[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:08:58 dist-test-slave-4tdj krb5kdc[7336](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:08:58 dist-test-slave-4tdj krb5kdc[7336](info): set up 2 sockets
Aug 09 19:08:58 dist-test-slave-4tdj krb5kdc[7336](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260809 19:08:59.887183 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.153s user 0.000s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:08:59 dist-test-slave-4tdj krb5kdc[7336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302539, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:09:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:09:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.39.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
I20260809 19:09:00.056777 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:44665
--webserver_interface=127.7.39.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:44055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:44665
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:00.410260 7357 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:00.410689 7357 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:00.410833 7357 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:00.417784 7357 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:09:00.417893 7357 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:00.417974 7357 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:00.418057 7357 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:09:00.418119 7357 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:09:00.427839 7357 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:44055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:44665
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:44665
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:00.429620 7357 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:00.431675 7357 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:00.451328 7371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:00.453601 7373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:00.454094 7365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:00.454210 7357 server_base.cc:1034] running on GCE node
I20260809 19:09:00.455417 7357 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:00.457839 7357 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:00.460327 7357 hybrid_clock.cc:648] HybridClock initialized: now 1786302540460166 us; error 138 us; skew 500 ppm
I20260809 19:09:00.461165 7357 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:00 dist-test-slave-4tdj krb5kdc[7336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302540, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:00.465325 7357 init.cc:377] Logged in from keytab as kudu/127.7.39.62@KRBTEST.COM (short username kudu)
I20260809 19:09:00.468256 7357 webserver.cc:460] Webserver started at http://127.7.39.62:40795/ using document root <none> and password file <none>
I20260809 19:09:00.469493 7357 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:00.469648 7357 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:00.470049 7357 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:00.475026 7357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "9cc20588ced145c6a9fb234533f3839b"
format_stamp: "Formatted at 2026-08-09 19:09:00 on dist-test-slave-4tdj"
server_key: "3e288b18e16b6a976d0e33d336a5aa20"
server_key_iv: "1c3722044afc6f758018cd14bfa64468"
server_key_version: "encryptionkey@0"
I20260809 19:09:00.476060 7357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "9cc20588ced145c6a9fb234533f3839b"
format_stamp: "Formatted at 2026-08-09 19:09:00 on dist-test-slave-4tdj"
server_key: "3e288b18e16b6a976d0e33d336a5aa20"
server_key_iv: "1c3722044afc6f758018cd14bfa64468"
server_key_version: "encryptionkey@0"
I20260809 19:09:00.483891 7357 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.002s sys 0.004s
I20260809 19:09:00.488034 7381 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:00.489825 7357 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260809 19:09:00.490146 7357 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "9cc20588ced145c6a9fb234533f3839b"
format_stamp: "Formatted at 2026-08-09 19:09:00 on dist-test-slave-4tdj"
server_key: "3e288b18e16b6a976d0e33d336a5aa20"
server_key_iv: "1c3722044afc6f758018cd14bfa64468"
server_key_version: "encryptionkey@0"
I20260809 19:09:00.490432 7357 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:00.504485 7357 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:00.508607 7357 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:00.508886 7357 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:00.528872 7357 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:44665
I20260809 19:09:00.528892 7470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:44665 every 8 connection(s)
I20260809 19:09:00.531047 7357 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:09:00.533684 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 7357
I20260809 19:09:00.534025 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:09:00.536005 7324 external_mini_cluster.cc:1428] Setting key 1402a132cb4140bd472419f91c8f800a
I20260809 19:09:00.536564 7471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:00.549651 7471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9cc20588ced145c6a9fb234533f3839b: Bootstrap starting.
I20260809 19:09:00.553177 7471 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9cc20588ced145c6a9fb234533f3839b: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:00.554277 7471 log.cc:824] T 00000000000000000000000000000000 P 9cc20588ced145c6a9fb234533f3839b: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:00.557482 7471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9cc20588ced145c6a9fb234533f3839b: No bootstrap required, opened a new log
Aug 09 19:09:00 dist-test-slave-4tdj krb5kdc[7336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302539, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:00.565526 7471 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9cc20588ced145c6a9fb234533f3839b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cc20588ced145c6a9fb234533f3839b" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 44665 } }
I20260809 19:09:00.565927 7471 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9cc20588ced145c6a9fb234533f3839b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:00.566160 7471 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9cc20588ced145c6a9fb234533f3839b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cc20588ced145c6a9fb234533f3839b, State: Initialized, Role: FOLLOWER
I20260809 19:09:00.567137 7471 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9cc20588ced145c6a9fb234533f3839b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cc20588ced145c6a9fb234533f3839b" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 44665 } }
I20260809 19:09:00.567422 7471 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9cc20588ced145c6a9fb234533f3839b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:09:00.567709 7471 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9cc20588ced145c6a9fb234533f3839b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:09:00.567915 7471 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9cc20588ced145c6a9fb234533f3839b [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:00.570120 7471 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9cc20588ced145c6a9fb234533f3839b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cc20588ced145c6a9fb234533f3839b" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 44665 } }
I20260809 19:09:00.570791 7471 leader_election.cc:302] T 00000000000000000000000000000000 P 9cc20588ced145c6a9fb234533f3839b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9cc20588ced145c6a9fb234533f3839b; no voters:
I20260809 19:09:00.571646 7471 leader_election.cc:288] T 00000000000000000000000000000000 P 9cc20588ced145c6a9fb234533f3839b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:09:00.571883 7479 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9cc20588ced145c6a9fb234533f3839b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:09:00.573874 7476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:00.541205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47584 (local address 127.7.39.62:44665)
0809 19:09:00.543670 (+ 2465us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:00.543684 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:00.543738 (+ 54us) server_negotiation.cc:407] Connection header received
0809 19:09:00.551986 (+ 8248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:00.552008 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:00.552406 (+ 398us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:00.552747 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:00.556066 (+ 3319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:00.557361 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:00.559071 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:00.559750 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:00.559942 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:00.565269 (+ 5327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:00.565288 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:00.565302 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:00.565340 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:00.568503 (+ 3163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:00.569233 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:00.569239 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:00.569244 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:00.569405 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:00.569837 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:00.569840 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:00.569842 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:00.570482 (+ 640us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:00.570898 (+ 416us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:00.571807 (+ 909us) server_negotiation.cc:299] Negotiation successful
0809 19:09:00.572290 (+ 483us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2150,"thread_start_us":1766,"threads_started":1}
I20260809 19:09:00.574776 7479 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9cc20588ced145c6a9fb234533f3839b [term 1 LEADER]: Becoming Leader. State: Replica: 9cc20588ced145c6a9fb234533f3839b, State: Running, Role: LEADER
I20260809 19:09:00.575665 7479 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9cc20588ced145c6a9fb234533f3839b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cc20588ced145c6a9fb234533f3839b" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 44665 } }
I20260809 19:09:00.577198 7471 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9cc20588ced145c6a9fb234533f3839b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:09:00.579694 7481 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9cc20588ced145c6a9fb234533f3839b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9cc20588ced145c6a9fb234533f3839b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cc20588ced145c6a9fb234533f3839b" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 44665 } } }
I20260809 19:09:00.580003 7481 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9cc20588ced145c6a9fb234533f3839b [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:00.580565 7480 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9cc20588ced145c6a9fb234533f3839b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9cc20588ced145c6a9fb234533f3839b. Latest consensus state: current_term: 1 leader_uuid: "9cc20588ced145c6a9fb234533f3839b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cc20588ced145c6a9fb234533f3839b" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 44665 } } }
I20260809 19:09:00.580871 7480 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9cc20588ced145c6a9fb234533f3839b [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:00.581156 7485 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:09:00.587863 7485 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:09:00.598924 7485 catalog_manager.cc:1347] Generated new cluster ID: 28c5c79306a14dcb9e337bc912ab2f7c
I20260809 19:09:00.599040 7485 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:09:00.612586 7485 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:09:00.614123 7485 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:09:00.619212 7485 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9cc20588ced145c6a9fb234533f3839b: Generated new TSK 0
I20260809 19:09:00.620057 7485 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.39.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
I20260809 19:09:00.669147 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.1:0
--local_ip_for_outbound_sockets=127.7.39.1
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:44665
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:44055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:00.990950 7512 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:00.991230 7512 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:00.991335 7512 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:00.998369 7512 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:00.998462 7512 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:00.998586 7512 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.1
I20260809 19:09:01.007858 7512 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:44055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:44665
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.1
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:01.009043 7512 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:01.010315 7512 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:01.026767 7520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:01.027015 7519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:01.031164 7523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:01.032459 7512 server_base.cc:1034] running on GCE node
I20260809 19:09:01.033177 7512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:01.034348 7512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:01.035555 7512 hybrid_clock.cc:648] HybridClock initialized: now 1786302541035480 us; error 52 us; skew 500 ppm
I20260809 19:09:01.035928 7512 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:01 dist-test-slave-4tdj krb5kdc[7336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302541, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:01.040257 7512 init.cc:377] Logged in from keytab as kudu/127.7.39.1@KRBTEST.COM (short username kudu)
I20260809 19:09:01.043193 7512 webserver.cc:460] Webserver started at http://127.7.39.1:38643/ using document root <none> and password file <none>
I20260809 19:09:01.044134 7512 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:01.044263 7512 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:01.044588 7512 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:01.048142 7512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-0/data/instance:
uuid: "4feead520eb44e5f842d9f654b89d9c4"
format_stamp: "Formatted at 2026-08-09 19:09:01 on dist-test-slave-4tdj"
server_key: "a39d9ca29fd556e34df1bd7e6503d9e2"
server_key_iv: "c50b800f5c9a846555cb2a9801c2677e"
server_key_version: "encryptionkey@0"
I20260809 19:09:01.049016 7512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance:
uuid: "4feead520eb44e5f842d9f654b89d9c4"
format_stamp: "Formatted at 2026-08-09 19:09:01 on dist-test-slave-4tdj"
server_key: "a39d9ca29fd556e34df1bd7e6503d9e2"
server_key_iv: "c50b800f5c9a846555cb2a9801c2677e"
server_key_version: "encryptionkey@0"
I20260809 19:09:01.054774 7512 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 19:09:01.058168 7535 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:01.059448 7512 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 19:09:01.059635 7512 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-0/wal
uuid: "4feead520eb44e5f842d9f654b89d9c4"
format_stamp: "Formatted at 2026-08-09 19:09:01 on dist-test-slave-4tdj"
server_key: "a39d9ca29fd556e34df1bd7e6503d9e2"
server_key_iv: "c50b800f5c9a846555cb2a9801c2677e"
server_key_version: "encryptionkey@0"
I20260809 19:09:01.059826 7512 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:01.080983 7512 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:01.085143 7512 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:01.085404 7512 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:01.086474 7512 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:09:01.088099 7512 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:01.088173 7512 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:01.088326 7512 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:01.088379 7512 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:01.120718 7512 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.1:36545
I20260809 19:09:01.120762 7705 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.1:36545 every 8 connection(s)
I20260809 19:09:01.122052 7512 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
I20260809 19:09:01.124549 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 7512
I20260809 19:09:01.124758 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance
I20260809 19:09:01.125583 7324 external_mini_cluster.cc:1428] Setting key 89b7b688b5ff7cc967db97544f29f3c8
Aug 09 19:09:01 dist-test-slave-4tdj krb5kdc[7336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302541, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.7.39.2@KRBTEST.COM; defaulting to no policy
I20260809 19:09:01.145056 7711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:01.125574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:54855 (local address 127.7.39.62:44665)
0809 19:09:01.130431 (+ 4857us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:01.130436 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:01.130451 (+ 15us) server_negotiation.cc:407] Connection header received
0809 19:09:01.130496 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:01.130500 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:01.130564 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:01.130657 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:01.132161 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:01.132938 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:01.134718 (+ 1780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:01.135113 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:01.135211 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:01.139169 (+ 3958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:01.139174 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:01.139177 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:01.139208 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:01.141668 (+ 2460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:01.142604 (+ 936us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:01.142608 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:01.142611 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:01.142734 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:01.143232 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:01.143235 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:01.143237 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:01.143495 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:01.143630 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:01.144559 (+ 929us) server_negotiation.cc:299] Negotiation successful
0809 19:09:01.144788 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4757,"thread_start_us":4650,"threads_started":1}
I20260809 19:09:01.145948 7712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:01.126325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:44665 (local address 127.7.39.1:54855)
0809 19:09:01.127203 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:01.127255 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:01.129753 (+ 2498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:01.130914 (+ 1161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:01.130923 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:01.131434 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:01.131982 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:01.131999 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:01.133094 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:01.133098 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:01.134574 (+ 1476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:01.134589 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:01.135332 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:01.135339 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:01.135624 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:01.136303 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:01.136338 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:01.138893 (+ 2555us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:01.141801 (+ 2908us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:01.141810 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:01.141828 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:01.142440 (+ 612us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:01.142842 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:01.142847 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:01.142851 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:01.143134 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:01.143640 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:01.143648 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:01.144106 (+ 458us) client_negotiation.cc:769] Sending connection context
0809 19:09:01.144423 (+ 317us) client_negotiation.cc:240] Negotiation successful
0809 19:09:01.144813 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":329,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.2@KRBTEST.COM" created.
I20260809 19:09:01.147716 7709 heartbeater.cc:347] Connected to a master server at 127.7.39.62:44665
I20260809 19:09:01.148144 7709 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:01.148978 7709 heartbeater.cc:511] Master 127.7.39.62:44665 requested a full tablet report, sending...
I20260809 19:09:01.153354 7408 ts_manager.cc:194] Registered new tserver with Master: 4feead520eb44e5f842d9f654b89d9c4 (127.7.39.1:36545)
I20260809 19:09:01.156211 7408 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.1@KRBTEST.COM'} at 127.7.39.1:54855
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
I20260809 19:09:01.167573 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.2:0
--local_ip_for_outbound_sockets=127.7.39.2
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:44665
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:44055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:01.475452 7715 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:01.475690 7715 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:01.475803 7715 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:01.482797 7715 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:01.482887 7715 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:01.483033 7715 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.2
I20260809 19:09:01.492046 7715 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:44055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:44665
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.2
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:01.493126 7715 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:01.494390 7715 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:01.506202 7723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:01.506309 7724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:01.506702 7727 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:01.507367 7715 server_base.cc:1034] running on GCE node
I20260809 19:09:01.507951 7715 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:01.508790 7715 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:01.509975 7715 hybrid_clock.cc:648] HybridClock initialized: now 1786302541509926 us; error 45 us; skew 500 ppm
I20260809 19:09:01.510260 7715 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:01 dist-test-slave-4tdj krb5kdc[7336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302541, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:01.513119 7715 init.cc:377] Logged in from keytab as kudu/127.7.39.2@KRBTEST.COM (short username kudu)
I20260809 19:09:01.514514 7715 webserver.cc:460] Webserver started at http://127.7.39.2:38081/ using document root <none> and password file <none>
I20260809 19:09:01.515136 7715 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:01.515247 7715 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:01.515523 7715 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:01.518234 7715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-1/data/instance:
uuid: "e7bf8005703e42478d4e050d1e55152d"
format_stamp: "Formatted at 2026-08-09 19:09:01 on dist-test-slave-4tdj"
server_key: "ae47eb3b084e73f7c376e97068d2a757"
server_key_iv: "f487c66d2485d182bbd1cd952e017841"
server_key_version: "encryptionkey@0"
I20260809 19:09:01.518982 7715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance:
uuid: "e7bf8005703e42478d4e050d1e55152d"
format_stamp: "Formatted at 2026-08-09 19:09:01 on dist-test-slave-4tdj"
server_key: "ae47eb3b084e73f7c376e97068d2a757"
server_key_iv: "f487c66d2485d182bbd1cd952e017841"
server_key_version: "encryptionkey@0"
I20260809 19:09:01.523671 7715 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 19:09:01.526815 7741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:01.527967 7715 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 19:09:01.528136 7715 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-1/wal
uuid: "e7bf8005703e42478d4e050d1e55152d"
format_stamp: "Formatted at 2026-08-09 19:09:01 on dist-test-slave-4tdj"
server_key: "ae47eb3b084e73f7c376e97068d2a757"
server_key_iv: "f487c66d2485d182bbd1cd952e017841"
server_key_version: "encryptionkey@0"
I20260809 19:09:01.528299 7715 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:01.553017 7715 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:01.556450 7715 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:01.556695 7715 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:01.557588 7715 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:09:01.558847 7715 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:01.558923 7715 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:01.559010 7715 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:01.559060 7715 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:01.589268 7715 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.2:37447
I20260809 19:09:01.589314 7940 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.2:37447 every 8 connection(s)
I20260809 19:09:01.590492 7715 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
I20260809 19:09:01.590886 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 7715
I20260809 19:09:01.591094 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance
I20260809 19:09:01.591648 7324 external_mini_cluster.cc:1428] Setting key 846dc111226459dde95cc35a42f88d7d
Aug 09 19:09:01 dist-test-slave-4tdj krb5kdc[7336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302541, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.7.39.3@KRBTEST.COM; defaulting to no policy
I20260809 19:09:01.610116 7711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:01.593057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:45263 (local address 127.7.39.62:44665)
0809 19:09:01.593244 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:01.593250 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:01.594519 (+ 1269us) server_negotiation.cc:407] Connection header received
0809 19:09:01.596371 (+ 1852us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:01.596376 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:01.596456 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:01.596548 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:01.597953 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:01.598774 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:01.600448 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:01.600858 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:01.600948 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:01.604760 (+ 3812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:01.604764 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:01.604768 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:01.604798 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:01.607205 (+ 2407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:01.608016 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:01.608019 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:01.608022 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:01.608136 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:01.608581 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:01.608584 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:01.608585 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:01.608819 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:01.608935 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:01.609675 (+ 740us) server_negotiation.cc:299] Negotiation successful
0809 19:09:01.609833 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 19:09:01.610982 7945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:01.593537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:44665 (local address 127.7.39.2:45263)
0809 19:09:01.594384 (+ 847us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:01.594429 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:01.596128 (+ 1699us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:01.596767 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:01.596775 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:01.597265 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:01.597795 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:01.597812 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:01.598927 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:01.598931 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:01.600306 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:01.600326 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:01.601076 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:01.601083 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:01.601352 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:01.602006 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:01.602034 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:01.604547 (+ 2513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:01.607342 (+ 2795us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:01.607350 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:01.607366 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:01.607917 (+ 551us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:01.608236 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:01.608241 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:01.608245 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:01.608482 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:01.608935 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:01.608943 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:01.609344 (+ 401us) client_negotiation.cc:769] Sending connection context
0809 19:09:01.609597 (+ 253us) client_negotiation.cc:240] Negotiation successful
0809 19:09:01.609942 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":328,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.3@KRBTEST.COM" created.
I20260809 19:09:01.612315 7943 heartbeater.cc:347] Connected to a master server at 127.7.39.62:44665
I20260809 19:09:01.612658 7943 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:01.613483 7943 heartbeater.cc:511] Master 127.7.39.62:44665 requested a full tablet report, sending...
I20260809 19:09:01.616050 7408 ts_manager.cc:194] Registered new tserver with Master: e7bf8005703e42478d4e050d1e55152d (127.7.39.2:37447)
I20260809 19:09:01.617102 7408 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.2@KRBTEST.COM'} at 127.7.39.2:45263
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
I20260809 19:09:01.630581 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.3:0
--local_ip_for_outbound_sockets=127.7.39.3
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:44665
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:44055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:01.947064 7949 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:01.947326 7949 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:01.947465 7949 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:01.954406 7949 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:01.954515 7949 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:01.954674 7949 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.3
I20260809 19:09:01.964022 7949 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:44055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:44665
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.3
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:01.965161 7949 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:01.966470 7949 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:01.978612 7962 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:01.978912 7958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:01.978636 7969 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:01.979346 7949 server_base.cc:1034] running on GCE node
I20260809 19:09:01.979954 7949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:01.980819 7949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:01.982013 7949 hybrid_clock.cc:648] HybridClock initialized: now 1786302541981969 us; error 35 us; skew 500 ppm
I20260809 19:09:01.982344 7949 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:01 dist-test-slave-4tdj krb5kdc[7336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302541, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:01.985347 7949 init.cc:377] Logged in from keytab as kudu/127.7.39.3@KRBTEST.COM (short username kudu)
I20260809 19:09:01.986732 7949 webserver.cc:460] Webserver started at http://127.7.39.3:40059/ using document root <none> and password file <none>
I20260809 19:09:01.987365 7949 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:01.987481 7949 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:01.987766 7949 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:01.990541 7949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-2/data/instance:
uuid: "da3090236c9e4c8d8f208bf3a91854c3"
format_stamp: "Formatted at 2026-08-09 19:09:01 on dist-test-slave-4tdj"
server_key: "52045a50bd1c620e80dbc8bc8539b88a"
server_key_iv: "dbb518d7d1d109dedd3835ab73ac219d"
server_key_version: "encryptionkey@0"
I20260809 19:09:01.991295 7949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance:
uuid: "da3090236c9e4c8d8f208bf3a91854c3"
format_stamp: "Formatted at 2026-08-09 19:09:01 on dist-test-slave-4tdj"
server_key: "52045a50bd1c620e80dbc8bc8539b88a"
server_key_iv: "dbb518d7d1d109dedd3835ab73ac219d"
server_key_version: "encryptionkey@0"
I20260809 19:09:01.996311 7949 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 19:09:01.999513 7988 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:02.000761 7949 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:09:02.000909 7949 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-2/wal
uuid: "da3090236c9e4c8d8f208bf3a91854c3"
format_stamp: "Formatted at 2026-08-09 19:09:01 on dist-test-slave-4tdj"
server_key: "52045a50bd1c620e80dbc8bc8539b88a"
server_key_iv: "dbb518d7d1d109dedd3835ab73ac219d"
server_key_version: "encryptionkey@0"
I20260809 19:09:02.001083 7949 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:02.017192 7949 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:02.020838 7949 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:02.021095 7949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:02.021991 7949 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:09:02.023408 7949 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:02.023487 7949 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:02.023610 7949 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:02.023685 7949 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:02.054200 7949 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.3:36643
I20260809 19:09:02.054261 8180 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.3:36643 every 8 connection(s)
I20260809 19:09:02.055449 7949 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
I20260809 19:09:02.063864 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 7949
I20260809 19:09:02.064081 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance
I20260809 19:09:02.064478 7324 external_mini_cluster.cc:1428] Setting key 782e707a97364824aaf1e296af1392a0
Aug 09 19:09:02 dist-test-slave-4tdj krb5kdc[7336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302541, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:02.074631 7711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:02.057818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:59175 (local address 127.7.39.62:44665)
0809 19:09:02.058014 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:02.058021 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:02.059233 (+ 1212us) server_negotiation.cc:407] Connection header received
0809 19:09:02.060939 (+ 1706us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:02.060943 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:02.061009 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:02.061093 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:02.062504 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:02.063306 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:02.065003 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:02.065517 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:02.065646 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:02.069371 (+ 3725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:02.069376 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:02.069379 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:02.069410 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:02.072205 (+ 2795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:02.072836 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:02.072839 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:02.072841 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:02.072949 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:02.073277 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:02.073280 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:02.073282 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:02.073524 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:02.073635 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:02.074193 (+ 558us) server_negotiation.cc:299] Negotiation successful
0809 19:09:02.074384 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 19:09:02.075508 8183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:02.058358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:44665 (local address 127.7.39.3:59175)
0809 19:09:02.059077 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:02.059123 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:02.060707 (+ 1584us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:02.061280 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:02.061288 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:02.061786 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:02.062361 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:02.062379 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:02.063464 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:02.063469 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:02.064860 (+ 1391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:02.064872 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:02.065731 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:02.065736 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:02.065990 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:02.066657 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:02.066679 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:02.069169 (+ 2490us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:02.072318 (+ 3149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:02.072324 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:02.072335 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:02.072745 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:02.073021 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:02.073024 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:02.073027 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:02.073197 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:02.073618 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:02.073624 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:02.073897 (+ 273us) client_negotiation.cc:769] Sending connection context
0809 19:09:02.074100 (+ 203us) client_negotiation.cc:240] Negotiation successful
0809 19:09:02.074492 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":277,"threads_started":1}
I20260809 19:09:02.076712 8181 heartbeater.cc:347] Connected to a master server at 127.7.39.62:44665
I20260809 19:09:02.076967 8181 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:02.077656 8181 heartbeater.cc:511] Master 127.7.39.62:44665 requested a full tablet report, sending...
I20260809 19:09:02.078994 7408 ts_manager.cc:194] Registered new tserver with Master: da3090236c9e4c8d8f208bf3a91854c3 (127.7.39.3:36643)
I20260809 19:09:02.079818 7408 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.3@KRBTEST.COM'} at 127.7.39.3:59175
I20260809 19:09:02.081238 7324 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 19:09:02 dist-test-slave-4tdj krb5kdc[7336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302542, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 19:09:02 dist-test-slave-4tdj krb5kdc[7336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302542, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.39.1@KRBTEST.COM
I20260809 19:09:02.129168 8191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:02.113927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57640 (local address 127.7.39.1:36545)
0809 19:09:02.114465 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:02.114472 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:02.114611 (+ 139us) server_negotiation.cc:407] Connection header received
0809 19:09:02.114781 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:02.114788 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:02.115000 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:02.115128 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:02.116434 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:02.117455 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:02.118672 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:02.119195 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:02.119288 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:02.123799 (+ 4511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:02.123810 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:02.123822 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:02.123855 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:02.126689 (+ 2834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:02.127260 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:02.127265 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:02.127267 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:02.127381 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:02.127774 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:02.127777 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:02.127779 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:02.128097 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:02.128318 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:02.128604 (+ 286us) server_negotiation.cc:299] Negotiation successful
0809 19:09:02.128834 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":229,"threads_started":1}
W20260809 19:09:02.130390 7570 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57640
Aug 09 19:09:02 dist-test-slave-4tdj krb5kdc[7336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302542, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
I20260809 19:09:02.159900 7709 heartbeater.cc:503] Master 127.7.39.62:44665 was elected leader, sending a full tablet report...
Aug 09 19:09:02 dist-test-slave-4tdj krb5kdc[7336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302542, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.1@KRBTEST.COM
I20260809 19:09:02.173321 8191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:02.160277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57654 (local address 127.7.39.1:36545)
0809 19:09:02.160479 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:02.160486 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:02.160951 (+ 465us) server_negotiation.cc:407] Connection header received
0809 19:09:02.161116 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:02.161120 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:02.161210 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:02.161290 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:02.162830 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:02.163568 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:02.164796 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:02.165180 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:02.165286 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:02.168733 (+ 3447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:02.168737 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:02.168740 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:02.168771 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:02.171281 (+ 2510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:02.171792 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:02.171796 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:02.171798 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:02.171908 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:02.172174 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:02.172177 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:02.172179 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:02.172402 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:02.172588 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:02.172788 (+ 200us) server_negotiation.cc:299] Negotiation successful
0809 19:09:02.173001 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 19:09:02.175108 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 7512
I20260809 19:09:02.186764 8191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:02.176106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57666 (local address 127.7.39.1:36545)
0809 19:09:02.176268 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:02.176274 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:02.176587 (+ 313us) server_negotiation.cc:407] Connection header received
0809 19:09:02.176721 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:02.176726 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:02.176779 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:02.176853 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:02.177931 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:02.178618 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:02.179810 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:02.180188 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:02.180291 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:02.182279 (+ 1988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:02.182283 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:02.182286 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:02.182368 (+ 82us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:02.184483 (+ 2115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:02.185052 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:02.185057 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:02.185060 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:02.185177 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:02.185511 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:02.185515 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:02.185517 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:02.185756 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:02.185960 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:02.186230 (+ 270us) server_negotiation.cc:299] Negotiation successful
0809 19:09:02.186436 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 19:09:02.187491 7700 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:02.273201 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 7512
I20260809 19:09:02.298069 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 7715
Aug 09 19:09:02 dist-test-slave-4tdj krb5kdc[7336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302542, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.2@KRBTEST.COM
I20260809 19:09:02.312783 8202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:02.298906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58444 (local address 127.7.39.2:37447)
0809 19:09:02.299466 (+ 560us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:02.299473 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:02.299500 (+ 27us) server_negotiation.cc:407] Connection header received
0809 19:09:02.299561 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:02.299567 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:02.299771 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:02.299898 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:02.300954 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:02.301960 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:02.303174 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:02.303695 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:02.303797 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:02.307634 (+ 3837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:02.307645 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:02.307659 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:02.307690 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:02.310152 (+ 2462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:02.310786 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:02.310793 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:02.310796 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:02.310913 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:02.311268 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:02.311272 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:02.311274 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:02.311598 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:02.311886 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:02.312200 (+ 314us) server_negotiation.cc:299] Negotiation successful
0809 19:09:02.312458 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":295,"threads_started":1}
I20260809 19:09:02.314050 7933 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:02.393478 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 7715
I20260809 19:09:02.411298 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 7949
Aug 09 19:09:02 dist-test-slave-4tdj krb5kdc[7336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302542, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.3@KRBTEST.COM
I20260809 19:09:02.427237 8205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:02.412326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60906 (local address 127.7.39.3:36643)
0809 19:09:02.412952 (+ 626us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:02.412958 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:02.412988 (+ 30us) server_negotiation.cc:407] Connection header received
0809 19:09:02.413046 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:02.413053 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:02.413257 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:02.413380 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:02.414710 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:02.415721 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:02.417028 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:02.417651 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:02.417747 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:02.421919 (+ 4172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:02.421931 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:02.421946 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:02.421991 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:02.424874 (+ 2883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:02.425422 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:02.425428 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:02.425431 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:02.425557 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:02.425845 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:02.425848 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:02.425850 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:02.426198 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:02.426563 (+ 365us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:02.426722 (+ 159us) server_negotiation.cc:299] Negotiation successful
0809 19:09:02.426920 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":324,"threads_started":1}
I20260809 19:09:02.428550 8173 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:02.508605 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 7949
I20260809 19:09:02.529412 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 7357
I20260809 19:09:02.530597 7465 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:02.631419 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 7357
2026-08-09T19:09:02Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (3958 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:09:02 dist-test-slave-4tdj krb5kdc[8215](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:09:02 dist-test-slave-4tdj krb5kdc[8215](info): set up 2 sockets
Aug 09 19:09:02 dist-test-slave-4tdj krb5kdc[8215](info): commencing operation
krb5kdc: starting...
W20260809 19:09:03.822118 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.142s user 0.002s sys 0.013s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:09:03 dist-test-slave-4tdj krb5kdc[8215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:09:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:09:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.39.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
I20260809 19:09:03.982936 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:42099
--webserver_interface=127.7.39.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:46411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:42099
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:04.300280 8236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:04.300565 8236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:04.300709 8236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:04.307802 8236 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:09:04.307907 8236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:04.307971 8236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:04.308064 8236 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:09:04.308132 8236 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:09:04.317643 8236 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:46411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:42099
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:42099
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:04.318874 8236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:04.320153 8236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:04.331368 8242 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:04.332445 8236 server_base.cc:1034] running on GCE node
W20260809 19:09:04.332821 8243 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:04.332847 8246 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:04.333694 8236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:04.335016 8236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:04.336225 8236 hybrid_clock.cc:648] HybridClock initialized: now 1786302544336170 us; error 35 us; skew 500 ppm
I20260809 19:09:04.336525 8236 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:04 dist-test-slave-4tdj krb5kdc[8215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302544, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:04.343297 8236 init.cc:377] Logged in from keytab as kudu/127.7.39.62@KRBTEST.COM (short username kudu)
I20260809 19:09:04.344669 8236 webserver.cc:460] Webserver started at http://127.7.39.62:36167/ using document root <none> and password file <none>
I20260809 19:09:04.345309 8236 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:04.345424 8236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:04.345726 8236 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:04.348591 8236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "a7449be969924c25b81841a74a9dc836"
format_stamp: "Formatted at 2026-08-09 19:09:04 on dist-test-slave-4tdj"
server_key: "99c83070a60cc2f49f51b420cd2a0b19"
server_key_iv: "4a5c2193d73a315dfd13e7e435de668e"
server_key_version: "encryptionkey@0"
I20260809 19:09:04.349288 8236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "a7449be969924c25b81841a74a9dc836"
format_stamp: "Formatted at 2026-08-09 19:09:04 on dist-test-slave-4tdj"
server_key: "99c83070a60cc2f49f51b420cd2a0b19"
server_key_iv: "4a5c2193d73a315dfd13e7e435de668e"
server_key_version: "encryptionkey@0"
I20260809 19:09:04.354142 8236 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 19:09:04.357406 8256 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:04.358623 8236 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:09:04.358781 8236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "a7449be969924c25b81841a74a9dc836"
format_stamp: "Formatted at 2026-08-09 19:09:04 on dist-test-slave-4tdj"
server_key: "99c83070a60cc2f49f51b420cd2a0b19"
server_key_iv: "4a5c2193d73a315dfd13e7e435de668e"
server_key_version: "encryptionkey@0"
I20260809 19:09:04.358956 8236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:04.383512 8236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:04.387035 8236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:04.387282 8236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:04.403828 8236 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:42099
I20260809 19:09:04.403864 8341 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:42099 every 8 connection(s)
I20260809 19:09:04.405030 8236 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:09:04.406960 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 8236
I20260809 19:09:04.407192 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:09:04.408032 7324 external_mini_cluster.cc:1428] Setting key b3e21a5a8c26e8deb57b9e0ae7002133
I20260809 19:09:04.409051 8343 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 19:09:04 dist-test-slave-4tdj krb5kdc[8215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:04.422322 8343 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7449be969924c25b81841a74a9dc836: Bootstrap starting.
I20260809 19:09:04.426148 8343 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a7449be969924c25b81841a74a9dc836: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:04.427292 8343 log.cc:824] T 00000000000000000000000000000000 P a7449be969924c25b81841a74a9dc836: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:04.430505 8343 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7449be969924c25b81841a74a9dc836: No bootstrap required, opened a new log
I20260809 19:09:04.430604 8349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:04.409913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57652 (local address 127.7.39.62:42099)
0809 19:09:04.410691 (+ 778us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:04.410705 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:04.410753 (+ 48us) server_negotiation.cc:407] Connection header received
0809 19:09:04.412462 (+ 1709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:04.412487 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:04.412947 (+ 460us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:04.413354 (+ 407us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:04.414682 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:04.416639 (+ 1957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:04.417781 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:04.418777 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:04.418957 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:04.422751 (+ 3794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:04.422761 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:04.422777 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:04.422821 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:04.426373 (+ 3552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:04.427035 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:04.427043 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:04.427051 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:04.427273 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:04.427654 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:04.427658 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:04.427661 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:04.428230 (+ 569us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:04.428450 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:04.428962 (+ 512us) server_negotiation.cc:299] Negotiation successful
0809 19:09:04.429352 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":552,"thread_start_us":327,"threads_started":1}
I20260809 19:09:04.437425 8343 raft_consensus.cc:348] T 00000000000000000000000000000000 P a7449be969924c25b81841a74a9dc836 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7449be969924c25b81841a74a9dc836" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 42099 } }
I20260809 19:09:04.437727 8343 raft_consensus.cc:374] T 00000000000000000000000000000000 P a7449be969924c25b81841a74a9dc836 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:04.437796 8343 raft_consensus.cc:729] T 00000000000000000000000000000000 P a7449be969924c25b81841a74a9dc836 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7449be969924c25b81841a74a9dc836, State: Initialized, Role: FOLLOWER
I20260809 19:09:04.438279 8343 consensus_queue.cc:260] T 00000000000000000000000000000000 P a7449be969924c25b81841a74a9dc836 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7449be969924c25b81841a74a9dc836" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 42099 } }
I20260809 19:09:04.438506 8343 raft_consensus.cc:388] T 00000000000000000000000000000000 P a7449be969924c25b81841a74a9dc836 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:09:04.438606 8343 raft_consensus.cc:482] T 00000000000000000000000000000000 P a7449be969924c25b81841a74a9dc836 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:09:04.438730 8343 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a7449be969924c25b81841a74a9dc836 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:04.440589 8343 raft_consensus.cc:504] T 00000000000000000000000000000000 P a7449be969924c25b81841a74a9dc836 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7449be969924c25b81841a74a9dc836" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 42099 } }
I20260809 19:09:04.440984 8343 leader_election.cc:302] T 00000000000000000000000000000000 P a7449be969924c25b81841a74a9dc836 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a7449be969924c25b81841a74a9dc836; no voters:
I20260809 19:09:04.441478 8343 leader_election.cc:288] T 00000000000000000000000000000000 P a7449be969924c25b81841a74a9dc836 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:09:04.441597 8352 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a7449be969924c25b81841a74a9dc836 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:09:04.442175 8352 raft_consensus.cc:686] T 00000000000000000000000000000000 P a7449be969924c25b81841a74a9dc836 [term 1 LEADER]: Becoming Leader. State: Replica: a7449be969924c25b81841a74a9dc836, State: Running, Role: LEADER
I20260809 19:09:04.442689 8352 consensus_queue.cc:237] T 00000000000000000000000000000000 P a7449be969924c25b81841a74a9dc836 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7449be969924c25b81841a74a9dc836" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 42099 } }
I20260809 19:09:04.443300 8343 sys_catalog.cc:564] T 00000000000000000000000000000000 P a7449be969924c25b81841a74a9dc836 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:09:04.445555 8356 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7449be969924c25b81841a74a9dc836 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a7449be969924c25b81841a74a9dc836. Latest consensus state: current_term: 1 leader_uuid: "a7449be969924c25b81841a74a9dc836" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7449be969924c25b81841a74a9dc836" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 42099 } } }
I20260809 19:09:04.445891 8356 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7449be969924c25b81841a74a9dc836 [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:04.446390 8355 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7449be969924c25b81841a74a9dc836 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a7449be969924c25b81841a74a9dc836" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7449be969924c25b81841a74a9dc836" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 42099 } } }
I20260809 19:09:04.446705 8355 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7449be969924c25b81841a74a9dc836 [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:04.447430 8365 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:09:04.452752 8365 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:09:04.460807 8365 catalog_manager.cc:1347] Generated new cluster ID: 8ecf2ee8f0004475afbba0aaed0f1736
I20260809 19:09:04.460908 8365 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:09:04.518790 8365 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:09:04.520048 8365 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:09:04.525697 8365 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a7449be969924c25b81841a74a9dc836: Generated new TSK 0
I20260809 19:09:04.526616 8365 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.39.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
I20260809 19:09:04.567246 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.1:0
--local_ip_for_outbound_sockets=127.7.39.1
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:42099
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:46411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:04.880854 8384 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:04.881101 8384 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:04.881194 8384 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:04.888114 8384 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:04.888211 8384 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:04.888325 8384 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.1
I20260809 19:09:04.897512 8384 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:46411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:42099
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.1
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:04.898638 8384 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:04.899885 8384 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:04.911756 8393 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:04.911844 8395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:04.911813 8398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:04.913136 8384 server_base.cc:1034] running on GCE node
I20260809 19:09:04.913686 8384 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:04.914521 8384 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:04.915717 8384 hybrid_clock.cc:648] HybridClock initialized: now 1786302544915676 us; error 34 us; skew 500 ppm
I20260809 19:09:04.915972 8384 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:04 dist-test-slave-4tdj krb5kdc[8215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302544, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:04.918879 8384 init.cc:377] Logged in from keytab as kudu/127.7.39.1@KRBTEST.COM (short username kudu)
I20260809 19:09:04.920240 8384 webserver.cc:460] Webserver started at http://127.7.39.1:43581/ using document root <none> and password file <none>
I20260809 19:09:04.920867 8384 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:04.920980 8384 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:04.921265 8384 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:04.924125 8384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-0/data/instance:
uuid: "540380a85aaa462eb4aac83a7ef6d5d4"
format_stamp: "Formatted at 2026-08-09 19:09:04 on dist-test-slave-4tdj"
server_key: "cf9148fa8ef175098d0775e1537b7fb2"
server_key_iv: "ea7c2a4d34a825dc97e88e423a39c65c"
server_key_version: "encryptionkey@0"
I20260809 19:09:04.924875 8384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance:
uuid: "540380a85aaa462eb4aac83a7ef6d5d4"
format_stamp: "Formatted at 2026-08-09 19:09:04 on dist-test-slave-4tdj"
server_key: "cf9148fa8ef175098d0775e1537b7fb2"
server_key_iv: "ea7c2a4d34a825dc97e88e423a39c65c"
server_key_version: "encryptionkey@0"
I20260809 19:09:04.930140 8384 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260809 19:09:04.933424 8407 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:04.934706 8384 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:09:04.934850 8384 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-0/wal
uuid: "540380a85aaa462eb4aac83a7ef6d5d4"
format_stamp: "Formatted at 2026-08-09 19:09:04 on dist-test-slave-4tdj"
server_key: "cf9148fa8ef175098d0775e1537b7fb2"
server_key_iv: "ea7c2a4d34a825dc97e88e423a39c65c"
server_key_version: "encryptionkey@0"
I20260809 19:09:04.935029 8384 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:04.968235 8384 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:04.971923 8384 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:04.972186 8384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:04.973065 8384 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:09:04.974356 8384 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:04.974439 8384 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:04.974574 8384 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:04.974634 8384 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:05.003870 8384 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.1:34553
I20260809 19:09:05.003916 8576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.1:34553 every 8 connection(s)
I20260809 19:09:05.005060 8384 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
I20260809 19:09:05.010704 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 8384
I20260809 19:09:05.010898 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance
I20260809 19:09:05.011502 7324 external_mini_cluster.cc:1428] Setting key e5bb62d0a4db5f23a72d5fcb79515598
Aug 09 19:09:05 dist-test-slave-4tdj krb5kdc[8215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302544, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:05.026489 8582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:05.007915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42099 (local address 127.7.39.1:53995)
0809 19:09:05.008569 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:05.008606 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:05.010214 (+ 1608us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:05.010929 (+ 715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:05.010936 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:05.011425 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:05.011977 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:05.012010 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:05.013168 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:05.013173 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:05.014516 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:05.014529 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:05.015459 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:05.015464 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:05.015679 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:05.016299 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:05.016326 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:05.018527 (+ 2201us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:05.022029 (+ 3502us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:05.022039 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:05.022055 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:05.022629 (+ 574us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:05.023044 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:05.023049 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:05.023053 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:05.023294 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:05.023913 (+ 619us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:05.023922 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:05.024332 (+ 410us) client_negotiation.cc:769] Sending connection context
0809 19:09:05.024628 (+ 296us) client_negotiation.cc:240] Negotiation successful
0809 19:09:05.025160 (+ 532us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":254,"threads_started":1}
I20260809 19:09:05.027096 8581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:05.007405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:53995 (local address 127.7.39.62:42099)
0809 19:09:05.007802 (+ 397us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:05.007807 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:05.008708 (+ 901us) server_negotiation.cc:407] Connection header received
0809 19:09:05.010520 (+ 1812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:05.010527 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:05.010600 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:05.010695 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:05.012190 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:05.013001 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:05.014661 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:05.015280 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:05.015404 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:05.018742 (+ 3338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:05.018747 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:05.018750 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:05.018783 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:05.021882 (+ 3099us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:05.022763 (+ 881us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:05.022769 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:05.022773 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:05.022922 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:05.023431 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:05.023436 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:05.023438 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:05.023789 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:05.023925 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:05.026509 (+ 2584us) server_negotiation.cc:299] Negotiation successful
0809 19:09:05.026743 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":195,"threads_started":1}
I20260809 19:09:05.028740 8578 heartbeater.cc:347] Connected to a master server at 127.7.39.62:42099
I20260809 19:09:05.029067 8578 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:05.029955 8578 heartbeater.cc:511] Master 127.7.39.62:42099 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.7.39.2@KRBTEST.COM; defaulting to no policy
I20260809 19:09:05.032222 8286 ts_manager.cc:194] Registered new tserver with Master: 540380a85aaa462eb4aac83a7ef6d5d4 (127.7.39.1:34553)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.2@KRBTEST.COM" created.
I20260809 19:09:05.033708 8286 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.1@KRBTEST.COM'} at 127.7.39.1:53995
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
I20260809 19:09:05.053287 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.2:0
--local_ip_for_outbound_sockets=127.7.39.2
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:42099
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:46411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:05.358649 8589 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:05.358887 8589 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:05.358985 8589 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:05.365778 8589 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:05.365869 8589 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:05.365981 8589 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.2
I20260809 19:09:05.375053 8589 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:46411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:42099
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.2
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:05.376089 8589 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:05.377306 8589 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:05.389070 8595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:05.389088 8601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:05.389070 8596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:05.389858 8589 server_base.cc:1034] running on GCE node
I20260809 19:09:05.390435 8589 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:05.391259 8589 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:05.392441 8589 hybrid_clock.cc:648] HybridClock initialized: now 1786302545392392 us; error 43 us; skew 500 ppm
I20260809 19:09:05.392712 8589 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:05 dist-test-slave-4tdj krb5kdc[8215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302545, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:05.395670 8589 init.cc:377] Logged in from keytab as kudu/127.7.39.2@KRBTEST.COM (short username kudu)
I20260809 19:09:05.396957 8589 webserver.cc:460] Webserver started at http://127.7.39.2:40953/ using document root <none> and password file <none>
I20260809 19:09:05.397567 8589 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:05.397681 8589 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:05.397953 8589 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:05.400641 8589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-1/data/instance:
uuid: "d0d222e36f29430ca02966d217bf58da"
format_stamp: "Formatted at 2026-08-09 19:09:05 on dist-test-slave-4tdj"
server_key: "f8ce0ffc4637e97db0ac31c40a33db12"
server_key_iv: "6bb8599f8d9193d955e0e74edd503e91"
server_key_version: "encryptionkey@0"
I20260809 19:09:05.401361 8589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance:
uuid: "d0d222e36f29430ca02966d217bf58da"
format_stamp: "Formatted at 2026-08-09 19:09:05 on dist-test-slave-4tdj"
server_key: "f8ce0ffc4637e97db0ac31c40a33db12"
server_key_iv: "6bb8599f8d9193d955e0e74edd503e91"
server_key_version: "encryptionkey@0"
I20260809 19:09:05.406330 8589 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260809 19:09:05.409648 8613 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:05.410969 8589 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260809 19:09:05.411115 8589 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-1/wal
uuid: "d0d222e36f29430ca02966d217bf58da"
format_stamp: "Formatted at 2026-08-09 19:09:05 on dist-test-slave-4tdj"
server_key: "f8ce0ffc4637e97db0ac31c40a33db12"
server_key_iv: "6bb8599f8d9193d955e0e74edd503e91"
server_key_version: "encryptionkey@0"
I20260809 19:09:05.411276 8589 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:05.425467 8589 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:05.428958 8589 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:05.429203 8589 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:05.430051 8589 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:09:05.431244 8589 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:05.431321 8589 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:05.431432 8589 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:05.431488 8589 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:05.460310 8589 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.2:43951
I20260809 19:09:05.460364 8789 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.2:43951 every 8 connection(s)
I20260809 19:09:05.461402 8589 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
I20260809 19:09:05.467746 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 8589
I20260809 19:09:05.467903 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance
I20260809 19:09:05.468319 7324 external_mini_cluster.cc:1428] Setting key d2e425d66c1dc3579a861bee2019f138
Aug 09 19:09:05 dist-test-slave-4tdj krb5kdc[8215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302545, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:05.480509 8581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:05.463591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:43437 (local address 127.7.39.62:42099)
0809 19:09:05.463748 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:05.463752 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:05.464801 (+ 1049us) server_negotiation.cc:407] Connection header received
0809 19:09:05.466503 (+ 1702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:05.466507 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:05.466582 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:05.466659 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:05.467996 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:05.468770 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:05.470571 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:05.470966 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:05.471071 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:05.474838 (+ 3767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:05.474842 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:05.474845 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:05.474877 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:05.477745 (+ 2868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:05.478429 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:05.478434 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:05.478438 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:05.478589 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:05.478950 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:05.478954 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:05.478957 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:05.479285 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:05.479430 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:05.480008 (+ 578us) server_negotiation.cc:299] Negotiation successful
0809 19:09:05.480220 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 19:09:05.481208 8792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:05.463973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42099 (local address 127.7.39.2:43437)
0809 19:09:05.464654 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:05.464693 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:05.466218 (+ 1525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:05.466836 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:05.466843 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:05.467277 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:05.467819 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:05.467842 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:05.468926 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:05.468930 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:05.470412 (+ 1482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:05.470428 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:05.471180 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:05.471187 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:05.471463 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:05.472090 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:05.472118 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:05.474631 (+ 2513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:05.477881 (+ 3250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:05.477887 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:05.477897 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:05.478285 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:05.478678 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:05.478681 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:05.478684 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:05.478853 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:05.479390 (+ 537us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:05.479395 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:05.479658 (+ 263us) client_negotiation.cc:769] Sending connection context
0809 19:09:05.479861 (+ 203us) client_negotiation.cc:240] Negotiation successful
0809 19:09:05.480197 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":248,"threads_started":1}
I20260809 19:09:05.482481 8790 heartbeater.cc:347] Connected to a master server at 127.7.39.62:42099
I20260809 19:09:05.482753 8790 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:05.483381 8790 heartbeater.cc:511] Master 127.7.39.62:42099 requested a full tablet report, sending...
I20260809 19:09:05.484709 8286 ts_manager.cc:194] Registered new tserver with Master: d0d222e36f29430ca02966d217bf58da (127.7.39.2:43951)
I20260809 19:09:05.485502 8286 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.2@KRBTEST.COM'} at 127.7.39.2:43437
WARNING: no policy specified for kudu/127.7.39.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
I20260809 19:09:05.506120 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.3:0
--local_ip_for_outbound_sockets=127.7.39.3
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:42099
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:46411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:05.816939 8796 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:05.817234 8796 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:05.817385 8796 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:05.824638 8796 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:05.824776 8796 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:05.824951 8796 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.3
I20260809 19:09:05.834766 8796 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:46411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:42099
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.3
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:05.836035 8796 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:05.837419 8796 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:05.850847 8813 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:05.850898 8809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:05.850924 8804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:05.851884 8796 server_base.cc:1034] running on GCE node
I20260809 19:09:05.852443 8796 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:05.853292 8796 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:05.854480 8796 hybrid_clock.cc:648] HybridClock initialized: now 1786302545854425 us; error 48 us; skew 500 ppm
I20260809 19:09:05.854771 8796 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:05 dist-test-slave-4tdj krb5kdc[8215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302545, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:05.857754 8796 init.cc:377] Logged in from keytab as kudu/127.7.39.3@KRBTEST.COM (short username kudu)
I20260809 19:09:05.859227 8796 webserver.cc:460] Webserver started at http://127.7.39.3:41347/ using document root <none> and password file <none>
I20260809 19:09:05.859867 8796 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:05.859980 8796 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:05.860275 8796 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:05.863168 8796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-2/data/instance:
uuid: "fd04f6d44f10426c9fbe102d900d267d"
format_stamp: "Formatted at 2026-08-09 19:09:05 on dist-test-slave-4tdj"
server_key: "13adfd5d542bed48829580caf0aa17df"
server_key_iv: "5102eba09b87bd1a78c8a6aaa7493303"
server_key_version: "encryptionkey@0"
I20260809 19:09:05.863901 8796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance:
uuid: "fd04f6d44f10426c9fbe102d900d267d"
format_stamp: "Formatted at 2026-08-09 19:09:05 on dist-test-slave-4tdj"
server_key: "13adfd5d542bed48829580caf0aa17df"
server_key_iv: "5102eba09b87bd1a78c8a6aaa7493303"
server_key_version: "encryptionkey@0"
I20260809 19:09:05.868669 8796 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 19:09:05.871805 8825 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:05.873011 8796 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 19:09:05.873150 8796 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-2/wal
uuid: "fd04f6d44f10426c9fbe102d900d267d"
format_stamp: "Formatted at 2026-08-09 19:09:05 on dist-test-slave-4tdj"
server_key: "13adfd5d542bed48829580caf0aa17df"
server_key_iv: "5102eba09b87bd1a78c8a6aaa7493303"
server_key_version: "encryptionkey@0"
I20260809 19:09:05.873323 8796 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:05.893054 8796 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:05.897083 8796 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:05.897337 8796 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:05.898260 8796 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:09:05.899536 8796 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:05.899617 8796 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:05.899736 8796 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:05.899793 8796 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:05.929708 8796 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.3:42083
I20260809 19:09:05.929767 9013 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.3:42083 every 8 connection(s)
I20260809 19:09:05.930953 8796 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
I20260809 19:09:05.939481 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 8796
I20260809 19:09:05.939649 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance
I20260809 19:09:05.940068 7324 external_mini_cluster.cc:1428] Setting key 3987d7777e01c762a8bfaae0da803df5
Aug 09 19:09:05 dist-test-slave-4tdj krb5kdc[8215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302545, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:05.949443 8581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:05.933251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:33293 (local address 127.7.39.62:42099)
0809 19:09:05.933441 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:05.933448 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:05.934588 (+ 1140us) server_negotiation.cc:407] Connection header received
0809 19:09:05.936323 (+ 1735us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:05.936327 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:05.936392 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:05.936477 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:05.937794 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:05.938593 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:05.940254 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:05.940759 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:05.940855 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:05.944261 (+ 3406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:05.944266 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:05.944269 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:05.944301 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:05.946662 (+ 2361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:05.947310 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:05.947315 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:05.947318 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:05.947431 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:05.947826 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:05.947831 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:05.947834 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:05.948116 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:05.948243 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:05.948884 (+ 641us) server_negotiation.cc:299] Negotiation successful
0809 19:09:05.949099 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 19:09:05.950455 9017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:05.933727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42099 (local address 127.7.39.3:33293)
0809 19:09:05.934445 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:05.934484 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:05.936090 (+ 1606us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:05.936657 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:05.936664 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:05.937136 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:05.937665 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:05.937681 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:05.938716 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:05.938720 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:05.940110 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:05.940123 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:05.940957 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:05.940964 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:05.941215 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:05.941845 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:05.941875 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:05.944072 (+ 2197us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:05.946793 (+ 2721us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:05.946802 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:05.946816 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:05.947200 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:05.947537 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:05.947542 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:05.947546 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:05.947722 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:05.948236 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:05.948243 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:05.948554 (+ 311us) client_negotiation.cc:769] Sending connection context
0809 19:09:05.948778 (+ 224us) client_negotiation.cc:240] Negotiation successful
0809 19:09:05.949248 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":270,"threads_started":1}
I20260809 19:09:05.951634 9015 heartbeater.cc:347] Connected to a master server at 127.7.39.62:42099
I20260809 19:09:05.951884 9015 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:05.952589 9015 heartbeater.cc:511] Master 127.7.39.62:42099 requested a full tablet report, sending...
I20260809 19:09:05.954005 8282 ts_manager.cc:194] Registered new tserver with Master: fd04f6d44f10426c9fbe102d900d267d (127.7.39.3:42083)
I20260809 19:09:05.955087 7324 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 19:09:05.955060 8282 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.3@KRBTEST.COM'} at 127.7.39.3:33293
I20260809 19:09:05.973912 8581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:05.962521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57666 (local address 127.7.39.62:42099)
0809 19:09:05.962677 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:05.962683 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:05.963129 (+ 446us) server_negotiation.cc:407] Connection header received
0809 19:09:05.963285 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:05.963290 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:05.963352 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:05.963426 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:05.964819 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:05.965523 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:05.966795 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:05.967224 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:05.967333 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:05.969368 (+ 2035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:05.969372 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:05.969376 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:05.969404 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:05.971540 (+ 2136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:05.972112 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:05.972118 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:05.972122 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:05.972230 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:05.972566 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:05.972571 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:05.972574 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:05.972867 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:05.973107 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:05.973409 (+ 302us) server_negotiation.cc:299] Negotiation successful
0809 19:09:05.973603 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 19:09:05.982190 8282 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57666:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:09:05.989138 8282 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:09:06.026728 9040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:06.005536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41562 (local address 127.7.39.1:34553)
0809 19:09:06.015632 (+ 10096us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:06.015642 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:06.017143 (+ 1501us) server_negotiation.cc:407] Connection header received
0809 19:09:06.017439 (+ 296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:06.017448 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:06.017687 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:06.017868 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:06.018856 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:06.020722 (+ 1866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:06.023793 (+ 3071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:06.025203 (+ 1410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:06.025344 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:06.025577 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:06.026136 (+ 559us) server_negotiation.cc:299] Negotiation successful
0809 19:09:06.026328 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9879,"thread_start_us":9660,"threads_started":1}
I20260809 19:09:06.027034 9039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:06.003857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:42083 (local address 127.0.0.1:49210)
0809 19:09:06.016220 (+ 12363us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:06.016265 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:06.016459 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:06.017672 (+ 1213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:06.017681 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:06.017717 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:06.018273 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:06.018326 (+ 53us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:06.021086 (+ 2760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:06.021098 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:06.024020 (+ 2922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:06.024040 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:06.026031 (+ 1991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:06.026038 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:06.026230 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:06.026266 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 19:09:06.026372 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 19:09:06.026605 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12103,"mutex_wait_us":8,"thread_start_us":12927,"threads_started":1}
I20260809 19:09:06.027220 9037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:06.004325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49210 (local address 127.7.39.3:42083)
0809 19:09:06.016993 (+ 12668us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:06.017002 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:06.017041 (+ 39us) server_negotiation.cc:407] Connection header received
0809 19:09:06.017140 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:06.017148 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:06.017404 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:06.018573 (+ 1169us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:06.018917 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:06.020873 (+ 1956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:06.024286 (+ 3413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:06.025801 (+ 1515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:06.025945 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:06.026202 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:06.026726 (+ 524us) server_negotiation.cc:299] Negotiation successful
0809 19:09:06.026886 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12514,"thread_start_us":12341,"threads_started":1}
I20260809 19:09:06.027735 9036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:06.004895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:34553 (local address 127.0.0.1:41562)
0809 19:09:06.017042 (+ 12147us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:06.017058 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:06.017252 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:06.018150 (+ 898us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:06.018155 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:06.018187 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:06.018654 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:06.018666 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:06.020925 (+ 2259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:06.020930 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:06.023592 (+ 2662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:06.023608 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:06.025608 (+ 2000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:06.025616 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:06.025825 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:06.025885 (+ 60us) client_negotiation.cc:769] Sending connection context
0809 19:09:06.026357 (+ 472us) client_negotiation.cc:240] Negotiation successful
0809 19:09:06.026603 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12017,"mutex_wait_us":33,"thread_start_us":10905,"threads_started":1}
I20260809 19:09:06.031389 8903 tablet_service.cc:1467] Processing CreateTablet for tablet f1dd7d4e37bc41d4bf8c35675977a0dd (DEFAULT_TABLE table=test-table [id=32aa35fedbd147588dc8d2eaf066b524]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:09:06.032356 9041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:06.017408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:43951 (local address 127.0.0.1:55356)
0809 19:09:06.023921 (+ 6513us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:06.023937 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:06.024051 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:06.026043 (+ 1992us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:06.026047 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:06.026073 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:06.026552 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:06.026565 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:06.028786 (+ 2221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:06.028791 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:06.030127 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:06.030140 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:06.031522 (+ 1382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:06.031529 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:06.031708 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:06.031739 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 19:09:06.031855 (+ 116us) client_negotiation.cc:240] Negotiation successful
0809 19:09:06.031990 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6397,"thread_start_us":6714,"threads_started":1}
I20260809 19:09:06.033114 9044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:06.017519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55356 (local address 127.7.39.2:43951)
0809 19:09:06.025541 (+ 8022us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:06.025550 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:06.025578 (+ 28us) server_negotiation.cc:407] Connection header received
0809 19:09:06.025672 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:06.025677 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:06.025833 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:06.026749 (+ 916us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:06.026965 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:06.028643 (+ 1678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:06.030319 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:06.031312 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:06.031449 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:06.031655 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:06.032594 (+ 939us) server_negotiation.cc:299] Negotiation successful
0809 19:09:06.032769 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7876,"thread_start_us":7731,"threads_started":1}
I20260809 19:09:06.033257 8903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1dd7d4e37bc41d4bf8c35675977a0dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:06.033896 8483 tablet_service.cc:1467] Processing CreateTablet for tablet f1dd7d4e37bc41d4bf8c35675977a0dd (DEFAULT_TABLE table=test-table [id=32aa35fedbd147588dc8d2eaf066b524]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:09:06.035400 8483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1dd7d4e37bc41d4bf8c35675977a0dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:06.036420 8578 heartbeater.cc:503] Master 127.7.39.62:42099 was elected leader, sending a full tablet report...
I20260809 19:09:06.036010 8686 tablet_service.cc:1467] Processing CreateTablet for tablet f1dd7d4e37bc41d4bf8c35675977a0dd (DEFAULT_TABLE table=test-table [id=32aa35fedbd147588dc8d2eaf066b524]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:09:06.037412 8686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1dd7d4e37bc41d4bf8c35675977a0dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:06.049474 9045 tablet_bootstrap.cc:492] T f1dd7d4e37bc41d4bf8c35675977a0dd P d0d222e36f29430ca02966d217bf58da: Bootstrap starting.
I20260809 19:09:06.051708 9051 tablet_bootstrap.cc:492] T f1dd7d4e37bc41d4bf8c35675977a0dd P 540380a85aaa462eb4aac83a7ef6d5d4: Bootstrap starting.
I20260809 19:09:06.053153 9052 tablet_bootstrap.cc:492] T f1dd7d4e37bc41d4bf8c35675977a0dd P fd04f6d44f10426c9fbe102d900d267d: Bootstrap starting.
I20260809 19:09:06.054080 9045 tablet_bootstrap.cc:654] T f1dd7d4e37bc41d4bf8c35675977a0dd P d0d222e36f29430ca02966d217bf58da: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:06.055497 9045 log.cc:824] T f1dd7d4e37bc41d4bf8c35675977a0dd P d0d222e36f29430ca02966d217bf58da: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:06.055613 9051 tablet_bootstrap.cc:654] T f1dd7d4e37bc41d4bf8c35675977a0dd P 540380a85aaa462eb4aac83a7ef6d5d4: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:06.056089 9052 tablet_bootstrap.cc:654] T f1dd7d4e37bc41d4bf8c35675977a0dd P fd04f6d44f10426c9fbe102d900d267d: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:06.056811 9051 log.cc:824] T f1dd7d4e37bc41d4bf8c35675977a0dd P 540380a85aaa462eb4aac83a7ef6d5d4: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:06.057408 9052 log.cc:824] T f1dd7d4e37bc41d4bf8c35675977a0dd P fd04f6d44f10426c9fbe102d900d267d: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:06.058760 9045 tablet_bootstrap.cc:492] T f1dd7d4e37bc41d4bf8c35675977a0dd P d0d222e36f29430ca02966d217bf58da: No bootstrap required, opened a new log
I20260809 19:09:06.059033 9045 ts_tablet_manager.cc:1397] T f1dd7d4e37bc41d4bf8c35675977a0dd P d0d222e36f29430ca02966d217bf58da: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260809 19:09:06.059832 9051 tablet_bootstrap.cc:492] T f1dd7d4e37bc41d4bf8c35675977a0dd P 540380a85aaa462eb4aac83a7ef6d5d4: No bootstrap required, opened a new log
I20260809 19:09:06.060108 9051 ts_tablet_manager.cc:1397] T f1dd7d4e37bc41d4bf8c35675977a0dd P 540380a85aaa462eb4aac83a7ef6d5d4: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260809 19:09:06.061153 9052 tablet_bootstrap.cc:492] T f1dd7d4e37bc41d4bf8c35675977a0dd P fd04f6d44f10426c9fbe102d900d267d: No bootstrap required, opened a new log
I20260809 19:09:06.061395 9052 ts_tablet_manager.cc:1397] T f1dd7d4e37bc41d4bf8c35675977a0dd P fd04f6d44f10426c9fbe102d900d267d: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260809 19:09:06.067644 9051 raft_consensus.cc:348] T f1dd7d4e37bc41d4bf8c35675977a0dd P 540380a85aaa462eb4aac83a7ef6d5d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd04f6d44f10426c9fbe102d900d267d" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 42083 } } peers { permanent_uuid: "540380a85aaa462eb4aac83a7ef6d5d4" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 34553 } } peers { permanent_uuid: "d0d222e36f29430ca02966d217bf58da" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43951 } }
I20260809 19:09:06.068007 9051 raft_consensus.cc:374] T f1dd7d4e37bc41d4bf8c35675977a0dd P 540380a85aaa462eb4aac83a7ef6d5d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:06.068130 9051 raft_consensus.cc:729] T f1dd7d4e37bc41d4bf8c35675977a0dd P 540380a85aaa462eb4aac83a7ef6d5d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 540380a85aaa462eb4aac83a7ef6d5d4, State: Initialized, Role: FOLLOWER
I20260809 19:09:06.068734 9051 consensus_queue.cc:260] T f1dd7d4e37bc41d4bf8c35675977a0dd P 540380a85aaa462eb4aac83a7ef6d5d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd04f6d44f10426c9fbe102d900d267d" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 42083 } } peers { permanent_uuid: "540380a85aaa462eb4aac83a7ef6d5d4" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 34553 } } peers { permanent_uuid: "d0d222e36f29430ca02966d217bf58da" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43951 } }
I20260809 19:09:06.069414 9045 raft_consensus.cc:348] T f1dd7d4e37bc41d4bf8c35675977a0dd P d0d222e36f29430ca02966d217bf58da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd04f6d44f10426c9fbe102d900d267d" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 42083 } } peers { permanent_uuid: "540380a85aaa462eb4aac83a7ef6d5d4" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 34553 } } peers { permanent_uuid: "d0d222e36f29430ca02966d217bf58da" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43951 } }
I20260809 19:09:06.069880 9045 raft_consensus.cc:374] T f1dd7d4e37bc41d4bf8c35675977a0dd P d0d222e36f29430ca02966d217bf58da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:06.070026 9045 raft_consensus.cc:729] T f1dd7d4e37bc41d4bf8c35675977a0dd P d0d222e36f29430ca02966d217bf58da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0d222e36f29430ca02966d217bf58da, State: Initialized, Role: FOLLOWER
I20260809 19:09:06.070621 9051 ts_tablet_manager.cc:1428] T f1dd7d4e37bc41d4bf8c35675977a0dd P 540380a85aaa462eb4aac83a7ef6d5d4: Time spent starting tablet: real 0.010s user 0.006s sys 0.004s
I20260809 19:09:06.070802 9045 consensus_queue.cc:260] T f1dd7d4e37bc41d4bf8c35675977a0dd P d0d222e36f29430ca02966d217bf58da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd04f6d44f10426c9fbe102d900d267d" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 42083 } } peers { permanent_uuid: "540380a85aaa462eb4aac83a7ef6d5d4" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 34553 } } peers { permanent_uuid: "d0d222e36f29430ca02966d217bf58da" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43951 } }
I20260809 19:09:06.071429 9052 raft_consensus.cc:348] T f1dd7d4e37bc41d4bf8c35675977a0dd P fd04f6d44f10426c9fbe102d900d267d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd04f6d44f10426c9fbe102d900d267d" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 42083 } } peers { permanent_uuid: "540380a85aaa462eb4aac83a7ef6d5d4" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 34553 } } peers { permanent_uuid: "d0d222e36f29430ca02966d217bf58da" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43951 } }
I20260809 19:09:06.071869 9052 raft_consensus.cc:374] T f1dd7d4e37bc41d4bf8c35675977a0dd P fd04f6d44f10426c9fbe102d900d267d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:06.071967 9052 raft_consensus.cc:729] T f1dd7d4e37bc41d4bf8c35675977a0dd P fd04f6d44f10426c9fbe102d900d267d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd04f6d44f10426c9fbe102d900d267d, State: Initialized, Role: FOLLOWER
I20260809 19:09:06.072571 9052 consensus_queue.cc:260] T f1dd7d4e37bc41d4bf8c35675977a0dd P fd04f6d44f10426c9fbe102d900d267d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd04f6d44f10426c9fbe102d900d267d" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 42083 } } peers { permanent_uuid: "540380a85aaa462eb4aac83a7ef6d5d4" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 34553 } } peers { permanent_uuid: "d0d222e36f29430ca02966d217bf58da" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43951 } }
I20260809 19:09:06.074278 9045 ts_tablet_manager.cc:1428] T f1dd7d4e37bc41d4bf8c35675977a0dd P d0d222e36f29430ca02966d217bf58da: Time spent starting tablet: real 0.015s user 0.006s sys 0.008s
I20260809 19:09:06.074260 9015 heartbeater.cc:503] Master 127.7.39.62:42099 was elected leader, sending a full tablet report...
I20260809 19:09:06.074806 9052 ts_tablet_manager.cc:1428] T f1dd7d4e37bc41d4bf8c35675977a0dd P fd04f6d44f10426c9fbe102d900d267d: Time spent starting tablet: real 0.013s user 0.015s sys 0.000s
I20260809 19:09:06.074882 8790 heartbeater.cc:503] Master 127.7.39.62:42099 was elected leader, sending a full tablet report...
I20260809 19:09:06.167261 9062 raft_consensus.cc:482] T f1dd7d4e37bc41d4bf8c35675977a0dd P fd04f6d44f10426c9fbe102d900d267d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:09:06.167548 9062 raft_consensus.cc:504] T f1dd7d4e37bc41d4bf8c35675977a0dd P fd04f6d44f10426c9fbe102d900d267d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd04f6d44f10426c9fbe102d900d267d" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 42083 } } peers { permanent_uuid: "540380a85aaa462eb4aac83a7ef6d5d4" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 34553 } } peers { permanent_uuid: "d0d222e36f29430ca02966d217bf58da" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43951 } }
I20260809 19:09:06.169332 9062 leader_election.cc:288] T f1dd7d4e37bc41d4bf8c35675977a0dd P fd04f6d44f10426c9fbe102d900d267d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 540380a85aaa462eb4aac83a7ef6d5d4 (127.7.39.1:34553), d0d222e36f29430ca02966d217bf58da (127.7.39.2:43951)
I20260809 19:09:06.175194 9044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:06.169902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:43507 (local address 127.7.39.2:43951)
0809 19:09:06.170126 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:06.170133 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:06.170156 (+ 23us) server_negotiation.cc:407] Connection header received
0809 19:09:06.170264 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:06.170270 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:06.170373 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:06.170456 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:06.170866 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:06.171806 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:06.173547 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:06.174343 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:06.174466 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:06.174558 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:06.174821 (+ 263us) server_negotiation.cc:299] Negotiation successful
0809 19:09:06.174946 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 19:09:06.175199 9017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:06.169672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:43951 (local address 127.7.39.3:43507)
0809 19:09:06.169978 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:06.169997 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:06.170125 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:06.170507 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:06.170512 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:06.170540 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:06.170744 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:06.170753 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:06.171954 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:06.171959 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:06.173397 (+ 1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:06.173410 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:06.174483 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:06.174489 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:06.174681 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:06.174704 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 19:09:06.174782 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 19:09:06.174912 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179}
I20260809 19:09:06.175513 9040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:06.169666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:49961 (local address 127.7.39.1:34553)
0809 19:09:06.169868 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:06.169874 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:06.170588 (+ 714us) server_negotiation.cc:407] Connection header received
0809 19:09:06.170724 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:06.170728 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:06.170782 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:06.170871 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:06.171342 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:06.172260 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:06.173884 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:06.174688 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:06.174805 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:06.174897 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:06.175170 (+ 273us) server_negotiation.cc:299] Negotiation successful
0809 19:09:06.175289 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 19:09:06.175590 9063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:06.169698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:34553 (local address 127.7.39.3:49961)
0809 19:09:06.170480 (+ 782us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:06.170496 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:06.170621 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:06.170888 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:06.170891 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:06.170917 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:06.171198 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:06.171205 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:06.172410 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:06.172415 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:06.173740 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:06.173752 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:06.174889 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:06.174895 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:06.175026 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:06.175052 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 19:09:06.175133 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 19:09:06.175257 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":676,"thread_start_us":427,"threads_started":1}
I20260809 19:09:06.176566 8723 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1dd7d4e37bc41d4bf8c35675977a0dd" candidate_uuid: "fd04f6d44f10426c9fbe102d900d267d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d222e36f29430ca02966d217bf58da" is_pre_election: true
I20260809 19:09:06.176596 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1dd7d4e37bc41d4bf8c35675977a0dd" candidate_uuid: "fd04f6d44f10426c9fbe102d900d267d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "540380a85aaa462eb4aac83a7ef6d5d4" is_pre_election: true
I20260809 19:09:06.177274 8723 raft_consensus.cc:2454] T f1dd7d4e37bc41d4bf8c35675977a0dd P d0d222e36f29430ca02966d217bf58da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd04f6d44f10426c9fbe102d900d267d in term 0.
I20260809 19:09:06.177950 8831 leader_election.cc:302] T f1dd7d4e37bc41d4bf8c35675977a0dd P fd04f6d44f10426c9fbe102d900d267d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0d222e36f29430ca02966d217bf58da, fd04f6d44f10426c9fbe102d900d267d; no voters:
I20260809 19:09:06.178304 9062 raft_consensus.cc:2781] T f1dd7d4e37bc41d4bf8c35675977a0dd P fd04f6d44f10426c9fbe102d900d267d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:09:06.178421 9062 raft_consensus.cc:482] T f1dd7d4e37bc41d4bf8c35675977a0dd P fd04f6d44f10426c9fbe102d900d267d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:09:06.178493 9062 raft_consensus.cc:3037] T f1dd7d4e37bc41d4bf8c35675977a0dd P fd04f6d44f10426c9fbe102d900d267d [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:06.178853 8517 raft_consensus.cc:2454] T f1dd7d4e37bc41d4bf8c35675977a0dd P 540380a85aaa462eb4aac83a7ef6d5d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd04f6d44f10426c9fbe102d900d267d in term 0.
I20260809 19:09:06.180837 9062 raft_consensus.cc:504] T f1dd7d4e37bc41d4bf8c35675977a0dd P fd04f6d44f10426c9fbe102d900d267d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd04f6d44f10426c9fbe102d900d267d" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 42083 } } peers { permanent_uuid: "540380a85aaa462eb4aac83a7ef6d5d4" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 34553 } } peers { permanent_uuid: "d0d222e36f29430ca02966d217bf58da" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43951 } }
I20260809 19:09:06.181357 9062 leader_election.cc:288] T f1dd7d4e37bc41d4bf8c35675977a0dd P fd04f6d44f10426c9fbe102d900d267d [CANDIDATE]: Term 1 election: Requested vote from peers 540380a85aaa462eb4aac83a7ef6d5d4 (127.7.39.1:34553), d0d222e36f29430ca02966d217bf58da (127.7.39.2:43951)
I20260809 19:09:06.181702 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1dd7d4e37bc41d4bf8c35675977a0dd" candidate_uuid: "fd04f6d44f10426c9fbe102d900d267d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "540380a85aaa462eb4aac83a7ef6d5d4"
I20260809 19:09:06.181804 8723 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1dd7d4e37bc41d4bf8c35675977a0dd" candidate_uuid: "fd04f6d44f10426c9fbe102d900d267d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d222e36f29430ca02966d217bf58da"
I20260809 19:09:06.181869 8517 raft_consensus.cc:3037] T f1dd7d4e37bc41d4bf8c35675977a0dd P 540380a85aaa462eb4aac83a7ef6d5d4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:06.181993 8723 raft_consensus.cc:3037] T f1dd7d4e37bc41d4bf8c35675977a0dd P d0d222e36f29430ca02966d217bf58da [term 0 FOLLOWER]: Advancing to term 1
W20260809 19:09:06.182443 9016 tablet.cc:2369] T f1dd7d4e37bc41d4bf8c35675977a0dd P fd04f6d44f10426c9fbe102d900d267d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:09:06.184207 8723 raft_consensus.cc:2454] T f1dd7d4e37bc41d4bf8c35675977a0dd P d0d222e36f29430ca02966d217bf58da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd04f6d44f10426c9fbe102d900d267d in term 1.
I20260809 19:09:06.184371 8517 raft_consensus.cc:2454] T f1dd7d4e37bc41d4bf8c35675977a0dd P 540380a85aaa462eb4aac83a7ef6d5d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd04f6d44f10426c9fbe102d900d267d in term 1.
I20260809 19:09:06.184540 8831 leader_election.cc:302] T f1dd7d4e37bc41d4bf8c35675977a0dd P fd04f6d44f10426c9fbe102d900d267d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0d222e36f29430ca02966d217bf58da, fd04f6d44f10426c9fbe102d900d267d; no voters:
I20260809 19:09:06.184821 9062 raft_consensus.cc:2781] T f1dd7d4e37bc41d4bf8c35675977a0dd P fd04f6d44f10426c9fbe102d900d267d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:09:06.185307 9062 raft_consensus.cc:686] T f1dd7d4e37bc41d4bf8c35675977a0dd P fd04f6d44f10426c9fbe102d900d267d [term 1 LEADER]: Becoming Leader. State: Replica: fd04f6d44f10426c9fbe102d900d267d, State: Running, Role: LEADER
I20260809 19:09:06.185761 9062 consensus_queue.cc:237] T f1dd7d4e37bc41d4bf8c35675977a0dd P fd04f6d44f10426c9fbe102d900d267d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd04f6d44f10426c9fbe102d900d267d" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 42083 } } peers { permanent_uuid: "540380a85aaa462eb4aac83a7ef6d5d4" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 34553 } } peers { permanent_uuid: "d0d222e36f29430ca02966d217bf58da" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43951 } }
I20260809 19:09:06.190182 8286 catalog_manager.cc:5495] T f1dd7d4e37bc41d4bf8c35675977a0dd P fd04f6d44f10426c9fbe102d900d267d reported cstate change: term changed from 0 to 1, leader changed from <none> to fd04f6d44f10426c9fbe102d900d267d (127.7.39.3). New cstate: current_term: 1 leader_uuid: "fd04f6d44f10426c9fbe102d900d267d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd04f6d44f10426c9fbe102d900d267d" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 42083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "540380a85aaa462eb4aac83a7ef6d5d4" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 34553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0d222e36f29430ca02966d217bf58da" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43951 } health_report { overall_health: UNKNOWN } } }
W20260809 19:09:06.213258 8791 tablet.cc:2369] T f1dd7d4e37bc41d4bf8c35675977a0dd P d0d222e36f29430ca02966d217bf58da: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 19:09:06 dist-test-slave-4tdj krb5kdc[8215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.1@KRBTEST.COM
I20260809 19:09:06.224480 9040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:06.210963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41564 (local address 127.7.39.1:34553)
0809 19:09:06.211124 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:06.211128 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:06.211644 (+ 516us) server_negotiation.cc:407] Connection header received
0809 19:09:06.211803 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:06.211807 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:06.211868 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:06.211961 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:06.213420 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:06.214141 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:06.215373 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:06.215788 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:06.215898 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:06.219603 (+ 3705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:06.219615 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:06.219629 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:06.219661 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:06.222178 (+ 2517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:06.222803 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:06.222810 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:06.222812 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:06.222931 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:06.223199 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:06.223202 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:06.223203 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:06.223536 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:06.223798 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:06.223996 (+ 198us) server_negotiation.cc:299] Negotiation successful
0809 19:09:06.224151 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
Aug 09 19:09:06 dist-test-slave-4tdj krb5kdc[8215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302546, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
W20260809 19:09:06.257230 8579 tablet.cc:2369] T f1dd7d4e37bc41d4bf8c35675977a0dd P 540380a85aaa462eb4aac83a7ef6d5d4: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 19:09:06 dist-test-slave-4tdj krb5kdc[8215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302546, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.39.1@KRBTEST.COM
I20260809 19:09:06.267946 9040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:06.255414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41576 (local address 127.7.39.1:34553)
0809 19:09:06.255613 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:06.255620 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:06.255916 (+ 296us) server_negotiation.cc:407] Connection header received
0809 19:09:06.256082 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:06.256086 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:06.256149 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:06.256231 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:06.257699 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:06.258531 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:06.259767 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:06.260162 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:06.260249 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:06.263763 (+ 3514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:06.263767 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:06.263771 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:06.263801 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:06.266028 (+ 2227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:06.266569 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:06.266573 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:06.266575 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:06.266703 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:06.266980 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:06.266983 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:06.266985 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:06.267218 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:06.267388 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:06.267558 (+ 170us) server_negotiation.cc:299] Negotiation successful
0809 19:09:06.267710 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
Aug 09 19:09:06 dist-test-slave-4tdj krb5kdc[8215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302546, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 19:09:06 dist-test-slave-4tdj krb5kdc[8215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302546, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.1@KRBTEST.COM
I20260809 19:09:06.308267 9040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:06.295874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41592 (local address 127.7.39.1:34553)
0809 19:09:06.296086 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:06.296091 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:06.296245 (+ 154us) server_negotiation.cc:407] Connection header received
0809 19:09:06.296405 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:06.296409 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:06.296468 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:06.296559 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:06.297782 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:06.298501 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:06.299660 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:06.300079 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:06.300186 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:06.303638 (+ 3452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:06.303642 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:06.303645 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:06.303677 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:06.305868 (+ 2191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:06.306505 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:06.306509 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:06.306511 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:06.306636 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:06.306967 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:06.306972 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:06.306975 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:06.307238 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:06.307470 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:06.307757 (+ 287us) server_negotiation.cc:299] Negotiation successful
0809 19:09:06.307967 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
W20260809 19:09:06.310619 8452 tablet_service.cc:2908] Rejecting scan request for tablet f1dd7d4e37bc41d4bf8c35675977a0dd: Uninitialized: clean time has not yet been initialized
I20260809 19:09:06.314007 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 8384
I20260809 19:09:06.325336 9040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:06.314897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41594 (local address 127.7.39.1:34553)
0809 19:09:06.315037 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:06.315042 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:06.315315 (+ 273us) server_negotiation.cc:407] Connection header received
0809 19:09:06.315423 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:06.315426 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:06.315487 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:06.315605 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:06.316602 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:06.317216 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:06.318266 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:06.318729 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:06.318829 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:06.320684 (+ 1855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:06.320689 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:06.320692 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:06.320719 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:06.323039 (+ 2320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:06.323764 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:06.323768 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:06.323770 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:06.323884 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:06.324258 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:06.324261 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:06.324263 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:06.324489 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:06.324694 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:06.324959 (+ 265us) server_negotiation.cc:299] Negotiation successful
0809 19:09:06.325101 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 19:09:06.325908 8571 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:06.411931 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 8384
I20260809 19:09:06.432709 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 8589
Aug 09 19:09:06 dist-test-slave-4tdj krb5kdc[8215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302546, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.2@KRBTEST.COM
I20260809 19:09:06.447118 9044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:06.433556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55362 (local address 127.7.39.2:43951)
0809 19:09:06.433742 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:06.433747 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:06.433768 (+ 21us) server_negotiation.cc:407] Connection header received
0809 19:09:06.433835 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:06.433841 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:06.433925 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:06.434012 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:06.435233 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:06.435958 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:06.437170 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:06.437551 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:06.437658 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:06.441512 (+ 3854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:06.441525 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:06.441541 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:06.441580 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:06.444358 (+ 2778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:06.445081 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:06.445088 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:06.445090 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:06.445234 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:06.445581 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:06.445587 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:06.445589 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:06.446000 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:06.446360 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:06.446599 (+ 239us) server_negotiation.cc:299] Negotiation successful
0809 19:09:06.446800 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 19:09:06.447778 8783 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:06.531988 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 8589
I20260809 19:09:06.556061 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 8796
Aug 09 19:09:06 dist-test-slave-4tdj krb5kdc[8215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302546, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.3@KRBTEST.COM
I20260809 19:09:06.570263 9088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:06.556828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49226 (local address 127.7.39.3:42083)
0809 19:09:06.557248 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:06.557253 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:06.557269 (+ 16us) server_negotiation.cc:407] Connection header received
0809 19:09:06.557323 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:06.557327 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:06.557386 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:06.557479 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:06.558691 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:06.559415 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:06.560699 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:06.561093 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:06.561188 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:06.565193 (+ 4005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:06.565218 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:06.565236 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:06.565268 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:06.567747 (+ 2479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:06.568346 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:06.568353 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:06.568355 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:06.568473 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:06.568834 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:06.568838 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:06.568840 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:06.569187 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:06.569447 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:06.569720 (+ 273us) server_negotiation.cc:299] Negotiation successful
0809 19:09:06.569943 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":216,"threads_started":1}
I20260809 19:09:06.570888 9005 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:06.657920 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 8796
I20260809 19:09:06.680219 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 8236
I20260809 19:09:06.681392 8335 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:06.786705 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 8236
2026-08-09T19:09:06Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4152 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:09:06 dist-test-slave-4tdj krb5kdc[9098](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:09:06 dist-test-slave-4tdj krb5kdc[9098](info): set up 2 sockets
Aug 09 19:09:06 dist-test-slave-4tdj krb5kdc[9098](info): commencing operation
krb5kdc: starting...
W20260809 19:09:07.973309 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.000s sys 0.015s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:09:08 dist-test-slave-4tdj krb5kdc[9098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:09:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:09:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.39.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
I20260809 19:09:08.135596 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:34971
--webserver_interface=127.7.39.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:45949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:34971
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:08.444015 9117 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:08.444271 9117 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:08.444382 9117 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:08.451371 9117 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:09:08.451467 9117 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 19:09:08.451531 9117 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:08.451611 9117 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:08.451679 9117 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:09:08.451761 9117 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:09:08.461133 9117 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:45949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:34971
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:34971
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:08.462352 9117 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:08.463954 9117 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:08.474999 9128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:08.474968 9131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:08.475334 9129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:08.475999 9117 server_base.cc:1034] running on GCE node
I20260809 19:09:08.476773 9117 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:08.478010 9117 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:08.479228 9117 hybrid_clock.cc:648] HybridClock initialized: now 1786302548479168 us; error 42 us; skew 500 ppm
I20260809 19:09:08.479530 9117 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:08 dist-test-slave-4tdj krb5kdc[9098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302548, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:08.482445 9117 init.cc:377] Logged in from keytab as kudu/127.7.39.62@KRBTEST.COM (short username kudu)
I20260809 19:09:08.483721 9117 webserver.cc:460] Webserver started at http://127.7.39.62:38039/ using document root <none> and password file <none>
I20260809 19:09:08.484426 9117 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:08.484539 9117 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:08.484885 9117 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:08.487782 9117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "9525e827d98a45c69c7952ebe5219a21"
format_stamp: "Formatted at 2026-08-09 19:09:08 on dist-test-slave-4tdj"
server_key: "1b2d3d6ed7a08350f4381e83575f2b7a"
server_key_iv: "59ad9c2989ca37a416eb5c6b64e81475"
server_key_version: "encryptionkey@0"
I20260809 19:09:08.488576 9117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "9525e827d98a45c69c7952ebe5219a21"
format_stamp: "Formatted at 2026-08-09 19:09:08 on dist-test-slave-4tdj"
server_key: "1b2d3d6ed7a08350f4381e83575f2b7a"
server_key_iv: "59ad9c2989ca37a416eb5c6b64e81475"
server_key_version: "encryptionkey@0"
I20260809 19:09:08.493285 9117 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 19:09:08.496446 9140 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:08.497606 9117 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 19:09:08.497758 9117 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "9525e827d98a45c69c7952ebe5219a21"
format_stamp: "Formatted at 2026-08-09 19:09:08 on dist-test-slave-4tdj"
server_key: "1b2d3d6ed7a08350f4381e83575f2b7a"
server_key_iv: "59ad9c2989ca37a416eb5c6b64e81475"
server_key_version: "encryptionkey@0"
I20260809 19:09:08.497937 9117 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:08.517894 9117 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:08.522185 9117 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:08.522480 9117 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:08.542222 9117 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:34971
I20260809 19:09:08.542243 9232 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:34971 every 8 connection(s)
I20260809 19:09:08.543520 9117 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:09:08.547147 9233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:08.551316 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 9117
I20260809 19:09:08.551517 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:09:08.552134 7324 external_mini_cluster.cc:1428] Setting key 31071744fd8aa97ade1234a97d750150
I20260809 19:09:08.557580 9233 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9525e827d98a45c69c7952ebe5219a21: Bootstrap starting.
I20260809 19:09:08.561022 9233 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9525e827d98a45c69c7952ebe5219a21: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:08.562153 9233 log.cc:824] T 00000000000000000000000000000000 P 9525e827d98a45c69c7952ebe5219a21: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:08.564584 9233 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9525e827d98a45c69c7952ebe5219a21: No bootstrap required, opened a new log
Aug 09 19:09:08 dist-test-slave-4tdj krb5kdc[9098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:08.572131 9233 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9525e827d98a45c69c7952ebe5219a21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9525e827d98a45c69c7952ebe5219a21" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34971 } }
I20260809 19:09:08.572499 9233 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9525e827d98a45c69c7952ebe5219a21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:08.572597 9233 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9525e827d98a45c69c7952ebe5219a21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9525e827d98a45c69c7952ebe5219a21, State: Initialized, Role: FOLLOWER
I20260809 19:09:08.573164 9233 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9525e827d98a45c69c7952ebe5219a21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9525e827d98a45c69c7952ebe5219a21" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34971 } }
I20260809 19:09:08.573328 9237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:08.553915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51714 (local address 127.7.39.62:34971)
0809 19:09:08.554688 (+ 773us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:08.554699 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:08.554739 (+ 40us) server_negotiation.cc:407] Connection header received
0809 19:09:08.556386 (+ 1647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:08.556407 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:08.556751 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:08.557034 (+ 283us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:08.558874 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:08.560160 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:08.561777 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:08.562476 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:08.562622 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:08.566602 (+ 3980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:08.566610 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:08.566625 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:08.566669 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:08.569568 (+ 2899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:08.570170 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:08.570176 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:08.570181 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:08.570406 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:08.570749 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:08.570755 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:08.570758 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:08.571268 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:08.571552 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:08.571963 (+ 411us) server_negotiation.cc:299] Negotiation successful
0809 19:09:08.572335 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":574,"thread_start_us":372,"threads_started":1}
I20260809 19:09:08.573390 9233 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9525e827d98a45c69c7952ebe5219a21 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:09:08.573505 9233 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9525e827d98a45c69c7952ebe5219a21 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:09:08.573688 9233 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9525e827d98a45c69c7952ebe5219a21 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:08.575882 9233 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9525e827d98a45c69c7952ebe5219a21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9525e827d98a45c69c7952ebe5219a21" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34971 } }
I20260809 19:09:08.576364 9233 leader_election.cc:302] T 00000000000000000000000000000000 P 9525e827d98a45c69c7952ebe5219a21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9525e827d98a45c69c7952ebe5219a21; no voters:
I20260809 19:09:08.576860 9233 leader_election.cc:288] T 00000000000000000000000000000000 P 9525e827d98a45c69c7952ebe5219a21 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:09:08.576970 9242 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9525e827d98a45c69c7952ebe5219a21 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:09:08.577582 9242 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9525e827d98a45c69c7952ebe5219a21 [term 1 LEADER]: Becoming Leader. State: Replica: 9525e827d98a45c69c7952ebe5219a21, State: Running, Role: LEADER
I20260809 19:09:08.578087 9242 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9525e827d98a45c69c7952ebe5219a21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9525e827d98a45c69c7952ebe5219a21" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34971 } }
I20260809 19:09:08.578759 9233 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9525e827d98a45c69c7952ebe5219a21 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:09:08.580451 9244 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9525e827d98a45c69c7952ebe5219a21 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9525e827d98a45c69c7952ebe5219a21. Latest consensus state: current_term: 1 leader_uuid: "9525e827d98a45c69c7952ebe5219a21" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9525e827d98a45c69c7952ebe5219a21" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34971 } } }
I20260809 19:09:08.580868 9244 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9525e827d98a45c69c7952ebe5219a21 [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:08.581342 9243 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9525e827d98a45c69c7952ebe5219a21 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9525e827d98a45c69c7952ebe5219a21" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9525e827d98a45c69c7952ebe5219a21" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34971 } } }
I20260809 19:09:08.581629 9243 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9525e827d98a45c69c7952ebe5219a21 [sys.catalog]: This master's current role is: LEADER
W20260809 19:09:08.590726 9265 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9525e827d98a45c69c7952ebe5219a21: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 19:09:08.590834 9265 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 19:09:08.590968 9255 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:09:08.593034 9255 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:09:08.601111 9255 catalog_manager.cc:1347] Generated new cluster ID: 7fbd948bba4043fdac9a6ac26c3c6525
I20260809 19:09:08.601207 9255 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:09:08.625026 9255 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:09:08.626334 9255 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:09:08.634706 9255 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9525e827d98a45c69c7952ebe5219a21: Generated new TSK 0
I20260809 19:09:08.635417 9255 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.39.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
I20260809 19:09:08.689146 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.1:0
--local_ip_for_outbound_sockets=127.7.39.1
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:34971
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:45949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:09.002118 9276 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:09.002413 9276 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:09.002569 9276 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:09.009473 9276 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:09.009578 9276 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:09.009686 9276 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 19:09:09.009793 9276 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.1
I20260809 19:09:09.018934 9276 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:45949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.39.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.39.62:34971
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.1
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:09.020376 9276 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:09.022011 9276 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:09.035451 9283 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:09.035403 9284 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:09.035475 9286 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:09.036134 9276 server_base.cc:1034] running on GCE node
I20260809 19:09:09.036774 9276 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:09.037645 9276 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:09.038848 9276 hybrid_clock.cc:648] HybridClock initialized: now 1786302549038779 us; error 51 us; skew 500 ppm
I20260809 19:09:09.039115 9276 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:09 dist-test-slave-4tdj krb5kdc[9098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302549, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:09.042078 9276 init.cc:377] Logged in from keytab as kudu/127.7.39.1@KRBTEST.COM (short username kudu)
I20260809 19:09:09.043462 9276 webserver.cc:460] Webserver started at http://127.7.39.1:44591/ using document root <none> and password file <none>
I20260809 19:09:09.044086 9276 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:09.044184 9276 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:09.044490 9276 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:09.047323 9276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-0/data/instance:
uuid: "2017da9db0d6485b9c042598fcc95e36"
format_stamp: "Formatted at 2026-08-09 19:09:09 on dist-test-slave-4tdj"
server_key: "913d4d057444ecfd87cbe7f3130930fa"
server_key_iv: "9f691d5fa7f4df41be127ee59fd2bef6"
server_key_version: "encryptionkey@0"
I20260809 19:09:09.048072 9276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance:
uuid: "2017da9db0d6485b9c042598fcc95e36"
format_stamp: "Formatted at 2026-08-09 19:09:09 on dist-test-slave-4tdj"
server_key: "913d4d057444ecfd87cbe7f3130930fa"
server_key_iv: "9f691d5fa7f4df41be127ee59fd2bef6"
server_key_version: "encryptionkey@0"
I20260809 19:09:09.053052 9276 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 19:09:09.056407 9302 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:09.057658 9276 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 19:09:09.057801 9276 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-0/wal
uuid: "2017da9db0d6485b9c042598fcc95e36"
format_stamp: "Formatted at 2026-08-09 19:09:09 on dist-test-slave-4tdj"
server_key: "913d4d057444ecfd87cbe7f3130930fa"
server_key_iv: "9f691d5fa7f4df41be127ee59fd2bef6"
server_key_version: "encryptionkey@0"
I20260809 19:09:09.057992 9276 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:09.075167 9276 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:09.079108 9276 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:09.079336 9276 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:09.082068 9276 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:09.082170 9276 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:09.082327 9276 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:09.082404 9276 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
Aug 09 19:09:09 dist-test-slave-4tdj krb5kdc[9098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302549, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:09.103420 9312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:09.082722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:56033 (local address 127.7.39.62:34971)
0809 19:09:09.083259 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:09.083263 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:09.084264 (+ 1001us) server_negotiation.cc:407] Connection header received
0809 19:09:09.086358 (+ 2094us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:09.086364 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:09.086447 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:09.086547 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:09.088665 (+ 2118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:09.089609 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:09.091655 (+ 2046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:09.092241 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:09.092376 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:09.096709 (+ 4333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:09.096716 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:09.096720 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:09.096761 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:09.099821 (+ 3060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:09.100807 (+ 986us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:09.100813 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:09.100816 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:09.100945 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:09.101524 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:09.101529 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:09.101532 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:09.101834 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:09.101966 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:09.102840 (+ 874us) server_negotiation.cc:299] Negotiation successful
0809 19:09:09.103066 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":328,"threads_started":1}
I20260809 19:09:09.104409 9313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:09.083328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34971 (local address 127.7.39.1:56033)
0809 19:09:09.084111 (+ 783us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:09.084154 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:09.086065 (+ 1911us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:09.086829 (+ 764us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:09.086840 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:09.087569 (+ 729us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:09.088468 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:09.088503 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:09.089766 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:09.089771 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:09.091514 (+ 1743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:09.091529 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:09.092505 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:09.092517 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:09.092811 (+ 294us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:09.093473 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:09.093504 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:09.096468 (+ 2964us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:09.099987 (+ 3519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:09.099997 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:09.100013 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:09.100641 (+ 628us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:09.101118 (+ 477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:09.101123 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:09.101127 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:09.101416 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:09.101970 (+ 554us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:09.101978 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:09.102406 (+ 428us) client_negotiation.cc:769] Sending connection context
0809 19:09:09.102749 (+ 343us) client_negotiation.cc:240] Negotiation successful
0809 19:09:09.103255 (+ 506us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":338,"threads_started":1}
I20260809 19:09:09.121287 9312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:09.109983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:50769 (local address 127.7.39.62:34971)
0809 19:09:09.110136 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:09.110142 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:09.110862 (+ 720us) server_negotiation.cc:407] Connection header received
0809 19:09:09.111008 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:09.111014 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:09.111078 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:09.111153 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:09.112024 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:09.112739 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:09.113949 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:09.114412 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:09.114515 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:09.116195 (+ 1680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:09.116200 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:09.116203 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:09.116231 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:09.118914 (+ 2683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:09.119521 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:09.119526 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:09.119530 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:09.119649 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:09.119971 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:09.119976 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:09.119979 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:09.120247 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:09.120374 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:09.120758 (+ 384us) server_negotiation.cc:299] Negotiation successful
0809 19:09:09.120954 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 19:09:09.121495 9416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:09.110038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34971 (local address 127.7.39.1:50769)
0809 19:09:09.110768 (+ 730us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:09.110784 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:09.110903 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:09.111190 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:09.111194 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:09.111618 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:09.111886 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:09.111895 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:09.112862 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:09.112866 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:09.113823 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:09.113835 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:09.114623 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:09.114633 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:09.114783 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:09.115331 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:09.115346 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:09.116011 (+ 665us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:09.119038 (+ 3027us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:09.119043 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:09.119048 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:09.119407 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:09.119750 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:09.119755 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:09.119759 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:09.119874 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:09.120358 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:09.120363 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:09.120531 (+ 168us) client_negotiation.cc:769] Sending connection context
0809 19:09:09.120652 (+ 121us) client_negotiation.cc:240] Negotiation successful
0809 19:09:09.120952 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":607,"thread_start_us":491,"threads_started":1}
I20260809 19:09:09.136731 9512 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.1:38077 every 8 connection(s)
I20260809 19:09:09.136765 9276 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.1:38077
I20260809 19:09:09.137910 9276 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
I20260809 19:09:09.139786 9514 heartbeater.cc:347] Connected to a master server at 127.7.39.62:34971
I20260809 19:09:09.139995 9514 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:09.140623 9514 heartbeater.cc:511] Master 127.7.39.62:34971 requested a full tablet report, sending...
I20260809 19:09:09.142483 9167 ts_manager.cc:194] Registered new tserver with Master: 2017da9db0d6485b9c042598fcc95e36 (127.7.39.1:38077)
I20260809 19:09:09.143879 9167 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.1@KRBTEST.COM'} at 127.7.39.1:56033
I20260809 19:09:09.146989 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 9276
I20260809 19:09:09.147181 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance
I20260809 19:09:09.147718 7324 external_mini_cluster.cc:1428] Setting key bb17672f5e6ec6d7ade1cdd939231ad0
WARNING: no policy specified for kudu/127.7.39.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
I20260809 19:09:09.184705 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.2:0
--local_ip_for_outbound_sockets=127.7.39.2
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:34971
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:45949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:09.490628 9518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:09.490873 9518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:09.491014 9518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:09.497823 9518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:09.497926 9518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:09.498060 9518 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 19:09:09.498167 9518 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.2
I20260809 19:09:09.507716 9518 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:45949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.39.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.39.62:34971
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.2
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:09.508895 9518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:09.510183 9518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:09.522603 9527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:09.522626 9529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:09.522756 9526 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:09.523281 9518 server_base.cc:1034] running on GCE node
I20260809 19:09:09.523870 9518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:09.524746 9518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:09.525941 9518 hybrid_clock.cc:648] HybridClock initialized: now 1786302549525873 us; error 51 us; skew 500 ppm
I20260809 19:09:09.526225 9518 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:09 dist-test-slave-4tdj krb5kdc[9098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302549, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:09.533568 9518 init.cc:377] Logged in from keytab as kudu/127.7.39.2@KRBTEST.COM (short username kudu)
I20260809 19:09:09.534962 9518 webserver.cc:460] Webserver started at http://127.7.39.2:43995/ using document root <none> and password file <none>
I20260809 19:09:09.535609 9518 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:09.535708 9518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:09.536024 9518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:09.538820 9518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-1/data/instance:
uuid: "36fb9651c0e84e03a736f88873517739"
format_stamp: "Formatted at 2026-08-09 19:09:09 on dist-test-slave-4tdj"
server_key: "07cf9a373a8b2a9793fa4bd2fce57613"
server_key_iv: "8d8766ae727b9ce52aebf2b69ae8a145"
server_key_version: "encryptionkey@0"
I20260809 19:09:09.539579 9518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance:
uuid: "36fb9651c0e84e03a736f88873517739"
format_stamp: "Formatted at 2026-08-09 19:09:09 on dist-test-slave-4tdj"
server_key: "07cf9a373a8b2a9793fa4bd2fce57613"
server_key_iv: "8d8766ae727b9ce52aebf2b69ae8a145"
server_key_version: "encryptionkey@0"
I20260809 19:09:09.544685 9518 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 19:09:09.548085 9538 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:09.549358 9518 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 19:09:09.549501 9518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-1/wal
uuid: "36fb9651c0e84e03a736f88873517739"
format_stamp: "Formatted at 2026-08-09 19:09:09 on dist-test-slave-4tdj"
server_key: "07cf9a373a8b2a9793fa4bd2fce57613"
server_key_iv: "8d8766ae727b9ce52aebf2b69ae8a145"
server_key_version: "encryptionkey@0"
I20260809 19:09:09.549698 9518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:09.584892 9518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:09.588587 9518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:09.588821 9518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:09.591465 9518 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:09.591564 9518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:09.591696 9518 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:09.591765 9518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 19:09:09 dist-test-slave-4tdj krb5kdc[9098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302549, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:09.613112 9312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:09.592040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:32781 (local address 127.7.39.62:34971)
0809 19:09:09.592229 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:09.592235 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:09.593638 (+ 1403us) server_negotiation.cc:407] Connection header received
0809 19:09:09.595610 (+ 1972us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:09.595616 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:09.595701 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:09.595786 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:09.597788 (+ 2002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:09.598828 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:09.601522 (+ 2694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:09.602132 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:09.602279 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:09.607003 (+ 4724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:09.607007 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:09.607019 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:09.607050 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:09.609939 (+ 2889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:09.610709 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:09.610716 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:09.610720 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:09.610885 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:09.611421 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:09.611426 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:09.611430 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:09.611715 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:09.611869 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:09.612550 (+ 681us) server_negotiation.cc:299] Negotiation successful
0809 19:09:09.612772 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 19:09:09.614144 9549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:09.592689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34971 (local address 127.7.39.2:32781)
0809 19:09:09.593475 (+ 786us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:09.593529 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:09.595341 (+ 1812us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:09.596023 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:09.596031 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:09.596730 (+ 699us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:09.597586 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:09.597620 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:09.599009 (+ 1389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:09.599018 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:09.601361 (+ 2343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:09.601385 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:09.602622 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:09.602630 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:09.602928 (+ 298us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:09.603682 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:09.603715 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:09.606724 (+ 3009us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:09.610086 (+ 3362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:09.610095 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:09.610110 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:09.610581 (+ 471us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:09.611025 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:09.611031 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:09.611034 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:09.611293 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:09.611848 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:09.611855 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:09.612192 (+ 337us) client_negotiation.cc:769] Sending connection context
0809 19:09:09.612414 (+ 222us) client_negotiation.cc:240] Negotiation successful
0809 19:09:09.612887 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":363,"threads_started":1}
I20260809 19:09:09.633045 9312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:09.619827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:52105 (local address 127.7.39.62:34971)
0809 19:09:09.619954 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:09.619958 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:09.620561 (+ 603us) server_negotiation.cc:407] Connection header received
0809 19:09:09.620718 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:09.620723 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:09.620781 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:09.620857 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:09.622036 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:09.622893 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:09.624786 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:09.625412 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:09.625554 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:09.627753 (+ 2199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:09.627757 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:09.627761 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:09.627797 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:09.630220 (+ 2423us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:09.630897 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:09.630903 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:09.630906 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:09.631070 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:09.631454 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:09.631459 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:09.631463 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:09.631816 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:09.631966 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:09.632507 (+ 541us) server_negotiation.cc:299] Negotiation successful
0809 19:09:09.632733 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 19:09:09.633308 9660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:09.619905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34971 (local address 127.7.39.2:52105)
0809 19:09:09.620461 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:09.620476 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:09.620608 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:09.620901 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:09.620906 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:09.621533 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:09.621848 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:09.621861 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:09.623058 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:09.623064 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:09.624619 (+ 1555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:09.624636 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:09.625629 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:09.625636 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:09.625762 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:09.626375 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:09.626396 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:09.627580 (+ 1184us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:09.630361 (+ 2781us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:09.630367 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:09.630371 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:09.630789 (+ 418us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:09.631214 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:09.631219 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:09.631223 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:09.631343 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:09.631953 (+ 610us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:09.631958 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:09.632191 (+ 233us) client_negotiation.cc:769] Sending connection context
0809 19:09:09.632372 (+ 181us) client_negotiation.cc:240] Negotiation successful
0809 19:09:09.632750 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":304,"threads_started":1}
I20260809 19:09:09.637310 9518 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.2:43833
I20260809 19:09:09.637461 9731 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.2:43833 every 8 connection(s)
I20260809 19:09:09.638496 9518 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
I20260809 19:09:09.641209 9733 heartbeater.cc:347] Connected to a master server at 127.7.39.62:34971
I20260809 19:09:09.641454 9733 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:09.642097 9733 heartbeater.cc:511] Master 127.7.39.62:34971 requested a full tablet report, sending...
I20260809 19:09:09.643388 9167 ts_manager.cc:194] Registered new tserver with Master: 36fb9651c0e84e03a736f88873517739 (127.7.39.2:43833)
I20260809 19:09:09.644133 9167 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.2@KRBTEST.COM'} at 127.7.39.2:32781
I20260809 19:09:09.647665 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 9518
I20260809 19:09:09.647817 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance
I20260809 19:09:09.648221 7324 external_mini_cluster.cc:1428] Setting key 2de5b01d10a100bdb9d061f8d6cf5c39
WARNING: no policy specified for kudu/127.7.39.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
I20260809 19:09:09.685340 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.3:0
--local_ip_for_outbound_sockets=127.7.39.3
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:34971
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:45949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:09.999118 9738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:09.999402 9738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:09.999569 9738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:10.006925 9738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:10.007084 9738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:10.007191 9738 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 19:09:10.007280 9738 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.3
I20260809 19:09:10.017241 9738 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:45949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.39.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.39.62:34971
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.3
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:10.018628 9738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:10.019989 9738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:10.033593 9744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:10.033684 9745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:10.033656 9747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:10.034478 9738 server_base.cc:1034] running on GCE node
I20260809 19:09:10.035071 9738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:10.035933 9738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:10.037150 9738 hybrid_clock.cc:648] HybridClock initialized: now 1786302550037085 us; error 41 us; skew 500 ppm
I20260809 19:09:10.037427 9738 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:10 dist-test-slave-4tdj krb5kdc[9098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302550, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:10.040484 9738 init.cc:377] Logged in from keytab as kudu/127.7.39.3@KRBTEST.COM (short username kudu)
I20260809 19:09:10.041805 9738 webserver.cc:460] Webserver started at http://127.7.39.3:41649/ using document root <none> and password file <none>
I20260809 19:09:10.042537 9738 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:10.042642 9738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:10.042945 9738 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:10.045742 9738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-2/data/instance:
uuid: "cb49bbd5d49e4ce7895ea0904cec0945"
format_stamp: "Formatted at 2026-08-09 19:09:10 on dist-test-slave-4tdj"
server_key: "a45233c276f7c559ac315559961d3bae"
server_key_iv: "2f7f7d76c8520e1943eef6a616744dec"
server_key_version: "encryptionkey@0"
I20260809 19:09:10.046547 9738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance:
uuid: "cb49bbd5d49e4ce7895ea0904cec0945"
format_stamp: "Formatted at 2026-08-09 19:09:10 on dist-test-slave-4tdj"
server_key: "a45233c276f7c559ac315559961d3bae"
server_key_iv: "2f7f7d76c8520e1943eef6a616744dec"
server_key_version: "encryptionkey@0"
I20260809 19:09:10.051366 9738 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 19:09:10.054845 9761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:10.056196 9738 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260809 19:09:10.056362 9738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-2/wal
uuid: "cb49bbd5d49e4ce7895ea0904cec0945"
format_stamp: "Formatted at 2026-08-09 19:09:10 on dist-test-slave-4tdj"
server_key: "a45233c276f7c559ac315559961d3bae"
server_key_iv: "2f7f7d76c8520e1943eef6a616744dec"
server_key_version: "encryptionkey@0"
I20260809 19:09:10.056567 9738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:10.080823 9738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:10.084810 9738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:10.085048 9738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:10.089183 9738 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:10.089283 9738 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:10.089412 9738 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:10.089488 9738 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 19:09:10 dist-test-slave-4tdj krb5kdc[9098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302550, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:10.110133 9312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:10.088243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:47811 (local address 127.7.39.62:34971)
0809 19:09:10.088408 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:10.088413 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:10.090516 (+ 2103us) server_negotiation.cc:407] Connection header received
0809 19:09:10.092505 (+ 1989us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:10.092511 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:10.092605 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:10.092692 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:10.094692 (+ 2000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.095714 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.098513 (+ 2799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.099013 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.099153 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:10.103571 (+ 4418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:10.103578 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:10.103583 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:10.103628 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:10.106998 (+ 3370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:10.107907 (+ 909us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:10.107911 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:10.107914 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:10.108036 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:10.108495 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:10.108497 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:10.108499 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:10.108761 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:10.108866 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:10.109721 (+ 855us) server_negotiation.cc:299] Negotiation successful
0809 19:09:10.109875 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 19:09:10.111851 9776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:10.089371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34971 (local address 127.7.39.3:47811)
0809 19:09:10.090354 (+ 983us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:10.090397 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:10.092226 (+ 1829us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:10.092949 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:10.092956 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:10.093629 (+ 673us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:10.094513 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:10.094541 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.095882 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.095889 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:10.098351 (+ 2462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:10.098365 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.099297 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.099306 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:10.099589 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:10.100322 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:10.100346 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:10.103264 (+ 2918us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:10.107127 (+ 3863us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:10.107136 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:10.107150 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:10.107783 (+ 633us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:10.108131 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:10.108136 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:10.108140 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:10.108403 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:10.108865 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:10.108873 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:10.109314 (+ 441us) client_negotiation.cc:769] Sending connection context
0809 19:09:10.109612 (+ 298us) client_negotiation.cc:240] Negotiation successful
0809 19:09:10.110156 (+ 544us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":727,"thread_start_us":412,"threads_started":1}
I20260809 19:09:10.131625 9312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:10.117765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:36067 (local address 127.7.39.62:34971)
0809 19:09:10.117926 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:10.117931 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:10.118515 (+ 584us) server_negotiation.cc:407] Connection header received
0809 19:09:10.118662 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:10.118667 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:10.118730 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:10.118803 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:10.119703 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.120842 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.122638 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.123193 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.123319 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:10.125634 (+ 2315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:10.125641 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:10.125646 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:10.125683 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:10.128872 (+ 3189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:10.129660 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:10.129666 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:10.129670 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:10.129821 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:10.130131 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:10.130135 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:10.130139 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:10.130504 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:10.130644 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:10.131243 (+ 599us) server_negotiation.cc:299] Negotiation successful
0809 19:09:10.131401 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 19:09:10.132014 9875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:10.117801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34971 (local address 127.7.39.3:36067)
0809 19:09:10.118426 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:10.118441 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:10.118562 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:10.118840 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:10.118844 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:10.119274 (+ 430us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:10.119547 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:10.119557 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.120972 (+ 1415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.120976 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:10.122505 (+ 1529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:10.122523 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.123382 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.123389 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:10.123588 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:10.124288 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:10.124308 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:10.125446 (+ 1138us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:10.129003 (+ 3557us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:10.129008 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:10.129012 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:10.129539 (+ 527us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:10.129923 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:10.129927 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:10.129929 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:10.130047 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:10.130714 (+ 667us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:10.130720 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:10.130941 (+ 221us) client_negotiation.cc:769] Sending connection context
0809 19:09:10.131128 (+ 187us) client_negotiation.cc:240] Negotiation successful
0809 19:09:10.131460 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":356,"threads_started":1}
I20260809 19:09:10.137421 9738 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.3:41019
I20260809 19:09:10.137428 9943 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.3:41019 every 8 connection(s)
I20260809 19:09:10.138870 9738 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
I20260809 19:09:10.140185 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 9738
I20260809 19:09:10.140385 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance
I20260809 19:09:10.140939 7324 external_mini_cluster.cc:1428] Setting key 8e7819e85cddef73861b7f73bc371184
I20260809 19:09:10.140904 9950 heartbeater.cc:347] Connected to a master server at 127.7.39.62:34971
I20260809 19:09:10.142064 9950 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:10.142697 9950 heartbeater.cc:511] Master 127.7.39.62:34971 requested a full tablet report, sending...
I20260809 19:09:10.143966 9167 ts_manager.cc:194] Registered new tserver with Master: cb49bbd5d49e4ce7895ea0904cec0945 (127.7.39.3:41019)
I20260809 19:09:10.144742 9167 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.3@KRBTEST.COM'} at 127.7.39.3:47811
I20260809 19:09:10.146346 9514 heartbeater.cc:503] Master 127.7.39.62:34971 was elected leader, sending a full tablet report...
I20260809 19:09:10.155552 7324 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 19:09:10 dist-test-slave-4tdj krb5kdc[9098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302550, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 19:09:10 dist-test-slave-4tdj krb5kdc[9098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302550, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:10.200601 9312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:10.187514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51718 (local address 127.7.39.62:34971)
0809 19:09:10.187744 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:10.187750 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:10.187921 (+ 171us) server_negotiation.cc:407] Connection header received
0809 19:09:10.188122 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:10.188127 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:10.188207 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:10.188296 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:10.189706 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.190488 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.191732 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.192153 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.192264 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:10.195815 (+ 3551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:10.195820 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:10.195823 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:10.195856 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:10.198062 (+ 2206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:10.198720 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:10.198724 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:10.198726 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:10.198849 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:10.199212 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:10.199217 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:10.199220 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:10.199488 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:10.199719 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:10.200015 (+ 296us) server_negotiation.cc:299] Negotiation successful
0809 19:09:10.200245 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 19:09:10.204603 9167 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51718:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:09:10.211481 9167 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:09:10.235556 9974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:10.223908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:41019 (local address 127.0.0.1:43226)
0809 19:09:10.225562 (+ 1654us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:10.225579 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:10.225667 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:10.227887 (+ 2220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:10.227895 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:10.227924 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:10.228338 (+ 414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:10.228351 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.230365 (+ 2014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.230370 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:10.232840 (+ 2470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:10.232856 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.234496 (+ 1640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.234502 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:10.234709 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:10.234765 (+ 56us) client_negotiation.cc:769] Sending connection context
0809 19:09:10.234870 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 19:09:10.235070 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1520,"mutex_wait_us":24,"thread_start_us":1406,"threads_started":1}
I20260809 19:09:10.236038 9969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:10.223407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:38077 (local address 127.0.0.1:43054)
0809 19:09:10.224734 (+ 1327us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:10.224780 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:10.224977 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:10.229066 (+ 4089us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:10.229070 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:10.229094 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:10.229475 (+ 381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:10.229489 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.231352 (+ 1863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.231357 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:10.233504 (+ 2147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:10.233530 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.235346 (+ 1816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.235352 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:10.235506 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:10.235549 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 19:09:10.235605 (+ 56us) client_negotiation.cc:240] Negotiation successful
0809 19:09:10.235708 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1031,"thread_start_us":869,"threads_started":1}
I20260809 19:09:10.236076 9979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:10.225636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47674 (local address 127.7.39.2:43833)
0809 19:09:10.226228 (+ 592us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:10.226236 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:10.228881 (+ 2645us) server_negotiation.cc:407] Connection header received
0809 19:09:10.229067 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:10.229075 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:10.229291 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:10.229489 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:10.230051 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.231453 (+ 1402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.233398 (+ 1945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.234641 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.234760 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:10.234964 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:10.235651 (+ 687us) server_negotiation.cc:299] Negotiation successful
0809 19:09:10.235809 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":271,"threads_started":1}
I20260809 19:09:10.236248 9976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:10.224254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43226 (local address 127.7.39.3:41019)
0809 19:09:10.226468 (+ 2214us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:10.226476 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:10.226509 (+ 33us) server_negotiation.cc:407] Connection header received
0809 19:09:10.226620 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:10.226628 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:10.227666 (+ 1038us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:10.227839 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:10.228597 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.230177 (+ 1580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.233046 (+ 2869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.234245 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.235275 (+ 1030us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:10.235499 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:10.235586 (+ 87us) server_negotiation.cc:299] Negotiation successful
0809 19:09:10.235924 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1820,"thread_start_us":1634,"threads_started":1}
I20260809 19:09:10.236536 9977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:10.225111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:43833 (local address 127.0.0.1:47674)
0809 19:09:10.228774 (+ 3663us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:10.228787 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:10.228901 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:10.229490 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:10.229495 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:10.229533 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:10.229862 (+ 329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:10.229872 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.231618 (+ 1746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.231621 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:10.233256 (+ 1635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:10.233269 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.235123 (+ 1854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.235130 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:10.235306 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:10.235342 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 19:09:10.235425 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 19:09:10.235548 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3574,"mutex_wait_us":4,"thread_start_us":3456,"threads_started":1}
I20260809 19:09:10.237093 9971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:10.223634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43054 (local address 127.7.39.1:38077)
0809 19:09:10.228506 (+ 4872us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:10.228526 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:10.228555 (+ 29us) server_negotiation.cc:407] Connection header received
0809 19:09:10.228646 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:10.228653 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:10.228890 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:10.229090 (+ 200us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:10.229684 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.231220 (+ 1536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.233674 (+ 2454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.235131 (+ 1457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.236390 (+ 1259us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:10.236598 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:10.236667 (+ 69us) server_negotiation.cc:299] Negotiation successful
0809 19:09:10.236825 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4709,"thread_start_us":4577,"threads_started":1}
I20260809 19:09:10.240183 9387 tablet_service.cc:1467] Processing CreateTablet for tablet 7480ddd040f947c28ee24b3dd7f0b7b0 (DEFAULT_TABLE table=test-table [id=9897da2d1a8e46639f15f760ddac0bad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:09:10.240061 9625 tablet_service.cc:1467] Processing CreateTablet for tablet 7480ddd040f947c28ee24b3dd7f0b7b0 (DEFAULT_TABLE table=test-table [id=9897da2d1a8e46639f15f760ddac0bad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:09:10.240062 9832 tablet_service.cc:1467] Processing CreateTablet for tablet 7480ddd040f947c28ee24b3dd7f0b7b0 (DEFAULT_TABLE table=test-table [id=9897da2d1a8e46639f15f760ddac0bad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:09:10.241336 9387 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7480ddd040f947c28ee24b3dd7f0b7b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:10.241415 9832 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7480ddd040f947c28ee24b3dd7f0b7b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:10.241415 9625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7480ddd040f947c28ee24b3dd7f0b7b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:10.252988 9982 tablet_bootstrap.cc:492] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 2017da9db0d6485b9c042598fcc95e36: Bootstrap starting.
I20260809 19:09:10.255455 9985 tablet_bootstrap.cc:492] T 7480ddd040f947c28ee24b3dd7f0b7b0 P cb49bbd5d49e4ce7895ea0904cec0945: Bootstrap starting.
I20260809 19:09:10.256193 9984 tablet_bootstrap.cc:492] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 36fb9651c0e84e03a736f88873517739: Bootstrap starting.
I20260809 19:09:10.256220 9982 tablet_bootstrap.cc:654] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 2017da9db0d6485b9c042598fcc95e36: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:10.257499 9982 log.cc:824] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 2017da9db0d6485b9c042598fcc95e36: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:10.259316 9984 tablet_bootstrap.cc:654] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 36fb9651c0e84e03a736f88873517739: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:10.259532 9985 tablet_bootstrap.cc:654] T 7480ddd040f947c28ee24b3dd7f0b7b0 P cb49bbd5d49e4ce7895ea0904cec0945: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:10.260577 9985 log.cc:824] T 7480ddd040f947c28ee24b3dd7f0b7b0 P cb49bbd5d49e4ce7895ea0904cec0945: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:10.260583 9984 log.cc:824] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 36fb9651c0e84e03a736f88873517739: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:10.260887 9982 tablet_bootstrap.cc:492] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 2017da9db0d6485b9c042598fcc95e36: No bootstrap required, opened a new log
I20260809 19:09:10.261806 9982 ts_tablet_manager.cc:1397] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 2017da9db0d6485b9c042598fcc95e36: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260809 19:09:10.263299 9985 tablet_bootstrap.cc:492] T 7480ddd040f947c28ee24b3dd7f0b7b0 P cb49bbd5d49e4ce7895ea0904cec0945: No bootstrap required, opened a new log
I20260809 19:09:10.263532 9985 ts_tablet_manager.cc:1397] T 7480ddd040f947c28ee24b3dd7f0b7b0 P cb49bbd5d49e4ce7895ea0904cec0945: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.005s
I20260809 19:09:10.265400 9984 tablet_bootstrap.cc:492] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 36fb9651c0e84e03a736f88873517739: No bootstrap required, opened a new log
I20260809 19:09:10.265693 9984 ts_tablet_manager.cc:1397] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 36fb9651c0e84e03a736f88873517739: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260809 19:09:10.268740 9982 raft_consensus.cc:348] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 2017da9db0d6485b9c042598fcc95e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } }
I20260809 19:09:10.269063 9982 raft_consensus.cc:374] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 2017da9db0d6485b9c042598fcc95e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:10.269187 9982 raft_consensus.cc:729] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 2017da9db0d6485b9c042598fcc95e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2017da9db0d6485b9c042598fcc95e36, State: Initialized, Role: FOLLOWER
I20260809 19:09:10.269734 9982 consensus_queue.cc:260] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 2017da9db0d6485b9c042598fcc95e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } }
I20260809 19:09:10.272475 9982 ts_tablet_manager.cc:1428] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 2017da9db0d6485b9c042598fcc95e36: Time spent starting tablet: real 0.011s user 0.009s sys 0.001s
I20260809 19:09:10.273505 9985 raft_consensus.cc:348] T 7480ddd040f947c28ee24b3dd7f0b7b0 P cb49bbd5d49e4ce7895ea0904cec0945 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } }
I20260809 19:09:10.273912 9985 raft_consensus.cc:374] T 7480ddd040f947c28ee24b3dd7f0b7b0 P cb49bbd5d49e4ce7895ea0904cec0945 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:10.274061 9985 raft_consensus.cc:729] T 7480ddd040f947c28ee24b3dd7f0b7b0 P cb49bbd5d49e4ce7895ea0904cec0945 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb49bbd5d49e4ce7895ea0904cec0945, State: Initialized, Role: FOLLOWER
I20260809 19:09:10.274715 9985 consensus_queue.cc:260] T 7480ddd040f947c28ee24b3dd7f0b7b0 P cb49bbd5d49e4ce7895ea0904cec0945 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } }
I20260809 19:09:10.275835 9950 heartbeater.cc:503] Master 127.7.39.62:34971 was elected leader, sending a full tablet report...
I20260809 19:09:10.276117 9984 raft_consensus.cc:348] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 36fb9651c0e84e03a736f88873517739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } }
I20260809 19:09:10.276504 9985 ts_tablet_manager.cc:1428] T 7480ddd040f947c28ee24b3dd7f0b7b0 P cb49bbd5d49e4ce7895ea0904cec0945: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260809 19:09:10.276530 9984 raft_consensus.cc:374] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 36fb9651c0e84e03a736f88873517739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:10.276616 9984 raft_consensus.cc:729] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 36fb9651c0e84e03a736f88873517739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36fb9651c0e84e03a736f88873517739, State: Initialized, Role: FOLLOWER
I20260809 19:09:10.277236 9984 consensus_queue.cc:260] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 36fb9651c0e84e03a736f88873517739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } }
I20260809 19:09:10.278383 9733 heartbeater.cc:503] Master 127.7.39.62:34971 was elected leader, sending a full tablet report...
I20260809 19:09:10.278904 9984 ts_tablet_manager.cc:1428] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 36fb9651c0e84e03a736f88873517739: Time spent starting tablet: real 0.013s user 0.007s sys 0.005s
W20260809 19:09:10.390435 9735 tablet.cc:2369] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 36fb9651c0e84e03a736f88873517739: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 19:09:10.390453 9515 tablet.cc:2369] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 2017da9db0d6485b9c042598fcc95e36: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 19:09:10.390467 9951 tablet.cc:2369] T 7480ddd040f947c28ee24b3dd7f0b7b0 P cb49bbd5d49e4ce7895ea0904cec0945: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:09:10.534835 9992 raft_consensus.cc:482] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 2017da9db0d6485b9c042598fcc95e36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:09:10.535180 9992 raft_consensus.cc:504] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 2017da9db0d6485b9c042598fcc95e36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } }
I20260809 19:09:10.537245 9992 leader_election.cc:288] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 2017da9db0d6485b9c042598fcc95e36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36fb9651c0e84e03a736f88873517739 (127.7.39.2:43833), cb49bbd5d49e4ce7895ea0904cec0945 (127.7.39.3:41019)
I20260809 19:09:10.545460 9976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:10.537794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:55309 (local address 127.7.39.3:41019)
0809 19:09:10.537998 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:10.538004 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:10.538702 (+ 698us) server_negotiation.cc:407] Connection header received
0809 19:09:10.538905 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:10.538911 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:10.538994 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:10.539081 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:10.539834 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.540748 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.543082 (+ 2334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.544250 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.544346 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:10.544458 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:10.545044 (+ 586us) server_negotiation.cc:299] Negotiation successful
0809 19:09:10.545190 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 19:09:10.545559 9995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:10.537753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:41019 (local address 127.7.39.1:55309)
0809 19:09:10.538596 (+ 843us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:10.538611 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:10.538760 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:10.539268 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:10.539273 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:10.539302 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:10.539668 (+ 366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:10.539682 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.540888 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.540892 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:10.542904 (+ 2012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:10.542920 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.544652 (+ 1732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.544658 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:10.544826 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:10.544860 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 19:09:10.544997 (+ 137us) client_negotiation.cc:240] Negotiation successful
0809 19:09:10.545126 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":696,"mutex_wait_us":20,"thread_start_us":443,"threads_started":1}
I20260809 19:09:10.546165 9979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:10.537922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:48233 (local address 127.7.39.2:43833)
0809 19:09:10.538157 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:10.538164 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:10.539377 (+ 1213us) server_negotiation.cc:407] Connection header received
0809 19:09:10.539580 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:10.539586 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:10.539670 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:10.539773 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:10.540384 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.541497 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.543934 (+ 2437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.545053 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.545162 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:10.545282 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:10.545833 (+ 551us) server_negotiation.cc:299] Negotiation successful
0809 19:09:10.545955 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260809 19:09:10.546844 9996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:10.537759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:43833 (local address 127.7.39.1:48233)
0809 19:09:10.539268 (+ 1509us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:10.539284 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:10.539426 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:10.539786 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:10.539791 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:10.539817 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:10.540206 (+ 389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:10.540219 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.541648 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.541654 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:10.543758 (+ 2104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:10.543773 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.545473 (+ 1700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.545479 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:10.545647 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:10.545678 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 19:09:10.546367 (+ 689us) client_negotiation.cc:240] Negotiation successful
0809 19:09:10.546493 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1378,"mutex_wait_us":418,"spinlock_wait_cycles":1280,"thread_start_us":760,"threads_started":1}
I20260809 19:09:10.546681 9865 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7480ddd040f947c28ee24b3dd7f0b7b0" candidate_uuid: "2017da9db0d6485b9c042598fcc95e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" is_pre_election: true
I20260809 19:09:10.547241 9865 raft_consensus.cc:2454] T 7480ddd040f947c28ee24b3dd7f0b7b0 P cb49bbd5d49e4ce7895ea0904cec0945 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2017da9db0d6485b9c042598fcc95e36 in term 0.
I20260809 19:09:10.547837 9659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7480ddd040f947c28ee24b3dd7f0b7b0" candidate_uuid: "2017da9db0d6485b9c042598fcc95e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36fb9651c0e84e03a736f88873517739" is_pre_election: true
I20260809 19:09:10.547960 9304 leader_election.cc:302] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 2017da9db0d6485b9c042598fcc95e36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2017da9db0d6485b9c042598fcc95e36, cb49bbd5d49e4ce7895ea0904cec0945; no voters:
I20260809 19:09:10.548379 9659 raft_consensus.cc:2454] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 36fb9651c0e84e03a736f88873517739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2017da9db0d6485b9c042598fcc95e36 in term 0.
I20260809 19:09:10.548383 9992 raft_consensus.cc:2781] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 2017da9db0d6485b9c042598fcc95e36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:09:10.548552 9992 raft_consensus.cc:482] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 2017da9db0d6485b9c042598fcc95e36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:09:10.548672 9992 raft_consensus.cc:3037] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 2017da9db0d6485b9c042598fcc95e36 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:10.551843 9992 raft_consensus.cc:504] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 2017da9db0d6485b9c042598fcc95e36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } }
I20260809 19:09:10.552561 9992 leader_election.cc:288] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 2017da9db0d6485b9c042598fcc95e36 [CANDIDATE]: Term 1 election: Requested vote from peers 36fb9651c0e84e03a736f88873517739 (127.7.39.2:43833), cb49bbd5d49e4ce7895ea0904cec0945 (127.7.39.3:41019)
I20260809 19:09:10.552934 9659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7480ddd040f947c28ee24b3dd7f0b7b0" candidate_uuid: "2017da9db0d6485b9c042598fcc95e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36fb9651c0e84e03a736f88873517739"
I20260809 19:09:10.553066 9865 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7480ddd040f947c28ee24b3dd7f0b7b0" candidate_uuid: "2017da9db0d6485b9c042598fcc95e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb49bbd5d49e4ce7895ea0904cec0945"
I20260809 19:09:10.553148 9659 raft_consensus.cc:3037] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 36fb9651c0e84e03a736f88873517739 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:10.553314 9865 raft_consensus.cc:3037] T 7480ddd040f947c28ee24b3dd7f0b7b0 P cb49bbd5d49e4ce7895ea0904cec0945 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:10.556404 9659 raft_consensus.cc:2454] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 36fb9651c0e84e03a736f88873517739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2017da9db0d6485b9c042598fcc95e36 in term 1.
I20260809 19:09:10.556402 9865 raft_consensus.cc:2454] T 7480ddd040f947c28ee24b3dd7f0b7b0 P cb49bbd5d49e4ce7895ea0904cec0945 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2017da9db0d6485b9c042598fcc95e36 in term 1.
I20260809 19:09:10.556802 9304 leader_election.cc:302] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 2017da9db0d6485b9c042598fcc95e36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2017da9db0d6485b9c042598fcc95e36, cb49bbd5d49e4ce7895ea0904cec0945; no voters:
I20260809 19:09:10.557099 9992 raft_consensus.cc:2781] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 2017da9db0d6485b9c042598fcc95e36 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:09:10.557539 9992 raft_consensus.cc:686] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 2017da9db0d6485b9c042598fcc95e36 [term 1 LEADER]: Becoming Leader. State: Replica: 2017da9db0d6485b9c042598fcc95e36, State: Running, Role: LEADER
I20260809 19:09:10.558102 9992 consensus_queue.cc:237] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 2017da9db0d6485b9c042598fcc95e36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } }
I20260809 19:09:10.563920 9166 catalog_manager.cc:5495] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 2017da9db0d6485b9c042598fcc95e36 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2017da9db0d6485b9c042598fcc95e36 (127.7.39.1). New cstate: current_term: 1 leader_uuid: "2017da9db0d6485b9c042598fcc95e36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } health_report { overall_health: UNKNOWN } } }
I20260809 19:09:10.607208 9971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:10.601824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43062 (local address 127.7.39.1:38077)
0809 19:09:10.602046 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:10.602053 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:10.602164 (+ 111us) server_negotiation.cc:407] Connection header received
0809 19:09:10.602514 (+ 350us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:10.602519 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:10.602607 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:10.602730 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:09:10.603097 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.603772 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.605064 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.605490 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.605601 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:10.606124 (+ 523us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:09:10.606620 (+ 496us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:09:10.606746 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:10.606878 (+ 132us) server_negotiation.cc:299] Negotiation successful
0809 19:09:10.606957 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 19:09:10.615602 9659 raft_consensus.cc:1261] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 36fb9651c0e84e03a736f88873517739 [term 1 FOLLOWER]: Refusing update from remote peer 2017da9db0d6485b9c042598fcc95e36: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:09:10.616480 9998 consensus_queue.cc:1035] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 2017da9db0d6485b9c042598fcc95e36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:09:10.617647 9865 raft_consensus.cc:1261] T 7480ddd040f947c28ee24b3dd7f0b7b0 P cb49bbd5d49e4ce7895ea0904cec0945 [term 1 FOLLOWER]: Refusing update from remote peer 2017da9db0d6485b9c042598fcc95e36: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:09:10.618474 9998 consensus_queue.cc:1035] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 2017da9db0d6485b9c042598fcc95e36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:09:10.653008 9167 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51718:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:09:10.653383 9167 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51718:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:09:10.657546 9167 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9525e827d98a45c69c7952ebe5219a21: Sending DeleteTablet for 3 replicas of tablet 7480ddd040f947c28ee24b3dd7f0b7b0
I20260809 19:09:10.659153 9625 tablet_service.cc:1514] Processing DeleteTablet for tablet 7480ddd040f947c28ee24b3dd7f0b7b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:09:10 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:47674
I20260809 19:09:10.660676 9167 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51718:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 19:09:10.661047 9387 tablet_service.cc:1514] Processing DeleteTablet for tablet 7480ddd040f947c28ee24b3dd7f0b7b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:09:10 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:43054
I20260809 19:09:10.661290 9832 tablet_service.cc:1514] Processing DeleteTablet for tablet 7480ddd040f947c28ee24b3dd7f0b7b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:09:10 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:43226
W20260809 19:09:10.661383 9167 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:09:10.662815 10015 tablet_replica.cc:330] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 2017da9db0d6485b9c042598fcc95e36: stopping tablet replica
I20260809 19:09:10.663581 10015 raft_consensus.cc:2229] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 2017da9db0d6485b9c042598fcc95e36 [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:09:10.664638 10015 raft_consensus.cc:2258] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 2017da9db0d6485b9c042598fcc95e36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:09:10.667004 10015 ts_tablet_manager.cc:1905] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 2017da9db0d6485b9c042598fcc95e36: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:09:10.670058 9387 tablet_service.cc:1467] Processing CreateTablet for tablet 3f5c865ae6c9452f9df012720a0aea32 (DEFAULT_TABLE table=test-table [id=88d58a4120564db19908620e21829946]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:09:10.670081 9831 tablet_service.cc:1467] Processing CreateTablet for tablet 3f5c865ae6c9452f9df012720a0aea32 (DEFAULT_TABLE table=test-table [id=88d58a4120564db19908620e21829946]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:09:10.670499 9831 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f5c865ae6c9452f9df012720a0aea32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:10.670516 9387 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f5c865ae6c9452f9df012720a0aea32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:10.674654 9625 tablet_service.cc:1467] Processing CreateTablet for tablet 3f5c865ae6c9452f9df012720a0aea32 (DEFAULT_TABLE table=test-table [id=88d58a4120564db19908620e21829946]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:09:10.675452 10015 ts_tablet_manager.cc:1918] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 2017da9db0d6485b9c042598fcc95e36: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:09:10.675782 10015 log.cc:1196] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 2017da9db0d6485b9c042598fcc95e36: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-0/wal/wals/7480ddd040f947c28ee24b3dd7f0b7b0
I20260809 19:09:10.676478 10015 ts_tablet_manager.cc:1939] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 2017da9db0d6485b9c042598fcc95e36: Deleting consensus metadata
I20260809 19:09:10.677793 9982 tablet_bootstrap.cc:492] T 3f5c865ae6c9452f9df012720a0aea32 P 2017da9db0d6485b9c042598fcc95e36: Bootstrap starting.
I20260809 19:09:10.678460 9144 catalog_manager.cc:4841] TS 2017da9db0d6485b9c042598fcc95e36 (127.7.39.1:38077): tablet 7480ddd040f947c28ee24b3dd7f0b7b0 (table test-table [id=9897da2d1a8e46639f15f760ddac0bad]) successfully deleted
I20260809 19:09:10.679382 9982 tablet_bootstrap.cc:654] T 3f5c865ae6c9452f9df012720a0aea32 P 2017da9db0d6485b9c042598fcc95e36: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:10.679634 9985 tablet_bootstrap.cc:492] T 3f5c865ae6c9452f9df012720a0aea32 P cb49bbd5d49e4ce7895ea0904cec0945: Bootstrap starting.
I20260809 19:09:10.680343 9625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f5c865ae6c9452f9df012720a0aea32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:10.680558 10013 tablet_replica.cc:330] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 36fb9651c0e84e03a736f88873517739: stopping tablet replica
I20260809 19:09:10.680995 10013 raft_consensus.cc:2229] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 36fb9651c0e84e03a736f88873517739 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:09:10.681202 9985 tablet_bootstrap.cc:654] T 3f5c865ae6c9452f9df012720a0aea32 P cb49bbd5d49e4ce7895ea0904cec0945: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:10.681538 10013 raft_consensus.cc:2258] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 36fb9651c0e84e03a736f88873517739 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:09:10.682163 10019 tablet_replica.cc:330] T 7480ddd040f947c28ee24b3dd7f0b7b0 P cb49bbd5d49e4ce7895ea0904cec0945: stopping tablet replica
I20260809 19:09:10.684042 10013 ts_tablet_manager.cc:1905] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 36fb9651c0e84e03a736f88873517739: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:09:10.688259 9984 tablet_bootstrap.cc:492] T 3f5c865ae6c9452f9df012720a0aea32 P 36fb9651c0e84e03a736f88873517739: Bootstrap starting.
I20260809 19:09:10.690112 9984 tablet_bootstrap.cc:654] T 3f5c865ae6c9452f9df012720a0aea32 P 36fb9651c0e84e03a736f88873517739: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:10.691040 10013 ts_tablet_manager.cc:1918] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 36fb9651c0e84e03a736f88873517739: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:09:10.691504 10019 raft_consensus.cc:2229] T 7480ddd040f947c28ee24b3dd7f0b7b0 P cb49bbd5d49e4ce7895ea0904cec0945 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:09:10.692090 10019 raft_consensus.cc:2258] T 7480ddd040f947c28ee24b3dd7f0b7b0 P cb49bbd5d49e4ce7895ea0904cec0945 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:09:10.692504 10013 log.cc:1196] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 36fb9651c0e84e03a736f88873517739: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-1/wal/wals/7480ddd040f947c28ee24b3dd7f0b7b0
I20260809 19:09:10.693372 10013 ts_tablet_manager.cc:1939] T 7480ddd040f947c28ee24b3dd7f0b7b0 P 36fb9651c0e84e03a736f88873517739: Deleting consensus metadata
I20260809 19:09:10.695017 10019 ts_tablet_manager.cc:1905] T 7480ddd040f947c28ee24b3dd7f0b7b0 P cb49bbd5d49e4ce7895ea0904cec0945: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:09:10.701948 9982 tablet_bootstrap.cc:492] T 3f5c865ae6c9452f9df012720a0aea32 P 2017da9db0d6485b9c042598fcc95e36: No bootstrap required, opened a new log
I20260809 19:09:10.702127 9982 ts_tablet_manager.cc:1397] T 3f5c865ae6c9452f9df012720a0aea32 P 2017da9db0d6485b9c042598fcc95e36: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.007s
I20260809 19:09:10.703181 9982 raft_consensus.cc:348] T 3f5c865ae6c9452f9df012720a0aea32 P 2017da9db0d6485b9c042598fcc95e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } }
I20260809 19:09:10.703439 9982 raft_consensus.cc:374] T 3f5c865ae6c9452f9df012720a0aea32 P 2017da9db0d6485b9c042598fcc95e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:10.703569 9982 raft_consensus.cc:729] T 3f5c865ae6c9452f9df012720a0aea32 P 2017da9db0d6485b9c042598fcc95e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2017da9db0d6485b9c042598fcc95e36, State: Initialized, Role: FOLLOWER
I20260809 19:09:10.703893 9982 consensus_queue.cc:260] T 3f5c865ae6c9452f9df012720a0aea32 P 2017da9db0d6485b9c042598fcc95e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } }
I20260809 19:09:10.704576 9982 ts_tablet_manager.cc:1428] T 3f5c865ae6c9452f9df012720a0aea32 P 2017da9db0d6485b9c042598fcc95e36: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260809 19:09:10.704659 9144 catalog_manager.cc:4841] TS 36fb9651c0e84e03a736f88873517739 (127.7.39.2:43833): tablet 7480ddd040f947c28ee24b3dd7f0b7b0 (table test-table [id=9897da2d1a8e46639f15f760ddac0bad]) successfully deleted
I20260809 19:09:10.706844 9985 tablet_bootstrap.cc:492] T 3f5c865ae6c9452f9df012720a0aea32 P cb49bbd5d49e4ce7895ea0904cec0945: No bootstrap required, opened a new log
I20260809 19:09:10.706873 10019 ts_tablet_manager.cc:1918] T 7480ddd040f947c28ee24b3dd7f0b7b0 P cb49bbd5d49e4ce7895ea0904cec0945: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:09:10.707043 9985 ts_tablet_manager.cc:1397] T 3f5c865ae6c9452f9df012720a0aea32 P cb49bbd5d49e4ce7895ea0904cec0945: Time spent bootstrapping tablet: real 0.028s user 0.008s sys 0.018s
I20260809 19:09:10.707146 10019 log.cc:1196] T 7480ddd040f947c28ee24b3dd7f0b7b0 P cb49bbd5d49e4ce7895ea0904cec0945: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-2/wal/wals/7480ddd040f947c28ee24b3dd7f0b7b0
I20260809 19:09:10.707821 10019 ts_tablet_manager.cc:1939] T 7480ddd040f947c28ee24b3dd7f0b7b0 P cb49bbd5d49e4ce7895ea0904cec0945: Deleting consensus metadata
I20260809 19:09:10.708017 9985 raft_consensus.cc:348] T 3f5c865ae6c9452f9df012720a0aea32 P cb49bbd5d49e4ce7895ea0904cec0945 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } }
I20260809 19:09:10.708326 9985 raft_consensus.cc:374] T 3f5c865ae6c9452f9df012720a0aea32 P cb49bbd5d49e4ce7895ea0904cec0945 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:10.708485 9985 raft_consensus.cc:729] T 3f5c865ae6c9452f9df012720a0aea32 P cb49bbd5d49e4ce7895ea0904cec0945 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb49bbd5d49e4ce7895ea0904cec0945, State: Initialized, Role: FOLLOWER
I20260809 19:09:10.708896 9985 consensus_queue.cc:260] T 3f5c865ae6c9452f9df012720a0aea32 P cb49bbd5d49e4ce7895ea0904cec0945 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } }
I20260809 19:09:10.710074 9142 catalog_manager.cc:4841] TS cb49bbd5d49e4ce7895ea0904cec0945 (127.7.39.3:41019): tablet 7480ddd040f947c28ee24b3dd7f0b7b0 (table test-table [id=9897da2d1a8e46639f15f760ddac0bad]) successfully deleted
I20260809 19:09:10.710145 9984 tablet_bootstrap.cc:492] T 3f5c865ae6c9452f9df012720a0aea32 P 36fb9651c0e84e03a736f88873517739: No bootstrap required, opened a new log
I20260809 19:09:10.710173 9985 ts_tablet_manager.cc:1428] T 3f5c865ae6c9452f9df012720a0aea32 P cb49bbd5d49e4ce7895ea0904cec0945: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260809 19:09:10.710341 9984 ts_tablet_manager.cc:1397] T 3f5c865ae6c9452f9df012720a0aea32 P 36fb9651c0e84e03a736f88873517739: Time spent bootstrapping tablet: real 0.022s user 0.010s sys 0.004s
I20260809 19:09:10.710956 9984 raft_consensus.cc:348] T 3f5c865ae6c9452f9df012720a0aea32 P 36fb9651c0e84e03a736f88873517739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } }
I20260809 19:09:10.711125 9984 raft_consensus.cc:374] T 3f5c865ae6c9452f9df012720a0aea32 P 36fb9651c0e84e03a736f88873517739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:10.711257 9984 raft_consensus.cc:729] T 3f5c865ae6c9452f9df012720a0aea32 P 36fb9651c0e84e03a736f88873517739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36fb9651c0e84e03a736f88873517739, State: Initialized, Role: FOLLOWER
I20260809 19:09:10.711499 9984 consensus_queue.cc:260] T 3f5c865ae6c9452f9df012720a0aea32 P 36fb9651c0e84e03a736f88873517739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } }
I20260809 19:09:10.712064 9984 ts_tablet_manager.cc:1428] T 3f5c865ae6c9452f9df012720a0aea32 P 36fb9651c0e84e03a736f88873517739: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260809 19:09:10.833002 10010 raft_consensus.cc:482] T 3f5c865ae6c9452f9df012720a0aea32 P 2017da9db0d6485b9c042598fcc95e36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:09:10.833266 10010 raft_consensus.cc:504] T 3f5c865ae6c9452f9df012720a0aea32 P 2017da9db0d6485b9c042598fcc95e36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } }
I20260809 19:09:10.834069 10010 leader_election.cc:288] T 3f5c865ae6c9452f9df012720a0aea32 P 2017da9db0d6485b9c042598fcc95e36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36fb9651c0e84e03a736f88873517739 (127.7.39.2:43833), cb49bbd5d49e4ce7895ea0904cec0945 (127.7.39.3:41019)
I20260809 19:09:10.834702 9659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f5c865ae6c9452f9df012720a0aea32" candidate_uuid: "2017da9db0d6485b9c042598fcc95e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36fb9651c0e84e03a736f88873517739" is_pre_election: true
I20260809 19:09:10.834685 9865 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f5c865ae6c9452f9df012720a0aea32" candidate_uuid: "2017da9db0d6485b9c042598fcc95e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" is_pre_election: true
I20260809 19:09:10.834964 9659 raft_consensus.cc:2454] T 3f5c865ae6c9452f9df012720a0aea32 P 36fb9651c0e84e03a736f88873517739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2017da9db0d6485b9c042598fcc95e36 in term 0.
I20260809 19:09:10.834955 9865 raft_consensus.cc:2454] T 3f5c865ae6c9452f9df012720a0aea32 P cb49bbd5d49e4ce7895ea0904cec0945 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2017da9db0d6485b9c042598fcc95e36 in term 0.
I20260809 19:09:10.835425 9306 leader_election.cc:302] T 3f5c865ae6c9452f9df012720a0aea32 P 2017da9db0d6485b9c042598fcc95e36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2017da9db0d6485b9c042598fcc95e36, 36fb9651c0e84e03a736f88873517739; no voters:
I20260809 19:09:10.835779 10010 raft_consensus.cc:2781] T 3f5c865ae6c9452f9df012720a0aea32 P 2017da9db0d6485b9c042598fcc95e36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:09:10.835932 10010 raft_consensus.cc:482] T 3f5c865ae6c9452f9df012720a0aea32 P 2017da9db0d6485b9c042598fcc95e36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:09:10.836061 10010 raft_consensus.cc:3037] T 3f5c865ae6c9452f9df012720a0aea32 P 2017da9db0d6485b9c042598fcc95e36 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:10.839596 10010 raft_consensus.cc:504] T 3f5c865ae6c9452f9df012720a0aea32 P 2017da9db0d6485b9c042598fcc95e36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } }
I20260809 19:09:10.840322 10010 leader_election.cc:288] T 3f5c865ae6c9452f9df012720a0aea32 P 2017da9db0d6485b9c042598fcc95e36 [CANDIDATE]: Term 1 election: Requested vote from peers 36fb9651c0e84e03a736f88873517739 (127.7.39.2:43833), cb49bbd5d49e4ce7895ea0904cec0945 (127.7.39.3:41019)
I20260809 19:09:10.840794 9865 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f5c865ae6c9452f9df012720a0aea32" candidate_uuid: "2017da9db0d6485b9c042598fcc95e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb49bbd5d49e4ce7895ea0904cec0945"
I20260809 19:09:10.840835 9659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f5c865ae6c9452f9df012720a0aea32" candidate_uuid: "2017da9db0d6485b9c042598fcc95e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36fb9651c0e84e03a736f88873517739"
I20260809 19:09:10.840997 9865 raft_consensus.cc:3037] T 3f5c865ae6c9452f9df012720a0aea32 P cb49bbd5d49e4ce7895ea0904cec0945 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:10.841077 9659 raft_consensus.cc:3037] T 3f5c865ae6c9452f9df012720a0aea32 P 36fb9651c0e84e03a736f88873517739 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:10.843031 9865 raft_consensus.cc:2454] T 3f5c865ae6c9452f9df012720a0aea32 P cb49bbd5d49e4ce7895ea0904cec0945 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2017da9db0d6485b9c042598fcc95e36 in term 1.
I20260809 19:09:10.843425 9304 leader_election.cc:302] T 3f5c865ae6c9452f9df012720a0aea32 P 2017da9db0d6485b9c042598fcc95e36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2017da9db0d6485b9c042598fcc95e36, cb49bbd5d49e4ce7895ea0904cec0945; no voters:
I20260809 19:09:10.843701 10010 raft_consensus.cc:2781] T 3f5c865ae6c9452f9df012720a0aea32 P 2017da9db0d6485b9c042598fcc95e36 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:09:10.843838 10010 raft_consensus.cc:686] T 3f5c865ae6c9452f9df012720a0aea32 P 2017da9db0d6485b9c042598fcc95e36 [term 1 LEADER]: Becoming Leader. State: Replica: 2017da9db0d6485b9c042598fcc95e36, State: Running, Role: LEADER
I20260809 19:09:10.844061 9659 raft_consensus.cc:2454] T 3f5c865ae6c9452f9df012720a0aea32 P 36fb9651c0e84e03a736f88873517739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2017da9db0d6485b9c042598fcc95e36 in term 1.
I20260809 19:09:10.844165 10010 consensus_queue.cc:237] T 3f5c865ae6c9452f9df012720a0aea32 P 2017da9db0d6485b9c042598fcc95e36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } }
I20260809 19:09:10.847014 9167 catalog_manager.cc:5495] T 3f5c865ae6c9452f9df012720a0aea32 P 2017da9db0d6485b9c042598fcc95e36 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2017da9db0d6485b9c042598fcc95e36 (127.7.39.1). New cstate: current_term: 1 leader_uuid: "2017da9db0d6485b9c042598fcc95e36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } health_report { overall_health: UNKNOWN } } }
Aug 09 19:09:10 dist-test-slave-4tdj krb5kdc[9098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302548, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:10.909734 10041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:10.896529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34971 (local address 127.0.0.1:51732)
0809 19:09:10.897227 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:10.897242 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:10.897375 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:10.897663 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:10.897667 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:10.898325 (+ 658us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:10.898538 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:10.898547 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.899596 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.899600 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:10.900562 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:10.900574 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.901294 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.901299 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:10.901456 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:10.902134 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:10.902151 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:10.904502 (+ 2351us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:10.907400 (+ 2898us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:10.907412 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:10.907420 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:10.907786 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:10.908107 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:10.908112 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:10.908116 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:10.908265 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:10.908744 (+ 479us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:10.908750 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:10.908882 (+ 132us) client_negotiation.cc:769] Sending connection context
0809 19:09:10.909035 (+ 153us) client_negotiation.cc:240] Negotiation successful
0809 19:09:10.909277 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":468,"threads_started":1}
I20260809 19:09:10.909780 10038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:10.896517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51732 (local address 127.7.39.62:34971)
0809 19:09:10.897073 (+ 556us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:10.897079 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:10.897319 (+ 240us) server_negotiation.cc:407] Connection header received
0809 19:09:10.897484 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:10.897488 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:10.897540 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:10.897625 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:10.898687 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.899446 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.900689 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:10.901145 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:10.901250 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:10.904667 (+ 3417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:10.904671 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:10.904674 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:10.904701 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:10.907279 (+ 2578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:10.907889 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:10.907894 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:10.907898 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:10.908010 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:10.908362 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:10.908367 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:10.908371 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:10.908626 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:10.908750 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:10.909128 (+ 378us) server_negotiation.cc:299] Negotiation successful
0809 19:09:10.909406 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":98,"server-negotiator.queue_time_us":407,"thread_start_us":263,"threads_started":1}
I20260809 19:09:10.915685 9167 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:51732:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 19:09:10.917111 9167 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:09:10.924013 9387 tablet_service.cc:1467] Processing CreateTablet for tablet 1edbd14c93b04e779de982b774fd7c98 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=357ca5fb132c4f27a0be36312f8f89bd]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 19:09:10.924077 9625 tablet_service.cc:1467] Processing CreateTablet for tablet 1edbd14c93b04e779de982b774fd7c98 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=357ca5fb132c4f27a0be36312f8f89bd]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 19:09:10.924180 9832 tablet_service.cc:1467] Processing CreateTablet for tablet 1edbd14c93b04e779de982b774fd7c98 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=357ca5fb132c4f27a0be36312f8f89bd]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 19:09:10.924638 9387 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1edbd14c93b04e779de982b774fd7c98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:10.924642 9625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1edbd14c93b04e779de982b774fd7c98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:10.924680 9832 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1edbd14c93b04e779de982b774fd7c98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:10.931874 9982 tablet_bootstrap.cc:492] T 1edbd14c93b04e779de982b774fd7c98 P 2017da9db0d6485b9c042598fcc95e36: Bootstrap starting.
I20260809 19:09:10.932286 9984 tablet_bootstrap.cc:492] T 1edbd14c93b04e779de982b774fd7c98 P 36fb9651c0e84e03a736f88873517739: Bootstrap starting.
I20260809 19:09:10.933427 9982 tablet_bootstrap.cc:654] T 1edbd14c93b04e779de982b774fd7c98 P 2017da9db0d6485b9c042598fcc95e36: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:10.934020 9985 tablet_bootstrap.cc:492] T 1edbd14c93b04e779de982b774fd7c98 P cb49bbd5d49e4ce7895ea0904cec0945: Bootstrap starting.
I20260809 19:09:10.934048 9984 tablet_bootstrap.cc:654] T 1edbd14c93b04e779de982b774fd7c98 P 36fb9651c0e84e03a736f88873517739: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:10.935707 9985 tablet_bootstrap.cc:654] T 1edbd14c93b04e779de982b774fd7c98 P cb49bbd5d49e4ce7895ea0904cec0945: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:10.943245 9985 tablet_bootstrap.cc:492] T 1edbd14c93b04e779de982b774fd7c98 P cb49bbd5d49e4ce7895ea0904cec0945: No bootstrap required, opened a new log
I20260809 19:09:10.943415 9985 ts_tablet_manager.cc:1397] T 1edbd14c93b04e779de982b774fd7c98 P cb49bbd5d49e4ce7895ea0904cec0945: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.001s
I20260809 19:09:10.943791 9982 tablet_bootstrap.cc:492] T 1edbd14c93b04e779de982b774fd7c98 P 2017da9db0d6485b9c042598fcc95e36: No bootstrap required, opened a new log
I20260809 19:09:10.943955 9982 ts_tablet_manager.cc:1397] T 1edbd14c93b04e779de982b774fd7c98 P 2017da9db0d6485b9c042598fcc95e36: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20260809 19:09:10.944440 9985 raft_consensus.cc:348] T 1edbd14c93b04e779de982b774fd7c98 P cb49bbd5d49e4ce7895ea0904cec0945 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } }
I20260809 19:09:10.944792 9985 raft_consensus.cc:374] T 1edbd14c93b04e779de982b774fd7c98 P cb49bbd5d49e4ce7895ea0904cec0945 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:10.944693 9982 raft_consensus.cc:348] T 1edbd14c93b04e779de982b774fd7c98 P 2017da9db0d6485b9c042598fcc95e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } }
I20260809 19:09:10.944922 9982 raft_consensus.cc:374] T 1edbd14c93b04e779de982b774fd7c98 P 2017da9db0d6485b9c042598fcc95e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:10.944950 9985 raft_consensus.cc:729] T 1edbd14c93b04e779de982b774fd7c98 P cb49bbd5d49e4ce7895ea0904cec0945 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb49bbd5d49e4ce7895ea0904cec0945, State: Initialized, Role: FOLLOWER
I20260809 19:09:10.945084 9982 raft_consensus.cc:729] T 1edbd14c93b04e779de982b774fd7c98 P 2017da9db0d6485b9c042598fcc95e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2017da9db0d6485b9c042598fcc95e36, State: Initialized, Role: FOLLOWER
I20260809 19:09:10.945284 9985 consensus_queue.cc:260] T 1edbd14c93b04e779de982b774fd7c98 P cb49bbd5d49e4ce7895ea0904cec0945 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } }
I20260809 19:09:10.945421 9982 consensus_queue.cc:260] T 1edbd14c93b04e779de982b774fd7c98 P 2017da9db0d6485b9c042598fcc95e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } }
I20260809 19:09:10.945706 9984 tablet_bootstrap.cc:492] T 1edbd14c93b04e779de982b774fd7c98 P 36fb9651c0e84e03a736f88873517739: No bootstrap required, opened a new log
I20260809 19:09:10.945937 10010 tablet_replica.cc:439] T 1edbd14c93b04e779de982b774fd7c98 P 2017da9db0d6485b9c042598fcc95e36: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } } }
I20260809 19:09:10.946261 10010 tablet_replica.cc:442] T 1edbd14c93b04e779de982b774fd7c98 P 2017da9db0d6485b9c042598fcc95e36: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 19:09:10.946777 9985 ts_tablet_manager.cc:1428] T 1edbd14c93b04e779de982b774fd7c98 P cb49bbd5d49e4ce7895ea0904cec0945: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260809 19:09:10.946630 9993 tablet_replica.cc:439] T 1edbd14c93b04e779de982b774fd7c98 P cb49bbd5d49e4ce7895ea0904cec0945: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } } }
I20260809 19:09:10.946962 9993 tablet_replica.cc:442] T 1edbd14c93b04e779de982b774fd7c98 P cb49bbd5d49e4ce7895ea0904cec0945: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 19:09:10.947772 9982 ts_tablet_manager.cc:1428] T 1edbd14c93b04e779de982b774fd7c98 P 2017da9db0d6485b9c042598fcc95e36: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260809 19:09:10.948305 9984 ts_tablet_manager.cc:1397] T 1edbd14c93b04e779de982b774fd7c98 P 36fb9651c0e84e03a736f88873517739: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.005s
I20260809 19:09:10.949688 9984 raft_consensus.cc:348] T 1edbd14c93b04e779de982b774fd7c98 P 36fb9651c0e84e03a736f88873517739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } }
I20260809 19:09:10.949941 9984 raft_consensus.cc:374] T 1edbd14c93b04e779de982b774fd7c98 P 36fb9651c0e84e03a736f88873517739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:10.950234 9984 raft_consensus.cc:729] T 1edbd14c93b04e779de982b774fd7c98 P 36fb9651c0e84e03a736f88873517739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36fb9651c0e84e03a736f88873517739, State: Initialized, Role: FOLLOWER
I20260809 19:09:10.950614 9984 consensus_queue.cc:260] T 1edbd14c93b04e779de982b774fd7c98 P 36fb9651c0e84e03a736f88873517739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } }
I20260809 19:09:10.951220 9984 ts_tablet_manager.cc:1428] T 1edbd14c93b04e779de982b774fd7c98 P 36fb9651c0e84e03a736f88873517739: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260809 19:09:10.951123 9994 tablet_replica.cc:439] T 1edbd14c93b04e779de982b774fd7c98 P 36fb9651c0e84e03a736f88873517739: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } } }
I20260809 19:09:10.951524 9994 tablet_replica.cc:442] T 1edbd14c93b04e779de982b774fd7c98 P 36fb9651c0e84e03a736f88873517739: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 19:09:11.155547 9994 raft_consensus.cc:482] T 1edbd14c93b04e779de982b774fd7c98 P 36fb9651c0e84e03a736f88873517739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:09:11.155736 9994 raft_consensus.cc:504] T 1edbd14c93b04e779de982b774fd7c98 P 36fb9651c0e84e03a736f88873517739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } }
I20260809 19:09:11.157059 9994 leader_election.cc:288] T 1edbd14c93b04e779de982b774fd7c98 P 36fb9651c0e84e03a736f88873517739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2017da9db0d6485b9c042598fcc95e36 (127.7.39.1:38077), cb49bbd5d49e4ce7895ea0904cec0945 (127.7.39.3:41019)
I20260809 19:09:11.178128 10049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:11.157431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:53357 (local address 127.7.39.1:38077)
0809 19:09:11.172639 (+ 15208us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:11.172645 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:11.172900 (+ 255us) server_negotiation.cc:407] Connection header received
0809 19:09:11.173166 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:11.173172 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:11.173247 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:11.173322 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:11.173869 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:11.174677 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:11.176387 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:11.177167 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:11.177267 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:11.177363 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:11.177690 (+ 327us) server_negotiation.cc:299] Negotiation successful
0809 19:09:11.177825 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15078,"thread_start_us":15220,"threads_started":1}
I20260809 19:09:11.178148 10050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:11.157431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:33729 (local address 127.7.39.3:41019)
0809 19:09:11.172662 (+ 15231us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:11.172667 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:11.173099 (+ 432us) server_negotiation.cc:407] Connection header received
0809 19:09:11.173255 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:11.173259 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:11.173319 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:11.173415 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:11.174011 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:11.174872 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:11.176522 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:11.177252 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:11.177366 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:11.177465 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:11.177724 (+ 259us) server_negotiation.cc:299] Negotiation successful
0809 19:09:11.177848 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15119,"thread_start_us":15496,"threads_started":1}
I20260809 19:09:11.178220 10047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:11.157368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:38077 (local address 127.7.39.2:53357)
0809 19:09:11.172774 (+ 15406us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:11.172796 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:11.173007 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:11.173365 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:11.173370 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:11.173395 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:11.173678 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:11.173689 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:11.174812 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:11.174817 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:11.176216 (+ 1399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:11.176228 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:11.177321 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:11.177327 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:11.177528 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:11.177564 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 19:09:11.177636 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 19:09:11.177778 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14940,"mutex_wait_us":4,"spinlock_wait_cycles":191744,"thread_start_us":14968,"threads_started":1}
I20260809 19:09:11.178244 10051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:11.157368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:41019 (local address 127.7.39.2:33729)
0809 19:09:11.172986 (+ 15618us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:11.173004 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:11.173144 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:11.173446 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:11.173451 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:11.173491 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:11.173871 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:11.173882 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:11.174994 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:11.174998 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:11.176386 (+ 1388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:11.176400 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:11.177438 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:11.177443 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:11.177579 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:11.177601 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 19:09:11.177691 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 19:09:11.177843 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15493,"mutex_wait_us":72,"thread_start_us":15337,"threads_started":1}
I20260809 19:09:11.178920 9865 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1edbd14c93b04e779de982b774fd7c98" candidate_uuid: "36fb9651c0e84e03a736f88873517739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" is_pre_election: true
I20260809 19:09:11.179219 9865 raft_consensus.cc:2454] T 1edbd14c93b04e779de982b774fd7c98 P cb49bbd5d49e4ce7895ea0904cec0945 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36fb9651c0e84e03a736f88873517739 in term 0.
I20260809 19:09:11.179390 9436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1edbd14c93b04e779de982b774fd7c98" candidate_uuid: "36fb9651c0e84e03a736f88873517739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2017da9db0d6485b9c042598fcc95e36" is_pre_election: true
I20260809 19:09:11.179687 9541 leader_election.cc:302] T 1edbd14c93b04e779de982b774fd7c98 P 36fb9651c0e84e03a736f88873517739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36fb9651c0e84e03a736f88873517739, cb49bbd5d49e4ce7895ea0904cec0945; no voters:
I20260809 19:09:11.179747 9436 raft_consensus.cc:2454] T 1edbd14c93b04e779de982b774fd7c98 P 2017da9db0d6485b9c042598fcc95e36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36fb9651c0e84e03a736f88873517739 in term 0.
I20260809 19:09:11.180114 9994 raft_consensus.cc:2781] T 1edbd14c93b04e779de982b774fd7c98 P 36fb9651c0e84e03a736f88873517739 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:09:11.180248 9994 raft_consensus.cc:482] T 1edbd14c93b04e779de982b774fd7c98 P 36fb9651c0e84e03a736f88873517739 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:09:11.180362 9994 raft_consensus.cc:3037] T 1edbd14c93b04e779de982b774fd7c98 P 36fb9651c0e84e03a736f88873517739 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:11.182519 9994 raft_consensus.cc:504] T 1edbd14c93b04e779de982b774fd7c98 P 36fb9651c0e84e03a736f88873517739 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } }
I20260809 19:09:11.183049 9994 leader_election.cc:288] T 1edbd14c93b04e779de982b774fd7c98 P 36fb9651c0e84e03a736f88873517739 [CANDIDATE]: Term 1 election: Requested vote from peers 2017da9db0d6485b9c042598fcc95e36 (127.7.39.1:38077), cb49bbd5d49e4ce7895ea0904cec0945 (127.7.39.3:41019)
I20260809 19:09:11.183455 9436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1edbd14c93b04e779de982b774fd7c98" candidate_uuid: "36fb9651c0e84e03a736f88873517739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2017da9db0d6485b9c042598fcc95e36"
I20260809 19:09:11.183482 9865 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1edbd14c93b04e779de982b774fd7c98" candidate_uuid: "36fb9651c0e84e03a736f88873517739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb49bbd5d49e4ce7895ea0904cec0945"
I20260809 19:09:11.183663 9436 raft_consensus.cc:3037] T 1edbd14c93b04e779de982b774fd7c98 P 2017da9db0d6485b9c042598fcc95e36 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:11.183704 9865 raft_consensus.cc:3037] T 1edbd14c93b04e779de982b774fd7c98 P cb49bbd5d49e4ce7895ea0904cec0945 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:11.186550 9865 raft_consensus.cc:2454] T 1edbd14c93b04e779de982b774fd7c98 P cb49bbd5d49e4ce7895ea0904cec0945 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36fb9651c0e84e03a736f88873517739 in term 1.
I20260809 19:09:11.186580 9436 raft_consensus.cc:2454] T 1edbd14c93b04e779de982b774fd7c98 P 2017da9db0d6485b9c042598fcc95e36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36fb9651c0e84e03a736f88873517739 in term 1.
I20260809 19:09:11.186928 9541 leader_election.cc:302] T 1edbd14c93b04e779de982b774fd7c98 P 36fb9651c0e84e03a736f88873517739 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2017da9db0d6485b9c042598fcc95e36, 36fb9651c0e84e03a736f88873517739, cb49bbd5d49e4ce7895ea0904cec0945; no voters:
I20260809 19:09:11.187217 9994 raft_consensus.cc:2781] T 1edbd14c93b04e779de982b774fd7c98 P 36fb9651c0e84e03a736f88873517739 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:09:11.187566 9994 raft_consensus.cc:686] T 1edbd14c93b04e779de982b774fd7c98 P 36fb9651c0e84e03a736f88873517739 [term 1 LEADER]: Becoming Leader. State: Replica: 36fb9651c0e84e03a736f88873517739, State: Running, Role: LEADER
I20260809 19:09:11.187943 9994 consensus_queue.cc:237] T 1edbd14c93b04e779de982b774fd7c98 P 36fb9651c0e84e03a736f88873517739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } }
I20260809 19:09:11.189814 10052 tablet_replica.cc:439] T 1edbd14c93b04e779de982b774fd7c98 P 36fb9651c0e84e03a736f88873517739: TxnStatusTablet state changed. Reason: New leader 36fb9651c0e84e03a736f88873517739. Latest consensus state: current_term: 1 leader_uuid: "36fb9651c0e84e03a736f88873517739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } } }
I20260809 19:09:11.190191 10052 tablet_replica.cc:442] T 1edbd14c93b04e779de982b774fd7c98 P 36fb9651c0e84e03a736f88873517739: This TxnStatusTablet replica's current role is: LEADER
I20260809 19:09:11.190961 10054 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 19:09:11.191223 10054 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 19:09:11.191499 9166 catalog_manager.cc:5495] T 1edbd14c93b04e779de982b774fd7c98 P 36fb9651c0e84e03a736f88873517739 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36fb9651c0e84e03a736f88873517739 (127.7.39.2). New cstate: current_term: 1 leader_uuid: "36fb9651c0e84e03a736f88873517739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } health_report { overall_health: UNKNOWN } } }
I20260809 19:09:11.251559 10041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:11.245271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:43833 (local address 127.0.0.1:47688)
0809 19:09:11.245558 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:11.245582 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:11.245724 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:11.246337 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:11.246341 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:11.246352 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 19:09:11.246503 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:11.246511 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:11.247940 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:11.247943 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:11.248893 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:11.248903 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:11.249866 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:11.249871 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:11.250023 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:11.250078 (+ 55us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 19:09:11.251120 (+ 1042us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 19:09:11.251133 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 19:09:11.251195 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 19:09:11.251315 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260809 19:09:11.251677 10057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:11.245229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47688 (local address 127.7.39.2:43833)
0809 19:09:11.245899 (+ 670us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:11.245926 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:11.245946 (+ 20us) server_negotiation.cc:407] Connection header received
0809 19:09:11.246037 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:11.246042 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:11.246137 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:11.246329 (+ 192us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:09:11.246630 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:11.247831 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:11.249023 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:11.249729 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:11.249858 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:11.250317 (+ 459us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:09:11.251028 (+ 711us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:09:11.251175 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:11.251247 (+ 72us) server_negotiation.cc:299] Negotiation successful
0809 19:09:11.251327 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":538,"thread_start_us":398,"threads_started":1}
I20260809 19:09:11.256364 9865 raft_consensus.cc:1261] T 1edbd14c93b04e779de982b774fd7c98 P cb49bbd5d49e4ce7895ea0904cec0945 [term 1 FOLLOWER]: Refusing update from remote peer 36fb9651c0e84e03a736f88873517739: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:09:11.256641 9436 raft_consensus.cc:1261] T 1edbd14c93b04e779de982b774fd7c98 P 2017da9db0d6485b9c042598fcc95e36 [term 1 FOLLOWER]: Refusing update from remote peer 36fb9651c0e84e03a736f88873517739: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:09:11.256999 10052 consensus_queue.cc:1035] T 1edbd14c93b04e779de982b774fd7c98 P 36fb9651c0e84e03a736f88873517739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:09:11.257373 9994 consensus_queue.cc:1035] T 1edbd14c93b04e779de982b774fd7c98 P 36fb9651c0e84e03a736f88873517739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:09:11.267637 9993 tablet_replica.cc:439] T 1edbd14c93b04e779de982b774fd7c98 P cb49bbd5d49e4ce7895ea0904cec0945: TxnStatusTablet state changed. Reason: New leader 36fb9651c0e84e03a736f88873517739. Latest consensus state: current_term: 1 leader_uuid: "36fb9651c0e84e03a736f88873517739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } } }
I20260809 19:09:11.267935 9993 tablet_replica.cc:442] T 1edbd14c93b04e779de982b774fd7c98 P cb49bbd5d49e4ce7895ea0904cec0945: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 19:09:11.269886 10058 mvcc.cc:205] Tried to move back new op lower bound from 7316695249939173376 to 7316695249669001216. Current Snapshot: MvccSnapshot[applied={T|T < 7316695249939173376}]
I20260809 19:09:11.270567 9994 tablet_replica.cc:439] T 1edbd14c93b04e779de982b774fd7c98 P 36fb9651c0e84e03a736f88873517739: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "36fb9651c0e84e03a736f88873517739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } } }
I20260809 19:09:11.270852 9994 tablet_replica.cc:442] T 1edbd14c93b04e779de982b774fd7c98 P 36fb9651c0e84e03a736f88873517739: This TxnStatusTablet replica's current role is: LEADER
I20260809 19:09:11.271394 10059 mvcc.cc:205] Tried to move back new op lower bound from 7316695249939173376 to 7316695249669001216. Current Snapshot: MvccSnapshot[applied={T|T < 7316695249939173376}]
I20260809 19:09:11.272683 10010 tablet_replica.cc:439] T 1edbd14c93b04e779de982b774fd7c98 P 2017da9db0d6485b9c042598fcc95e36: TxnStatusTablet state changed. Reason: New leader 36fb9651c0e84e03a736f88873517739. Latest consensus state: current_term: 1 leader_uuid: "36fb9651c0e84e03a736f88873517739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } } }
I20260809 19:09:11.272958 10010 tablet_replica.cc:442] T 1edbd14c93b04e779de982b774fd7c98 P 2017da9db0d6485b9c042598fcc95e36: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 19:09:11.274933 10052 tablet_replica.cc:439] T 1edbd14c93b04e779de982b774fd7c98 P 36fb9651c0e84e03a736f88873517739: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "36fb9651c0e84e03a736f88873517739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } } }
I20260809 19:09:11.275156 10052 tablet_replica.cc:442] T 1edbd14c93b04e779de982b774fd7c98 P 36fb9651c0e84e03a736f88873517739: This TxnStatusTablet replica's current role is: LEADER
I20260809 19:09:11.277745 9993 tablet_replica.cc:439] T 1edbd14c93b04e779de982b774fd7c98 P cb49bbd5d49e4ce7895ea0904cec0945: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "36fb9651c0e84e03a736f88873517739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } } }
I20260809 19:09:11.277987 9993 tablet_replica.cc:442] T 1edbd14c93b04e779de982b774fd7c98 P cb49bbd5d49e4ce7895ea0904cec0945: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 19:09:11.282397 10010 tablet_replica.cc:439] T 1edbd14c93b04e779de982b774fd7c98 P 2017da9db0d6485b9c042598fcc95e36: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "36fb9651c0e84e03a736f88873517739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2017da9db0d6485b9c042598fcc95e36" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38077 } } peers { permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 } } peers { permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 } } }
I20260809 19:09:11.282650 10010 tablet_replica.cc:442] T 1edbd14c93b04e779de982b774fd7c98 P 2017da9db0d6485b9c042598fcc95e36: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 19:09:11.295157 10057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:11.288729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:33695 (local address 127.7.39.2:43833)
0809 19:09:11.288920 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:11.288927 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:11.290838 (+ 1911us) server_negotiation.cc:407] Connection header received
0809 19:09:11.291016 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:11.291020 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:11.291086 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:11.291156 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:09:11.291584 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:11.292320 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:11.293554 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:11.293952 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:11.294056 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:11.294481 (+ 425us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:09:11.294585 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:09:11.294658 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:11.294790 (+ 132us) server_negotiation.cc:299] Negotiation successful
0809 19:09:11.294865 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 19:09:11.295243 10074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:11.288682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:43833 (local address 127.7.39.1:33695)
0809 19:09:11.290745 (+ 2063us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:11.290760 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:11.290893 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:11.291185 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:11.291189 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:11.291202 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 19:09:11.291450 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:11.291459 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:11.292446 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:11.292451 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:11.293416 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:11.293428 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:11.294131 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:11.294136 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:11.294247 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:11.294323 (+ 76us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 19:09:11.294673 (+ 350us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 19:09:11.294685 (+ 12us) client_negotiation.cc:769] Sending connection context
0809 19:09:11.294754 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 19:09:11.294881 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1899,"thread_start_us":1786,"threads_started":1}
I20260809 19:09:11.304490 9865 raft_consensus.cc:1261] T 3f5c865ae6c9452f9df012720a0aea32 P cb49bbd5d49e4ce7895ea0904cec0945 [term 1 FOLLOWER]: Refusing update from remote peer 2017da9db0d6485b9c042598fcc95e36: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:09:11.304629 9659 raft_consensus.cc:1261] T 3f5c865ae6c9452f9df012720a0aea32 P 36fb9651c0e84e03a736f88873517739 [term 1 FOLLOWER]: Refusing update from remote peer 2017da9db0d6485b9c042598fcc95e36: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:09:11.305099 9998 consensus_queue.cc:1035] T 3f5c865ae6c9452f9df012720a0aea32 P 2017da9db0d6485b9c042598fcc95e36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb49bbd5d49e4ce7895ea0904cec0945" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 41019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:09:11.305408 10010 consensus_queue.cc:1035] T 3f5c865ae6c9452f9df012720a0aea32 P 2017da9db0d6485b9c042598fcc95e36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36fb9651c0e84e03a736f88873517739" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 43833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:09:11.309204 10060 mvcc.cc:205] Tried to move back new op lower bound from 7316695250138546176 to 7316695248260317184. Current Snapshot: MvccSnapshot[applied={T|T < 7316695250138546176}]
I20260809 19:09:11.346455 10049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:11.340404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:55403 (local address 127.7.39.1:38077)
0809 19:09:11.340575 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:11.340579 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:11.341174 (+ 595us) server_negotiation.cc:407] Connection header received
0809 19:09:11.341364 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:11.341369 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:11.341432 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:11.341502 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:09:11.342057 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:11.342863 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:11.344795 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:11.345245 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:11.345354 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:11.345790 (+ 436us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:09:11.345890 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:09:11.345962 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:11.346102 (+ 140us) server_negotiation.cc:299] Negotiation successful
0809 19:09:11.346179 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 19:09:11.346657 10087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:11.340442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:38077 (local address 127.7.39.2:55403)
0809 19:09:11.341073 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:11.341089 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:11.341230 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:11.341535 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:11.341540 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:11.341551 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 19:09:11.341895 (+ 344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:11.341904 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:11.343026 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:11.343031 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:11.344672 (+ 1641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:11.344688 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:11.345422 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:11.345428 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:11.345559 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:11.345620 (+ 61us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 19:09:11.345985 (+ 365us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 19:09:11.346001 (+ 16us) client_negotiation.cc:769] Sending connection context
0809 19:09:11.346072 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 19:09:11.346204 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":323,"threads_started":1}
I20260809 19:09:11.382961 9166 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51718:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:09:11.383173 9166 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51718:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:09:11.386041 9166 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9525e827d98a45c69c7952ebe5219a21: Sending DeleteTablet for 3 replicas of tablet 3f5c865ae6c9452f9df012720a0aea32
I20260809 19:09:11.386696 9387 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f5c865ae6c9452f9df012720a0aea32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:09:11 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:43054
I20260809 19:09:11.387283 9832 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f5c865ae6c9452f9df012720a0aea32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:09:11 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:43226
I20260809 19:09:11.387362 10089 tablet_replica.cc:330] T 3f5c865ae6c9452f9df012720a0aea32 P 2017da9db0d6485b9c042598fcc95e36: stopping tablet replica
I20260809 19:09:11.387557 10089 raft_consensus.cc:2229] T 3f5c865ae6c9452f9df012720a0aea32 P 2017da9db0d6485b9c042598fcc95e36 [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:09:11.387841 9625 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f5c865ae6c9452f9df012720a0aea32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:09:11 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:47674
I20260809 19:09:11.387990 10089 raft_consensus.cc:2258] T 3f5c865ae6c9452f9df012720a0aea32 P 2017da9db0d6485b9c042598fcc95e36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:09:11.389082 10089 ts_tablet_manager.cc:1905] T 3f5c865ae6c9452f9df012720a0aea32 P 2017da9db0d6485b9c042598fcc95e36: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:09:11.394374 10098 tablet_replica.cc:330] T 3f5c865ae6c9452f9df012720a0aea32 P 36fb9651c0e84e03a736f88873517739: stopping tablet replica
I20260809 19:09:11.395117 10098 raft_consensus.cc:2229] T 3f5c865ae6c9452f9df012720a0aea32 P 36fb9651c0e84e03a736f88873517739 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:09:11.395701 10098 raft_consensus.cc:2258] T 3f5c865ae6c9452f9df012720a0aea32 P 36fb9651c0e84e03a736f88873517739 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:09:11.396747 10089 ts_tablet_manager.cc:1918] T 3f5c865ae6c9452f9df012720a0aea32 P 2017da9db0d6485b9c042598fcc95e36: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 19:09:11.396915 10089 log.cc:1196] T 3f5c865ae6c9452f9df012720a0aea32 P 2017da9db0d6485b9c042598fcc95e36: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-0/wal/wals/3f5c865ae6c9452f9df012720a0aea32
I20260809 19:09:11.397210 10098 ts_tablet_manager.cc:1905] T 3f5c865ae6c9452f9df012720a0aea32 P 36fb9651c0e84e03a736f88873517739: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:09:11.397459 10089 ts_tablet_manager.cc:1939] T 3f5c865ae6c9452f9df012720a0aea32 P 2017da9db0d6485b9c042598fcc95e36: Deleting consensus metadata
I20260809 19:09:11.398551 9144 catalog_manager.cc:4841] TS 2017da9db0d6485b9c042598fcc95e36 (127.7.39.1:38077): tablet 3f5c865ae6c9452f9df012720a0aea32 (table test-table [id=88d58a4120564db19908620e21829946]) successfully deleted
I20260809 19:09:11.400906 10090 tablet_replica.cc:330] T 3f5c865ae6c9452f9df012720a0aea32 P cb49bbd5d49e4ce7895ea0904cec0945: stopping tablet replica
I20260809 19:09:11.401203 10090 raft_consensus.cc:2229] T 3f5c865ae6c9452f9df012720a0aea32 P cb49bbd5d49e4ce7895ea0904cec0945 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:09:11.401527 10090 raft_consensus.cc:2258] T 3f5c865ae6c9452f9df012720a0aea32 P cb49bbd5d49e4ce7895ea0904cec0945 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:09:11.402592 10090 ts_tablet_manager.cc:1905] T 3f5c865ae6c9452f9df012720a0aea32 P cb49bbd5d49e4ce7895ea0904cec0945: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:09:11.404453 10098 ts_tablet_manager.cc:1918] T 3f5c865ae6c9452f9df012720a0aea32 P 36fb9651c0e84e03a736f88873517739: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 19:09:11.404645 10098 log.cc:1196] T 3f5c865ae6c9452f9df012720a0aea32 P 36fb9651c0e84e03a736f88873517739: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-1/wal/wals/3f5c865ae6c9452f9df012720a0aea32
I20260809 19:09:11.405243 10098 ts_tablet_manager.cc:1939] T 3f5c865ae6c9452f9df012720a0aea32 P 36fb9651c0e84e03a736f88873517739: Deleting consensus metadata
I20260809 19:09:11.406575 9144 catalog_manager.cc:4841] TS 36fb9651c0e84e03a736f88873517739 (127.7.39.2:43833): tablet 3f5c865ae6c9452f9df012720a0aea32 (table test-table [id=88d58a4120564db19908620e21829946]) successfully deleted
I20260809 19:09:11.409235 10090 ts_tablet_manager.cc:1918] T 3f5c865ae6c9452f9df012720a0aea32 P cb49bbd5d49e4ce7895ea0904cec0945: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 19:09:11.409358 10090 log.cc:1196] T 3f5c865ae6c9452f9df012720a0aea32 P cb49bbd5d49e4ce7895ea0904cec0945: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786302538618573-7324-0/minicluster-data/ts-2/wal/wals/3f5c865ae6c9452f9df012720a0aea32
I20260809 19:09:11.409782 10090 ts_tablet_manager.cc:1939] T 3f5c865ae6c9452f9df012720a0aea32 P cb49bbd5d49e4ce7895ea0904cec0945: Deleting consensus metadata
I20260809 19:09:11.410943 9142 catalog_manager.cc:4841] TS cb49bbd5d49e4ce7895ea0904cec0945 (127.7.39.3:41019): tablet 3f5c865ae6c9452f9df012720a0aea32 (table test-table [id=88d58a4120564db19908620e21829946]) successfully deleted
Aug 09 19:09:11 dist-test-slave-4tdj krb5kdc[9098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302550, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.39.1@KRBTEST.COM
I20260809 19:09:11.421380 10049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:11.405455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43076 (local address 127.7.39.1:38077)
0809 19:09:11.405606 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:11.405612 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:11.407382 (+ 1770us) server_negotiation.cc:407] Connection header received
0809 19:09:11.407555 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:11.407559 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:11.407624 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:11.407708 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:11.409054 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:11.409841 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:11.411181 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:11.411586 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:11.411693 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:11.415931 (+ 4238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:11.415942 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:11.415957 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:11.415986 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:11.418780 (+ 2794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:11.419552 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:11.419558 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:11.419561 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:11.419687 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:11.420064 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:11.420067 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:11.420069 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:11.420396 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:11.420662 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:11.420928 (+ 266us) server_negotiation.cc:299] Negotiation successful
0809 19:09:11.421085 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
W20260809 19:09:11.422142 9498 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43076
I20260809 19:09:11.438763 10106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:11.424930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51738 (local address 127.7.39.62:34971)
0809 19:09:11.426668 (+ 1738us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:11.426672 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:11.426687 (+ 15us) server_negotiation.cc:407] Connection header received
0809 19:09:11.426731 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:11.426734 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:11.426789 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:11.426870 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:11.428376 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:11.429160 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:11.430840 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:11.431271 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:11.431364 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:11.433872 (+ 2508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:11.433876 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:11.433879 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:11.433920 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:11.436391 (+ 2471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:11.437128 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:11.437132 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:11.437134 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:11.437243 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:11.437565 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:11.437567 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:11.437569 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:11.437796 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:11.437974 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:11.438328 (+ 354us) server_negotiation.cc:299] Negotiation successful
0809 19:09:11.438490 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1640,"thread_start_us":1503,"threads_started":1}
W20260809 19:09:11.439280 9166 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51738
I20260809 19:09:11.442094 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 9276
I20260809 19:09:11.454952 10049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:11.442901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43084 (local address 127.7.39.1:38077)
0809 19:09:11.443099 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:11.443105 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:11.443308 (+ 203us) server_negotiation.cc:407] Connection header received
0809 19:09:11.443445 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:11.443450 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:11.443525 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:11.443625 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:11.444544 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:11.445558 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:11.446805 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:11.447429 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:11.447556 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:11.449494 (+ 1938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:11.449500 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:11.449505 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:11.449542 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:11.452606 (+ 3064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:11.453248 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:11.453252 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:11.453255 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:11.453389 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:11.453751 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:11.453754 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:11.453756 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:11.454007 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:11.454230 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:11.454574 (+ 344us) server_negotiation.cc:299] Negotiation successful
0809 19:09:11.454728 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
W20260809 19:09:11.455534 9498 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43084
W20260809 19:09:11.456022 7324 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 9276: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 19:09:11.456184 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 9276
I20260809 19:09:11.497593 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 9518
Aug 09 19:09:11 dist-test-slave-4tdj krb5kdc[9098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302550, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.39.2@KRBTEST.COM
I20260809 19:09:11.514604 10057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:11.498445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47702 (local address 127.7.39.2:43833)
0809 19:09:11.498613 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:11.498618 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:11.498637 (+ 19us) server_negotiation.cc:407] Connection header received
0809 19:09:11.498841 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:11.498845 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:11.498934 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:11.499025 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:11.500569 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:11.501419 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:11.503204 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:11.503647 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:11.503741 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:11.508654 (+ 4913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:11.508664 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:11.508677 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:11.508713 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:11.511591 (+ 2878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:11.512357 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:11.512366 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:11.512368 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:11.512496 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:11.512901 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:11.512904 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:11.512906 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:11.513252 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:11.513526 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:11.513899 (+ 373us) server_negotiation.cc:299] Negotiation successful
0809 19:09:11.514110 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
W20260809 19:09:11.515295 9725 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47702
W20260809 19:09:11.515920 7324 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 9518: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 19:09:11.516130 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 9518
I20260809 19:09:11.541754 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 9738
Aug 09 19:09:11 dist-test-slave-4tdj krb5kdc[9098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302550, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.39.3@KRBTEST.COM
I20260809 19:09:11.556805 10050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:11.542513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43240 (local address 127.7.39.3:41019)
0809 19:09:11.542688 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:11.542694 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:11.542735 (+ 41us) server_negotiation.cc:407] Connection header received
0809 19:09:11.542929 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:11.542933 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:11.543000 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:11.543092 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:11.544295 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:11.544961 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:11.546201 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:11.546697 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:11.546809 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:11.550878 (+ 4069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:11.550895 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:11.550914 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:11.550957 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:11.554268 (+ 3311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:11.554903 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:11.554913 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:11.554916 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:11.555076 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:11.555373 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:11.555377 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:11.555381 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:11.555791 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:11.556083 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:11.556227 (+ 144us) server_negotiation.cc:299] Negotiation successful
0809 19:09:11.556458 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
W20260809 19:09:11.557444 9936 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43240
W20260809 19:09:11.558012 7324 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 9738: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 19:09:11.558139 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 9738
I20260809 19:09:11.577286 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 9117
I20260809 19:09:11.578226 9227 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:11.688853 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 9117
2026-08-09T19:09:11Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (4903 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:09:11 dist-test-slave-4tdj krb5kdc[10116](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:09:11 dist-test-slave-4tdj krb5kdc[10116](info): set up 2 sockets
Aug 09 19:09:11 dist-test-slave-4tdj krb5kdc[10116](info): commencing operation
krb5kdc: starting...
W20260809 19:09:12.870381 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.134s user 0.006s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:09:12 dist-test-slave-4tdj krb5kdc[10116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302552, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:09:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:09:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.39.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
I20260809 19:09:13.047122 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:40951
--webserver_interface=127.7.39.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:45485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:40951
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:13.363746 10134 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:13.364009 10134 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:13.364133 10134 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:13.371377 10134 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:09:13.371464 10134 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 19:09:13.371526 10134 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:13.371613 10134 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:13.371671 10134 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:09:13.371752 10134 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:09:13.381160 10134 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:45485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:40951
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:40951
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:13.382357 10134 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:13.383668 10134 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:13.394507 10141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:13.394572 10145 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:13.394603 10143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:13.395357 10134 server_base.cc:1034] running on GCE node
I20260809 19:09:13.396103 10134 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:13.397359 10134 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:13.398568 10134 hybrid_clock.cc:648] HybridClock initialized: now 1786302553398507 us; error 58 us; skew 500 ppm
I20260809 19:09:13.398873 10134 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:13 dist-test-slave-4tdj krb5kdc[10116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302553, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:13.401719 10134 init.cc:377] Logged in from keytab as kudu/127.7.39.62@KRBTEST.COM (short username kudu)
I20260809 19:09:13.403106 10134 webserver.cc:460] Webserver started at http://127.7.39.62:36053/ using document root <none> and password file <none>
I20260809 19:09:13.403740 10134 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:13.403838 10134 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:13.404129 10134 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:13.406965 10134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "8a28432874cf4ec4b00485ee845290ea"
format_stamp: "Formatted at 2026-08-09 19:09:13 on dist-test-slave-4tdj"
server_key: "80d8b853cf25d63185c01b36832a9ce5"
server_key_iv: "fbc9d1d497e8fefb1f099efb2be25e91"
server_key_version: "encryptionkey@0"
I20260809 19:09:13.407756 10134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "8a28432874cf4ec4b00485ee845290ea"
format_stamp: "Formatted at 2026-08-09 19:09:13 on dist-test-slave-4tdj"
server_key: "80d8b853cf25d63185c01b36832a9ce5"
server_key_iv: "fbc9d1d497e8fefb1f099efb2be25e91"
server_key_version: "encryptionkey@0"
I20260809 19:09:13.412570 10134 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 19:09:13.415771 10156 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:13.417093 10134 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 19:09:13.417282 10134 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "8a28432874cf4ec4b00485ee845290ea"
format_stamp: "Formatted at 2026-08-09 19:09:13 on dist-test-slave-4tdj"
server_key: "80d8b853cf25d63185c01b36832a9ce5"
server_key_iv: "fbc9d1d497e8fefb1f099efb2be25e91"
server_key_version: "encryptionkey@0"
I20260809 19:09:13.417510 10134 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:13.467990 10134 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:13.472332 10134 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:13.472622 10134 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:13.494074 10134 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:40951
I20260809 19:09:13.494097 10263 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:40951 every 8 connection(s)
I20260809 19:09:13.495544 10134 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:09:13.499181 10264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:13.504065 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 10134
I20260809 19:09:13.504276 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:09:13.505052 7324 external_mini_cluster.cc:1428] Setting key aaf29279e50ffc1bafea311ca900b6cf
I20260809 19:09:13.510111 10264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a28432874cf4ec4b00485ee845290ea: Bootstrap starting.
I20260809 19:09:13.513556 10264 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a28432874cf4ec4b00485ee845290ea: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:13.514786 10264 log.cc:824] T 00000000000000000000000000000000 P 8a28432874cf4ec4b00485ee845290ea: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:13.517954 10264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a28432874cf4ec4b00485ee845290ea: No bootstrap required, opened a new log
Aug 09 19:09:13 dist-test-slave-4tdj krb5kdc[10116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302552, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:13.525636 10264 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8a28432874cf4ec4b00485ee845290ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a28432874cf4ec4b00485ee845290ea" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 40951 } }
I20260809 19:09:13.525962 10264 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8a28432874cf4ec4b00485ee845290ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:13.526068 10264 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8a28432874cf4ec4b00485ee845290ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a28432874cf4ec4b00485ee845290ea, State: Initialized, Role: FOLLOWER
I20260809 19:09:13.526662 10264 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a28432874cf4ec4b00485ee845290ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a28432874cf4ec4b00485ee845290ea" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 40951 } }
I20260809 19:09:13.526928 10264 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8a28432874cf4ec4b00485ee845290ea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:09:13.527067 10264 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8a28432874cf4ec4b00485ee845290ea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:09:13.527235 10264 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8a28432874cf4ec4b00485ee845290ea [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:13.527535 10270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:13.507121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50094 (local address 127.7.39.62:40951)
0809 19:09:13.507958 (+ 837us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:13.507971 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:13.508016 (+ 45us) server_negotiation.cc:407] Connection header received
0809 19:09:13.509651 (+ 1635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:13.509673 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:13.510026 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:13.510390 (+ 364us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:13.512045 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:13.513266 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:13.514974 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:13.515956 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:13.516108 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:13.520511 (+ 4403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:13.520521 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:13.520537 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:13.520577 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:13.523667 (+ 3090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:13.524324 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:13.524331 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:13.524337 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:13.524505 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:13.524860 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:13.524865 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:13.524869 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:13.525377 (+ 508us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:13.525653 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:13.526092 (+ 439us) server_negotiation.cc:299] Negotiation successful
0809 19:09:13.526522 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":636,"thread_start_us":379,"threads_started":1}
I20260809 19:09:13.529801 10264 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8a28432874cf4ec4b00485ee845290ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a28432874cf4ec4b00485ee845290ea" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 40951 } }
I20260809 19:09:13.530365 10264 leader_election.cc:302] T 00000000000000000000000000000000 P 8a28432874cf4ec4b00485ee845290ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a28432874cf4ec4b00485ee845290ea; no voters:
I20260809 19:09:13.530867 10264 leader_election.cc:288] T 00000000000000000000000000000000 P 8a28432874cf4ec4b00485ee845290ea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:09:13.530992 10274 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8a28432874cf4ec4b00485ee845290ea [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:09:13.531682 10274 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8a28432874cf4ec4b00485ee845290ea [term 1 LEADER]: Becoming Leader. State: Replica: 8a28432874cf4ec4b00485ee845290ea, State: Running, Role: LEADER
I20260809 19:09:13.532181 10274 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a28432874cf4ec4b00485ee845290ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a28432874cf4ec4b00485ee845290ea" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 40951 } }
I20260809 19:09:13.532727 10264 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8a28432874cf4ec4b00485ee845290ea [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:09:13.534965 10278 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a28432874cf4ec4b00485ee845290ea [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a28432874cf4ec4b00485ee845290ea. Latest consensus state: current_term: 1 leader_uuid: "8a28432874cf4ec4b00485ee845290ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a28432874cf4ec4b00485ee845290ea" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 40951 } } }
I20260809 19:09:13.535250 10278 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a28432874cf4ec4b00485ee845290ea [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:13.536459 10276 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a28432874cf4ec4b00485ee845290ea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8a28432874cf4ec4b00485ee845290ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a28432874cf4ec4b00485ee845290ea" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 40951 } } }
I20260809 19:09:13.536741 10276 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a28432874cf4ec4b00485ee845290ea [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:13.536821 10283 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:09:13.541478 10283 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:09:13.548846 10283 catalog_manager.cc:1347] Generated new cluster ID: f6003f2754524291ba4df387f9c8f9b2
I20260809 19:09:13.548956 10283 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:09:13.563683 10283 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:09:13.565356 10283 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:09:13.578014 10283 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8a28432874cf4ec4b00485ee845290ea: Generated new TSK 0
I20260809 19:09:13.578945 10283 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.39.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
I20260809 19:09:13.621481 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.1:0
--local_ip_for_outbound_sockets=127.7.39.1
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:40951
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:45485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:13.935199 10311 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:13.935508 10311 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:13.935674 10311 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:13.942917 10311 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:13.943024 10311 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:13.943161 10311 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 19:09:13.943231 10311 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 19:09:13.943342 10311 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.1
I20260809 19:09:13.953096 10311 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:45485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.39.1
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.39.62:40951
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.1
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:13.954269 10311 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:13.955595 10311 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:13.967455 10320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:13.967497 10321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:13.967528 10324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:13.968376 10311 server_base.cc:1034] running on GCE node
I20260809 19:09:13.968914 10311 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:13.969741 10311 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:13.970933 10311 hybrid_clock.cc:648] HybridClock initialized: now 1786302553970892 us; error 28 us; skew 500 ppm
I20260809 19:09:13.971220 10311 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:13 dist-test-slave-4tdj krb5kdc[10116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302553, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:13.974244 10311 init.cc:377] Logged in from keytab as kudu/127.7.39.1@KRBTEST.COM (short username kudu)
I20260809 19:09:13.975586 10311 webserver.cc:460] Webserver started at http://127.7.39.1:44021/ using document root <none> and password file <none>
I20260809 19:09:13.976326 10311 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:13.976449 10311 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:13.976735 10311 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:13.979524 10311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-0/data/instance:
uuid: "64d003a1eeab4fdbba09e2463a7119b9"
format_stamp: "Formatted at 2026-08-09 19:09:13 on dist-test-slave-4tdj"
server_key: "79e555f88fd64a1829732cfbd2170366"
server_key_iv: "cf5d0e902187d3f7ebf99c046cb1845a"
server_key_version: "encryptionkey@0"
I20260809 19:09:13.980243 10311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance:
uuid: "64d003a1eeab4fdbba09e2463a7119b9"
format_stamp: "Formatted at 2026-08-09 19:09:13 on dist-test-slave-4tdj"
server_key: "79e555f88fd64a1829732cfbd2170366"
server_key_iv: "cf5d0e902187d3f7ebf99c046cb1845a"
server_key_version: "encryptionkey@0"
I20260809 19:09:13.984925 10311 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 19:09:13.988137 10337 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:13.989292 10311 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 19:09:13.989430 10311 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-0/wal
uuid: "64d003a1eeab4fdbba09e2463a7119b9"
format_stamp: "Formatted at 2026-08-09 19:09:13 on dist-test-slave-4tdj"
server_key: "79e555f88fd64a1829732cfbd2170366"
server_key_iv: "cf5d0e902187d3f7ebf99c046cb1845a"
server_key_version: "encryptionkey@0"
I20260809 19:09:13.989595 10311 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:14.031078 10311 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:14.035117 10311 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:14.035394 10311 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:14.038106 10311 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:14.038213 10311 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:14.038349 10311 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:14.038439 10311 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 19:09:14 dist-test-slave-4tdj krb5kdc[10116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302553, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:14.060098 10348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:14.038673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:47081 (local address 127.7.39.62:40951)
0809 19:09:14.039369 (+ 696us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:14.039376 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:14.040330 (+ 954us) server_negotiation.cc:407] Connection header received
0809 19:09:14.042587 (+ 2257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:14.042592 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:14.042659 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:14.042732 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:14.044908 (+ 2176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:14.045801 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:14.048625 (+ 2824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:14.049040 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:14.049137 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:14.053791 (+ 4654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:14.053798 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:14.053803 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:14.053845 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:14.056908 (+ 3063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:14.057561 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:14.057567 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:14.057570 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:14.057697 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:14.058102 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:14.058107 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:14.058111 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:14.058421 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:14.058552 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:14.059438 (+ 886us) server_negotiation.cc:299] Negotiation successful
0809 19:09:14.059678 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":583,"thread_start_us":477,"threads_started":1}
I20260809 19:09:14.060742 10351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:14.039285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:40951 (local address 127.7.39.1:47081)
0809 19:09:14.040163 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:14.040212 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:14.042227 (+ 2015us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:14.043231 (+ 1004us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:14.043238 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:14.043933 (+ 695us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:14.044743 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:14.044762 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:14.045997 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:14.046007 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:14.048465 (+ 2458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:14.048483 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:14.049276 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:14.049284 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:14.049563 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:14.050206 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:14.050235 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:14.053556 (+ 3321us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:14.057030 (+ 3474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:14.057038 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:14.057056 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:14.057441 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:14.057796 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:14.057801 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:14.057805 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:14.057992 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:14.058555 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:14.058566 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:14.059007 (+ 441us) client_negotiation.cc:769] Sending connection context
0809 19:09:14.059311 (+ 304us) client_negotiation.cc:240] Negotiation successful
0809 19:09:14.059702 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"thread_start_us":368,"threads_started":1}
I20260809 19:09:14.079768 10454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:14.066019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:40951 (local address 127.7.39.1:52121)
0809 19:09:14.066757 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:14.066800 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:14.066935 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:14.067206 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:14.067211 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:14.067799 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:14.068173 (+ 374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:14.068185 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:14.069043 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:14.069049 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:14.070778 (+ 1729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:14.070793 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:14.071637 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:14.071647 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:14.071872 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:14.072500 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:14.072516 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:14.073530 (+ 1014us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:14.076929 (+ 3399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:14.076933 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:14.076937 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:14.077427 (+ 490us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:14.077885 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:14.077893 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:14.077897 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:14.078054 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:14.078725 (+ 671us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:14.078730 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:14.078958 (+ 228us) client_negotiation.cc:769] Sending connection context
0809 19:09:14.079144 (+ 186us) client_negotiation.cc:240] Negotiation successful
0809 19:09:14.079409 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"thread_start_us":394,"threads_started":1}
I20260809 19:09:14.080534 10348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:14.066021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:52121 (local address 127.7.39.62:40951)
0809 19:09:14.066192 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:14.066198 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:14.066885 (+ 687us) server_negotiation.cc:407] Connection header received
0809 19:09:14.067033 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:14.067037 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:14.067091 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:14.067161 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:14.068290 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:14.068938 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:14.070987 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:14.071446 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:14.071572 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:14.073690 (+ 2118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:14.073695 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:14.073698 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:14.073728 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:14.076812 (+ 3084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:14.077550 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:14.077555 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:14.077558 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:14.077767 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:14.078220 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:14.078228 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:14.078230 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:14.078606 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:14.078748 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:14.080053 (+ 1305us) server_negotiation.cc:299] Negotiation successful
0809 19:09:14.080227 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 19:09:14.089193 10311 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.1:38023
I20260809 19:09:14.089231 10524 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.1:38023 every 8 connection(s)
I20260809 19:09:14.090358 10311 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
I20260809 19:09:14.092118 10525 heartbeater.cc:347] Connected to a master server at 127.7.39.62:40951
I20260809 19:09:14.092329 10525 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:14.092938 10525 heartbeater.cc:511] Master 127.7.39.62:40951 requested a full tablet report, sending...
I20260809 19:09:14.094789 10180 ts_manager.cc:194] Registered new tserver with Master: 64d003a1eeab4fdbba09e2463a7119b9 (127.7.39.1:38023)
I20260809 19:09:14.096184 10180 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.1@KRBTEST.COM'} at 127.7.39.1:47081
I20260809 19:09:14.097645 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 10311
I20260809 19:09:14.097836 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance
I20260809 19:09:14.098651 7324 external_mini_cluster.cc:1428] Setting key 53cf7fd2a5fc6032035906d1f83d294c
WARNING: no policy specified for kudu/127.7.39.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
I20260809 19:09:14.137253 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.2:0
--local_ip_for_outbound_sockets=127.7.39.2
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:40951
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:45485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:14.446702 10533 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:14.446951 10533 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:14.447049 10533 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:14.453877 10533 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:14.453972 10533 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:14.454067 10533 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 19:09:14.454119 10533 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 19:09:14.454185 10533 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.2
I20260809 19:09:14.463428 10533 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:45485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.39.2
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.39.62:40951
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.2
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:14.464550 10533 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:14.465776 10533 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:14.477663 10545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:14.477733 10550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:14.477702 10547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:14.478677 10533 server_base.cc:1034] running on GCE node
I20260809 19:09:14.479228 10533 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:14.480051 10533 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:14.481247 10533 hybrid_clock.cc:648] HybridClock initialized: now 1786302554481205 us; error 31 us; skew 500 ppm
I20260809 19:09:14.481526 10533 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:14 dist-test-slave-4tdj krb5kdc[10116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302554, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:14.484406 10533 init.cc:377] Logged in from keytab as kudu/127.7.39.2@KRBTEST.COM (short username kudu)
I20260809 19:09:14.485769 10533 webserver.cc:460] Webserver started at http://127.7.39.2:43829/ using document root <none> and password file <none>
I20260809 19:09:14.486410 10533 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:14.486531 10533 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:14.486826 10533 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:14.489626 10533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-1/data/instance:
uuid: "681671877b2445079dfb22bf4e0a0d80"
format_stamp: "Formatted at 2026-08-09 19:09:14 on dist-test-slave-4tdj"
server_key: "57d4946a2ed1b3e6273c5e5ddfcd0d4c"
server_key_iv: "7701a58e8270d91ea8e5f2a05f0f4b14"
server_key_version: "encryptionkey@0"
I20260809 19:09:14.490389 10533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance:
uuid: "681671877b2445079dfb22bf4e0a0d80"
format_stamp: "Formatted at 2026-08-09 19:09:14 on dist-test-slave-4tdj"
server_key: "57d4946a2ed1b3e6273c5e5ddfcd0d4c"
server_key_iv: "7701a58e8270d91ea8e5f2a05f0f4b14"
server_key_version: "encryptionkey@0"
I20260809 19:09:14.495256 10533 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260809 19:09:14.498513 10561 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:14.499810 10533 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 19:09:14.499956 10533 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-1/wal
uuid: "681671877b2445079dfb22bf4e0a0d80"
format_stamp: "Formatted at 2026-08-09 19:09:14 on dist-test-slave-4tdj"
server_key: "57d4946a2ed1b3e6273c5e5ddfcd0d4c"
server_key_iv: "7701a58e8270d91ea8e5f2a05f0f4b14"
server_key_version: "encryptionkey@0"
I20260809 19:09:14.500123 10533 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:14.540835 10533 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:14.544763 10533 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:14.545020 10533 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:14.547582 10533 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:14.547683 10533 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:14.547811 10533 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:14.547906 10533 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 19:09:14 dist-test-slave-4tdj krb5kdc[10116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302554, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:14.568833 10348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:14.547965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:57903 (local address 127.7.39.62:40951)
0809 19:09:14.548169 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:14.548178 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:14.549558 (+ 1380us) server_negotiation.cc:407] Connection header received
0809 19:09:14.551525 (+ 1967us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:14.551532 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:14.551622 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:14.551729 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:14.553741 (+ 2012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:14.554804 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:14.557104 (+ 2300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:14.557747 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:14.557891 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:14.562095 (+ 4204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:14.562103 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:14.562108 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:14.562151 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:14.565498 (+ 3347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:14.566124 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:14.566129 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:14.566134 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:14.566286 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:14.566807 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:14.566813 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:14.566817 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:14.567142 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:14.567285 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:14.568233 (+ 948us) server_negotiation.cc:299] Negotiation successful
0809 19:09:14.568473 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 19:09:14.570436 10577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:14.548524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:40951 (local address 127.7.39.2:57903)
0809 19:09:14.549368 (+ 844us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:14.549415 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:14.551265 (+ 1850us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:14.551985 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:14.551993 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:14.552664 (+ 671us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:14.553481 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:14.553530 (+ 49us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:14.554951 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:14.554955 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:14.556943 (+ 1988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:14.556959 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:14.557953 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:14.557958 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:14.558129 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:14.558805 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:14.558837 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:14.561866 (+ 3029us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:14.565628 (+ 3762us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:14.565634 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:14.565645 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:14.566030 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:14.566427 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:14.566435 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:14.566439 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:14.566692 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:14.567308 (+ 616us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:14.567322 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:14.567792 (+ 470us) client_negotiation.cc:769] Sending connection context
0809 19:09:14.568139 (+ 347us) client_negotiation.cc:240] Negotiation successful
0809 19:09:14.568700 (+ 561us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":567,"thread_start_us":356,"threads_started":1}
I20260809 19:09:14.590118 10686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:14.576185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:40951 (local address 127.7.39.2:34105)
0809 19:09:14.576965 (+ 780us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:14.576980 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:14.577083 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:14.577440 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:14.577445 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:14.577952 (+ 507us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:14.578386 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:14.578404 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:14.579761 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:14.579766 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:14.581416 (+ 1650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:14.581427 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:14.582120 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:14.582126 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:14.582253 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:14.582861 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:14.582884 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:14.583933 (+ 1049us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:14.587563 (+ 3630us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:14.587568 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:14.587573 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:14.588017 (+ 444us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:14.588470 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:14.588474 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:14.588481 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:14.588651 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:14.589346 (+ 695us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:14.589349 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:14.589490 (+ 141us) client_negotiation.cc:769] Sending connection context
0809 19:09:14.589600 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 19:09:14.589805 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":665,"thread_start_us":434,"threads_started":1}
I20260809 19:09:14.590310 10348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:14.576125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:34105 (local address 127.7.39.62:40951)
0809 19:09:14.576286 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:14.576292 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:14.577064 (+ 772us) server_negotiation.cc:407] Connection header received
0809 19:09:14.577163 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:14.577169 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:14.577244 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:14.577334 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:14.578525 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:14.579591 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:14.581548 (+ 1957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:14.581939 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:14.582045 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:14.584197 (+ 2152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:14.584204 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:14.584209 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:14.584248 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:14.587446 (+ 3198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:14.588205 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:14.588210 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:14.588213 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:14.588361 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:14.588776 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:14.588781 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:14.588784 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:14.589233 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:14.589387 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:14.589704 (+ 317us) server_negotiation.cc:299] Negotiation successful
0809 19:09:14.589939 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 19:09:14.597646 10533 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.2:46179
I20260809 19:09:14.597681 10767 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.2:46179 every 8 connection(s)
I20260809 19:09:14.598811 10533 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
I20260809 19:09:14.600486 10768 heartbeater.cc:347] Connected to a master server at 127.7.39.62:40951
I20260809 19:09:14.600682 10768 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:14.601217 10768 heartbeater.cc:511] Master 127.7.39.62:40951 requested a full tablet report, sending...
I20260809 19:09:14.602427 10180 ts_manager.cc:194] Registered new tserver with Master: 681671877b2445079dfb22bf4e0a0d80 (127.7.39.2:46179)
I20260809 19:09:14.603130 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 10533
I20260809 19:09:14.603178 10180 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.2@KRBTEST.COM'} at 127.7.39.2:57903
I20260809 19:09:14.603305 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance
I20260809 19:09:14.603856 7324 external_mini_cluster.cc:1428] Setting key 7dfebe4004fb99cc0d167477f5e72766
WARNING: no policy specified for kudu/127.7.39.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
I20260809 19:09:14.641147 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.3:0
--local_ip_for_outbound_sockets=127.7.39.3
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:40951
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:45485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:14.983575 10772 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:14.983814 10772 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:14.983948 10772 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:14.990770 10772 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:14.990857 10772 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:14.990967 10772 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 19:09:14.991029 10772 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 19:09:14.991124 10772 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.3
I20260809 19:09:15.000350 10772 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:45485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.39.3
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.39.62:40951
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.3
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:15.001447 10772 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:15.002717 10772 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:15.014807 10787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:15.014875 10782 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:15.014853 10789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:15.015857 10772 server_base.cc:1034] running on GCE node
I20260809 19:09:15.016359 10772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:15.017154 10772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:15.018363 10772 hybrid_clock.cc:648] HybridClock initialized: now 1786302555018324 us; error 26 us; skew 500 ppm
I20260809 19:09:15.018659 10772 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:15 dist-test-slave-4tdj krb5kdc[10116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302555, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:15.022220 10772 init.cc:377] Logged in from keytab as kudu/127.7.39.3@KRBTEST.COM (short username kudu)
I20260809 19:09:15.024513 10772 webserver.cc:460] Webserver started at http://127.7.39.3:38885/ using document root <none> and password file <none>
I20260809 19:09:15.025326 10772 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:15.025462 10772 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:15.025838 10772 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:15.028702 10772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-2/data/instance:
uuid: "7e844fa8c4c2497bbad97852d6dfbbda"
format_stamp: "Formatted at 2026-08-09 19:09:15 on dist-test-slave-4tdj"
server_key: "c5358860a352f363aadcd877fb1406fe"
server_key_iv: "4dbdc400340204a640132382f8176b19"
server_key_version: "encryptionkey@0"
I20260809 19:09:15.029403 10772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance:
uuid: "7e844fa8c4c2497bbad97852d6dfbbda"
format_stamp: "Formatted at 2026-08-09 19:09:15 on dist-test-slave-4tdj"
server_key: "c5358860a352f363aadcd877fb1406fe"
server_key_iv: "4dbdc400340204a640132382f8176b19"
server_key_version: "encryptionkey@0"
I20260809 19:09:15.034313 10772 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 19:09:15.037463 10800 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:15.038751 10772 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:09:15.039023 10772 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-2/wal
uuid: "7e844fa8c4c2497bbad97852d6dfbbda"
format_stamp: "Formatted at 2026-08-09 19:09:15 on dist-test-slave-4tdj"
server_key: "c5358860a352f363aadcd877fb1406fe"
server_key_iv: "4dbdc400340204a640132382f8176b19"
server_key_version: "encryptionkey@0"
I20260809 19:09:15.039285 10772 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:15.055600 10772 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:15.059058 10772 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:15.059309 10772 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:15.061832 10772 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:15.061954 10772 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:15.062084 10772 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:15.062166 10772 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 19:09:15 dist-test-slave-4tdj krb5kdc[10116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302555, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:15.082814 10348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:15.062266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:37297 (local address 127.7.39.62:40951)
0809 19:09:15.062470 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:15.062476 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:15.063872 (+ 1396us) server_negotiation.cc:407] Connection header received
0809 19:09:15.065925 (+ 2053us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:15.065931 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:15.066012 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:15.066103 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:15.068173 (+ 2070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.069294 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.071729 (+ 2435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.072373 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.072495 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:15.076716 (+ 4221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:15.076720 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:15.076724 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:15.076755 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:15.079393 (+ 2638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:15.080321 (+ 928us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:15.080327 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:15.080330 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:15.080486 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:15.081012 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:15.081018 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:15.081022 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:15.081417 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:15.081575 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:15.082146 (+ 571us) server_negotiation.cc:299] Negotiation successful
0809 19:09:15.082415 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260809 19:09:15.083401 10815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:15.062895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:40951 (local address 127.7.39.3:37297)
0809 19:09:15.063733 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:15.063768 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:15.065631 (+ 1863us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:15.066403 (+ 772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:15.066417 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:15.067112 (+ 695us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:15.067937 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:15.067957 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.069472 (+ 1515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.069481 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:15.071532 (+ 2051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:15.071547 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.072776 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.072785 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:15.073075 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:15.073702 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:15.073729 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:15.076497 (+ 2768us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:15.079581 (+ 3084us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:15.079589 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:15.079606 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:15.080149 (+ 543us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:15.080596 (+ 447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:15.080601 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:15.080604 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:15.080854 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:15.081535 (+ 681us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:15.081542 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:15.081810 (+ 268us) client_negotiation.cc:769] Sending connection context
0809 19:09:15.082010 (+ 200us) client_negotiation.cc:240] Negotiation successful
0809 19:09:15.082384 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":346,"threads_started":1}
I20260809 19:09:15.099164 10525 heartbeater.cc:503] Master 127.7.39.62:40951 was elected leader, sending a full tablet report...
I20260809 19:09:15.103592 10348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:15.088335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:55521 (local address 127.7.39.62:40951)
0809 19:09:15.088585 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:15.088591 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:15.089242 (+ 651us) server_negotiation.cc:407] Connection header received
0809 19:09:15.089483 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:15.089489 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:15.089572 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:15.089639 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:15.090953 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.092019 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.094198 (+ 2179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.094857 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.094952 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:15.097158 (+ 2206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:15.097162 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:15.097166 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:15.097194 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:15.100255 (+ 3061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:15.101291 (+ 1036us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:15.101298 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:15.101302 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:15.101482 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:15.101928 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:15.101933 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:15.101937 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:15.102283 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:15.102490 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:15.102946 (+ 456us) server_negotiation.cc:299] Negotiation successful
0809 19:09:15.103176 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135}
I20260809 19:09:15.103801 10893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:15.088406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:40951 (local address 127.7.39.3:55521)
0809 19:09:15.089142 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:15.089169 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:15.089337 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:15.089848 (+ 511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:15.089856 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:15.090524 (+ 668us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:15.090818 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:15.090827 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.092205 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.092211 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:15.094026 (+ 1815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:15.094042 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.095241 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.095248 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:15.095455 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:15.095985 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:15.096007 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:15.096987 (+ 980us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:15.100450 (+ 3463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:15.100471 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:15.100475 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:15.101087 (+ 612us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:15.101615 (+ 528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:15.101620 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:15.101623 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:15.101801 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:15.102427 (+ 626us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:15.102430 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:15.102623 (+ 193us) client_negotiation.cc:769] Sending connection context
0809 19:09:15.102802 (+ 179us) client_negotiation.cc:240] Negotiation successful
0809 19:09:15.103153 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":603,"thread_start_us":457,"threads_started":1}
I20260809 19:09:15.115830 10772 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.3:36445
I20260809 19:09:15.115863 10997 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.3:36445 every 8 connection(s)
I20260809 19:09:15.116947 10772 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
I20260809 19:09:15.118804 10998 heartbeater.cc:347] Connected to a master server at 127.7.39.62:40951
I20260809 19:09:15.119014 10998 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:15.119593 10998 heartbeater.cc:511] Master 127.7.39.62:40951 requested a full tablet report, sending...
I20260809 19:09:15.120731 10180 ts_manager.cc:194] Registered new tserver with Master: 7e844fa8c4c2497bbad97852d6dfbbda (127.7.39.3:36445)
I20260809 19:09:15.121570 10180 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.3@KRBTEST.COM'} at 127.7.39.3:37297
I20260809 19:09:15.125519 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 10772
I20260809 19:09:15.125654 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance
I20260809 19:09:15.126039 7324 external_mini_cluster.cc:1428] Setting key ef1fa24a8978d94980f6f25dd13e2cd4
I20260809 19:09:15.128671 7324 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 19:09:15 dist-test-slave-4tdj krb5kdc[10116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302555, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 19:09:15 dist-test-slave-4tdj krb5kdc[10116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302555, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:15.173731 10348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:15.160905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50106 (local address 127.7.39.62:40951)
0809 19:09:15.161094 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:15.161099 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:15.161379 (+ 280us) server_negotiation.cc:407] Connection header received
0809 19:09:15.161540 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:15.161544 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:15.161614 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:15.161704 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:15.163134 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.163893 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.165141 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.165563 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.165664 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:15.169132 (+ 3468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:15.169137 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:15.169141 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:15.169173 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:15.171546 (+ 2373us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:15.172154 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:15.172158 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:15.172160 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:15.172283 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:15.172603 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:15.172607 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:15.172609 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:15.172860 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:15.173063 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:15.173302 (+ 239us) server_negotiation.cc:299] Negotiation successful
0809 19:09:15.173461 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 19:09:15.177780 10180 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50106:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:09:15.184907 10180 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:09:15.223560 11024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:15.197550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33104 (local address 127.7.39.2:46179)
0809 19:09:15.216303 (+ 18753us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:15.216312 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:15.216341 (+ 29us) server_negotiation.cc:407] Connection header received
0809 19:09:15.216439 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:15.216445 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:15.216707 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:15.216909 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:15.217624 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.219059 (+ 1435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.221113 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.222537 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.222655 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:15.222857 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:15.223115 (+ 258us) server_negotiation.cc:299] Negotiation successful
0809 19:09:15.223274 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18604,"thread_start_us":18482,"threads_started":1}
I20260809 19:09:15.223762 11020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:15.197079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:46179 (local address 127.0.0.1:33104)
0809 19:09:15.214364 (+ 17285us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:15.214387 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:15.214527 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:15.216909 (+ 2382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:15.216914 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:15.216941 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:15.217350 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:15.217370 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.219194 (+ 1824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.219199 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:15.220959 (+ 1760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:15.220990 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.222708 (+ 1718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.222714 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:15.222896 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:15.222945 (+ 49us) client_negotiation.cc:769] Sending connection context
0809 19:09:15.223059 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 19:09:15.223244 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17103,"mutex_wait_us":6,"thread_start_us":16913,"threads_started":1}
I20260809 19:09:15.224814 11023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:15.197482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:38023 (local address 127.0.0.1:37178)
0809 19:09:15.215074 (+ 17592us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:15.215093 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:15.215307 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:15.216391 (+ 1084us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:15.216401 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:15.216435 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:15.216806 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:15.216817 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.218788 (+ 1971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.218794 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:15.221273 (+ 2479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:15.221314 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.223547 (+ 2233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.223555 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:15.224102 (+ 547us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:15.224173 (+ 71us) client_negotiation.cc:769] Sending connection context
0809 19:09:15.224286 (+ 113us) client_negotiation.cc:240] Negotiation successful
0809 19:09:15.224408 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17446,"mutex_wait_us":32,"thread_start_us":17295,"threads_started":1}
I20260809 19:09:15.224989 11019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:15.196920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:36445 (local address 127.0.0.1:48692)
0809 19:09:15.212084 (+ 15164us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:15.212136 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:15.212362 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:15.217266 (+ 4904us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:15.217270 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:15.217305 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:15.217715 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:15.217725 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.219540 (+ 1815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.219546 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:15.221911 (+ 2365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:15.221926 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.224096 (+ 2170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.224106 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:15.224317 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:15.224350 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 19:09:15.224433 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 19:09:15.224595 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14829,"mutex_wait_us":22,"thread_start_us":15672,"threads_started":1}
I20260809 19:09:15.225667 11022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:15.197293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48692 (local address 127.7.39.3:36445)
0809 19:09:15.216738 (+ 19445us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:15.216745 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:15.216776 (+ 31us) server_negotiation.cc:407] Connection header received
0809 19:09:15.216869 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:15.216877 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:15.217084 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:15.217265 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:15.217888 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.219378 (+ 1490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.222115 (+ 2737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.223591 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.223723 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:15.223946 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:15.225259 (+ 1313us) server_negotiation.cc:299] Negotiation successful
0809 19:09:15.225387 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19276,"thread_start_us":19093,"threads_started":1}
I20260809 19:09:15.224820 11025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:15.198055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37178 (local address 127.7.39.1:38023)
0809 19:09:15.213777 (+ 15722us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:15.213789 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:15.215196 (+ 1407us) server_negotiation.cc:407] Connection header received
0809 19:09:15.215514 (+ 318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:15.215525 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:15.215818 (+ 293us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:15.216032 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:15.217033 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.218606 (+ 1573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.221503 (+ 2897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.223031 (+ 1528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.223167 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:15.223376 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:15.224332 (+ 956us) server_negotiation.cc:299] Negotiation successful
0809 19:09:15.224491 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15522,"thread_start_us":15338,"threads_started":1}
I20260809 19:09:15.227520 10643 tablet_service.cc:1467] Processing CreateTablet for tablet 362567b5c19b4c5a8c497bc3678dda83 (DEFAULT_TABLE table=test-table [id=df1cce23134448ad909e588849d85a9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:09:15.228981 10643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 362567b5c19b4c5a8c497bc3678dda83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:15.228927 10887 tablet_service.cc:1467] Processing CreateTablet for tablet 362567b5c19b4c5a8c497bc3678dda83 (DEFAULT_TABLE table=test-table [id=df1cce23134448ad909e588849d85a9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:09:15.230108 10887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 362567b5c19b4c5a8c497bc3678dda83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:15.230003 10421 tablet_service.cc:1467] Processing CreateTablet for tablet 362567b5c19b4c5a8c497bc3678dda83 (DEFAULT_TABLE table=test-table [id=df1cce23134448ad909e588849d85a9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:09:15.231303 10421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 362567b5c19b4c5a8c497bc3678dda83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:15.243026 11026 tablet_bootstrap.cc:492] T 362567b5c19b4c5a8c497bc3678dda83 P 7e844fa8c4c2497bbad97852d6dfbbda: Bootstrap starting.
I20260809 19:09:15.244973 11029 tablet_bootstrap.cc:492] T 362567b5c19b4c5a8c497bc3678dda83 P 64d003a1eeab4fdbba09e2463a7119b9: Bootstrap starting.
I20260809 19:09:15.246795 11026 tablet_bootstrap.cc:654] T 362567b5c19b4c5a8c497bc3678dda83 P 7e844fa8c4c2497bbad97852d6dfbbda: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:15.248123 11026 log.cc:824] T 362567b5c19b4c5a8c497bc3678dda83 P 7e844fa8c4c2497bbad97852d6dfbbda: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:15.248620 11029 tablet_bootstrap.cc:654] T 362567b5c19b4c5a8c497bc3678dda83 P 64d003a1eeab4fdbba09e2463a7119b9: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:15.249760 11027 tablet_bootstrap.cc:492] T 362567b5c19b4c5a8c497bc3678dda83 P 681671877b2445079dfb22bf4e0a0d80: Bootstrap starting.
I20260809 19:09:15.250007 11029 log.cc:824] T 362567b5c19b4c5a8c497bc3678dda83 P 64d003a1eeab4fdbba09e2463a7119b9: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:15.252761 11029 tablet_bootstrap.cc:492] T 362567b5c19b4c5a8c497bc3678dda83 P 64d003a1eeab4fdbba09e2463a7119b9: No bootstrap required, opened a new log
I20260809 19:09:15.252915 11027 tablet_bootstrap.cc:654] T 362567b5c19b4c5a8c497bc3678dda83 P 681671877b2445079dfb22bf4e0a0d80: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:15.253044 11029 ts_tablet_manager.cc:1397] T 362567b5c19b4c5a8c497bc3678dda83 P 64d003a1eeab4fdbba09e2463a7119b9: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260809 19:09:15.253093 11026 tablet_bootstrap.cc:492] T 362567b5c19b4c5a8c497bc3678dda83 P 7e844fa8c4c2497bbad97852d6dfbbda: No bootstrap required, opened a new log
I20260809 19:09:15.253343 11026 ts_tablet_manager.cc:1397] T 362567b5c19b4c5a8c497bc3678dda83 P 7e844fa8c4c2497bbad97852d6dfbbda: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260809 19:09:15.254093 11027 log.cc:824] T 362567b5c19b4c5a8c497bc3678dda83 P 681671877b2445079dfb22bf4e0a0d80: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:15.256981 11027 tablet_bootstrap.cc:492] T 362567b5c19b4c5a8c497bc3678dda83 P 681671877b2445079dfb22bf4e0a0d80: No bootstrap required, opened a new log
I20260809 19:09:15.257232 11027 ts_tablet_manager.cc:1397] T 362567b5c19b4c5a8c497bc3678dda83 P 681671877b2445079dfb22bf4e0a0d80: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260809 19:09:15.261149 11029 raft_consensus.cc:348] T 362567b5c19b4c5a8c497bc3678dda83 P 64d003a1eeab4fdbba09e2463a7119b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } }
I20260809 19:09:15.261512 11029 raft_consensus.cc:374] T 362567b5c19b4c5a8c497bc3678dda83 P 64d003a1eeab4fdbba09e2463a7119b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:15.261617 11029 raft_consensus.cc:729] T 362567b5c19b4c5a8c497bc3678dda83 P 64d003a1eeab4fdbba09e2463a7119b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64d003a1eeab4fdbba09e2463a7119b9, State: Initialized, Role: FOLLOWER
I20260809 19:09:15.262280 11029 consensus_queue.cc:260] T 362567b5c19b4c5a8c497bc3678dda83 P 64d003a1eeab4fdbba09e2463a7119b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } }
I20260809 19:09:15.263043 11026 raft_consensus.cc:348] T 362567b5c19b4c5a8c497bc3678dda83 P 7e844fa8c4c2497bbad97852d6dfbbda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } }
I20260809 19:09:15.263433 11026 raft_consensus.cc:374] T 362567b5c19b4c5a8c497bc3678dda83 P 7e844fa8c4c2497bbad97852d6dfbbda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:15.263513 11026 raft_consensus.cc:729] T 362567b5c19b4c5a8c497bc3678dda83 P 7e844fa8c4c2497bbad97852d6dfbbda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e844fa8c4c2497bbad97852d6dfbbda, State: Initialized, Role: FOLLOWER
I20260809 19:09:15.264163 11029 ts_tablet_manager.cc:1428] T 362567b5c19b4c5a8c497bc3678dda83 P 64d003a1eeab4fdbba09e2463a7119b9: Time spent starting tablet: real 0.011s user 0.011s sys 0.000s
I20260809 19:09:15.264050 11026 consensus_queue.cc:260] T 362567b5c19b4c5a8c497bc3678dda83 P 7e844fa8c4c2497bbad97852d6dfbbda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } }
I20260809 19:09:15.265377 10998 heartbeater.cc:503] Master 127.7.39.62:40951 was elected leader, sending a full tablet report...
I20260809 19:09:15.265882 11026 ts_tablet_manager.cc:1428] T 362567b5c19b4c5a8c497bc3678dda83 P 7e844fa8c4c2497bbad97852d6dfbbda: Time spent starting tablet: real 0.012s user 0.009s sys 0.004s
I20260809 19:09:15.267012 11027 raft_consensus.cc:348] T 362567b5c19b4c5a8c497bc3678dda83 P 681671877b2445079dfb22bf4e0a0d80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } }
I20260809 19:09:15.267357 11027 raft_consensus.cc:374] T 362567b5c19b4c5a8c497bc3678dda83 P 681671877b2445079dfb22bf4e0a0d80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:15.267465 11027 raft_consensus.cc:729] T 362567b5c19b4c5a8c497bc3678dda83 P 681671877b2445079dfb22bf4e0a0d80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 681671877b2445079dfb22bf4e0a0d80, State: Initialized, Role: FOLLOWER
I20260809 19:09:15.267997 11027 consensus_queue.cc:260] T 362567b5c19b4c5a8c497bc3678dda83 P 681671877b2445079dfb22bf4e0a0d80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } }
I20260809 19:09:15.268322 11036 raft_consensus.cc:482] T 362567b5c19b4c5a8c497bc3678dda83 P 7e844fa8c4c2497bbad97852d6dfbbda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:09:15.269448 11036 raft_consensus.cc:504] T 362567b5c19b4c5a8c497bc3678dda83 P 7e844fa8c4c2497bbad97852d6dfbbda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } }
I20260809 19:09:15.270802 10768 heartbeater.cc:503] Master 127.7.39.62:40951 was elected leader, sending a full tablet report...
I20260809 19:09:15.271451 11027 ts_tablet_manager.cc:1428] T 362567b5c19b4c5a8c497bc3678dda83 P 681671877b2445079dfb22bf4e0a0d80: Time spent starting tablet: real 0.014s user 0.015s sys 0.000s
I20260809 19:09:15.273262 11036 leader_election.cc:288] T 362567b5c19b4c5a8c497bc3678dda83 P 7e844fa8c4c2497bbad97852d6dfbbda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 681671877b2445079dfb22bf4e0a0d80 (127.7.39.2:46179), 64d003a1eeab4fdbba09e2463a7119b9 (127.7.39.1:38023)
I20260809 19:09:15.277696 11024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:15.272224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:43371 (local address 127.7.39.2:46179)
0809 19:09:15.272424 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:15.272430 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:15.272449 (+ 19us) server_negotiation.cc:407] Connection header received
0809 19:09:15.272507 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:15.272512 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:15.272581 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:15.272661 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:15.273229 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.274202 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.276097 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.276888 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.276993 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:15.277068 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:15.277423 (+ 355us) server_negotiation.cc:299] Negotiation successful
0809 19:09:15.277513 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 19:09:15.277880 10815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:15.271729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:46179 (local address 127.7.39.3:43371)
0809 19:09:15.271920 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:15.271942 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:15.272066 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:15.272801 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:15.272805 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:15.272825 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:15.273039 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:15.273053 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.274334 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.274340 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:15.275959 (+ 1619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:15.275972 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.277049 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.277056 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:15.277266 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:15.277306 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 19:09:15.277410 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 19:09:15.277563 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260809 19:09:15.278769 10694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "362567b5c19b4c5a8c497bc3678dda83" candidate_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "681671877b2445079dfb22bf4e0a0d80" is_pre_election: true
I20260809 19:09:15.279240 10694 raft_consensus.cc:2454] T 362567b5c19b4c5a8c497bc3678dda83 P 681671877b2445079dfb22bf4e0a0d80 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e844fa8c4c2497bbad97852d6dfbbda in term 0.
I20260809 19:09:15.279945 11025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:15.273411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:37319 (local address 127.7.39.1:38023)
0809 19:09:15.273781 (+ 370us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:15.273788 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:15.273809 (+ 21us) server_negotiation.cc:407] Connection header received
0809 19:09:15.273871 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:15.273876 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:15.273971 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:15.274070 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:15.275287 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.276177 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.278250 (+ 2073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.279087 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.279194 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:15.279262 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:15.279664 (+ 402us) server_negotiation.cc:299] Negotiation successful
0809 19:09:15.279781 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232}
I20260809 19:09:15.280012 10801 leader_election.cc:302] T 362567b5c19b4c5a8c497bc3678dda83 P 7e844fa8c4c2497bbad97852d6dfbbda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681671877b2445079dfb22bf4e0a0d80, 7e844fa8c4c2497bbad97852d6dfbbda; no voters:
I20260809 19:09:15.280232 11041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:15.272718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:38023 (local address 127.7.39.3:37319)
0809 19:09:15.273337 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:15.273354 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:15.273453 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:15.274563 (+ 1110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:15.274568 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:15.274602 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:15.275079 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:15.275094 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.276311 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.276315 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:15.278100 (+ 1785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:15.278116 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.279298 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.279306 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:15.279497 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:15.279536 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 19:09:15.279641 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 19:09:15.279768 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":303,"threads_started":1}
I20260809 19:09:15.280457 11036 raft_consensus.cc:2781] T 362567b5c19b4c5a8c497bc3678dda83 P 7e844fa8c4c2497bbad97852d6dfbbda [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:09:15.280579 11036 raft_consensus.cc:482] T 362567b5c19b4c5a8c497bc3678dda83 P 7e844fa8c4c2497bbad97852d6dfbbda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:09:15.280675 11036 raft_consensus.cc:3037] T 362567b5c19b4c5a8c497bc3678dda83 P 7e844fa8c4c2497bbad97852d6dfbbda [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:15.281164 10458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "362567b5c19b4c5a8c497bc3678dda83" candidate_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64d003a1eeab4fdbba09e2463a7119b9" is_pre_election: true
I20260809 19:09:15.281608 10458 raft_consensus.cc:2454] T 362567b5c19b4c5a8c497bc3678dda83 P 64d003a1eeab4fdbba09e2463a7119b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e844fa8c4c2497bbad97852d6dfbbda in term 0.
I20260809 19:09:15.283174 11036 raft_consensus.cc:504] T 362567b5c19b4c5a8c497bc3678dda83 P 7e844fa8c4c2497bbad97852d6dfbbda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } }
I20260809 19:09:15.283685 11036 leader_election.cc:288] T 362567b5c19b4c5a8c497bc3678dda83 P 7e844fa8c4c2497bbad97852d6dfbbda [CANDIDATE]: Term 1 election: Requested vote from peers 681671877b2445079dfb22bf4e0a0d80 (127.7.39.2:46179), 64d003a1eeab4fdbba09e2463a7119b9 (127.7.39.1:38023)
I20260809 19:09:15.284088 10694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "362567b5c19b4c5a8c497bc3678dda83" candidate_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "681671877b2445079dfb22bf4e0a0d80"
I20260809 19:09:15.284101 10458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "362567b5c19b4c5a8c497bc3678dda83" candidate_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64d003a1eeab4fdbba09e2463a7119b9"
I20260809 19:09:15.284241 10694 raft_consensus.cc:3037] T 362567b5c19b4c5a8c497bc3678dda83 P 681671877b2445079dfb22bf4e0a0d80 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:15.284251 10458 raft_consensus.cc:3037] T 362567b5c19b4c5a8c497bc3678dda83 P 64d003a1eeab4fdbba09e2463a7119b9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:15.286509 10694 raft_consensus.cc:2454] T 362567b5c19b4c5a8c497bc3678dda83 P 681671877b2445079dfb22bf4e0a0d80 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e844fa8c4c2497bbad97852d6dfbbda in term 1.
I20260809 19:09:15.286533 10458 raft_consensus.cc:2454] T 362567b5c19b4c5a8c497bc3678dda83 P 64d003a1eeab4fdbba09e2463a7119b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e844fa8c4c2497bbad97852d6dfbbda in term 1.
I20260809 19:09:15.286835 10801 leader_election.cc:302] T 362567b5c19b4c5a8c497bc3678dda83 P 7e844fa8c4c2497bbad97852d6dfbbda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681671877b2445079dfb22bf4e0a0d80, 7e844fa8c4c2497bbad97852d6dfbbda; no voters:
I20260809 19:09:15.287098 11036 raft_consensus.cc:2781] T 362567b5c19b4c5a8c497bc3678dda83 P 7e844fa8c4c2497bbad97852d6dfbbda [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:09:15.287499 11036 raft_consensus.cc:686] T 362567b5c19b4c5a8c497bc3678dda83 P 7e844fa8c4c2497bbad97852d6dfbbda [term 1 LEADER]: Becoming Leader. State: Replica: 7e844fa8c4c2497bbad97852d6dfbbda, State: Running, Role: LEADER
I20260809 19:09:15.287900 11036 consensus_queue.cc:237] T 362567b5c19b4c5a8c497bc3678dda83 P 7e844fa8c4c2497bbad97852d6dfbbda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } }
I20260809 19:09:15.291574 10178 catalog_manager.cc:5495] T 362567b5c19b4c5a8c497bc3678dda83 P 7e844fa8c4c2497bbad97852d6dfbbda reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e844fa8c4c2497bbad97852d6dfbbda (127.7.39.3). New cstate: current_term: 1 leader_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } health_report { overall_health: UNKNOWN } } }
Aug 09 19:09:15 dist-test-slave-4tdj krb5kdc[10116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302553, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
W20260809 19:09:15.342577 10526 tablet.cc:2369] T 362567b5c19b4c5a8c497bc3678dda83 P 64d003a1eeab4fdbba09e2463a7119b9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:09:15.344903 11050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:15.332407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:40951 (local address 127.0.0.1:50120)
0809 19:09:15.332995 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:15.333011 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:15.333142 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:15.333422 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:15.333426 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:15.334154 (+ 728us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:15.334443 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:15.334453 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.335376 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.335381 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:15.336319 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:15.336331 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.337007 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.337017 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:15.337167 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:15.337785 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:15.337802 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:15.339998 (+ 2196us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:15.342545 (+ 2547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:15.342555 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:15.342561 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:15.343010 (+ 449us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:15.343415 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:15.343420 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:15.343424 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:15.343588 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:15.344063 (+ 475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:15.344069 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:15.344222 (+ 153us) client_negotiation.cc:769] Sending connection context
0809 19:09:15.344352 (+ 130us) client_negotiation.cc:240] Negotiation successful
0809 19:09:15.344578 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":320,"threads_started":1}
I20260809 19:09:15.344923 10348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:15.332411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50120 (local address 127.7.39.62:40951)
0809 19:09:15.332563 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:15.332568 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:15.333087 (+ 519us) server_negotiation.cc:407] Connection header received
0809 19:09:15.333250 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:15.333253 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:15.333305 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:15.333378 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:15.334566 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.335260 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.336443 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.336844 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.336945 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:15.340152 (+ 3207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:15.340156 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:15.340160 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:15.340186 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:15.342404 (+ 2218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:15.343138 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:15.343143 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:15.343146 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:15.343299 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:15.343688 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:15.343691 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:15.343693 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:15.343953 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:15.344090 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:15.344454 (+ 364us) server_negotiation.cc:299] Negotiation successful
0809 19:09:15.344684 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":68,"server-negotiator.queue_time_us":47}
I20260809 19:09:15.349519 10178 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:50120:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 19:09:15.350512 10178 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260809 19:09:15.351075 10769 tablet.cc:2369] T 362567b5c19b4c5a8c497bc3678dda83 P 681671877b2445079dfb22bf4e0a0d80: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:09:15.356873 10421 tablet_service.cc:1467] Processing CreateTablet for tablet 54d7107abdf84c46985b6758e32f3323 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a4002bfe1a2b44cb8e8605858ffa2dec]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 19:09:15.356954 10643 tablet_service.cc:1467] Processing CreateTablet for tablet 54d7107abdf84c46985b6758e32f3323 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a4002bfe1a2b44cb8e8605858ffa2dec]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 19:09:15.357136 10887 tablet_service.cc:1467] Processing CreateTablet for tablet 54d7107abdf84c46985b6758e32f3323 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a4002bfe1a2b44cb8e8605858ffa2dec]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 19:09:15.357831 10421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54d7107abdf84c46985b6758e32f3323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:15.357843 10643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54d7107abdf84c46985b6758e32f3323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:15.357947 10887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54d7107abdf84c46985b6758e32f3323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:15.363492 11029 tablet_bootstrap.cc:492] T 54d7107abdf84c46985b6758e32f3323 P 64d003a1eeab4fdbba09e2463a7119b9: Bootstrap starting.
I20260809 19:09:15.364740 11029 tablet_bootstrap.cc:654] T 54d7107abdf84c46985b6758e32f3323 P 64d003a1eeab4fdbba09e2463a7119b9: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:15.364833 11026 tablet_bootstrap.cc:492] T 54d7107abdf84c46985b6758e32f3323 P 7e844fa8c4c2497bbad97852d6dfbbda: Bootstrap starting.
I20260809 19:09:15.365316 11027 tablet_bootstrap.cc:492] T 54d7107abdf84c46985b6758e32f3323 P 681671877b2445079dfb22bf4e0a0d80: Bootstrap starting.
I20260809 19:09:15.366434 11026 tablet_bootstrap.cc:654] T 54d7107abdf84c46985b6758e32f3323 P 7e844fa8c4c2497bbad97852d6dfbbda: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:15.366794 11027 tablet_bootstrap.cc:654] T 54d7107abdf84c46985b6758e32f3323 P 681671877b2445079dfb22bf4e0a0d80: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:15.367508 11029 tablet_bootstrap.cc:492] T 54d7107abdf84c46985b6758e32f3323 P 64d003a1eeab4fdbba09e2463a7119b9: No bootstrap required, opened a new log
I20260809 19:09:15.367666 11029 ts_tablet_manager.cc:1397] T 54d7107abdf84c46985b6758e32f3323 P 64d003a1eeab4fdbba09e2463a7119b9: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260809 19:09:15.368409 11026 tablet_bootstrap.cc:492] T 54d7107abdf84c46985b6758e32f3323 P 7e844fa8c4c2497bbad97852d6dfbbda: No bootstrap required, opened a new log
I20260809 19:09:15.368355 11029 raft_consensus.cc:348] T 54d7107abdf84c46985b6758e32f3323 P 64d003a1eeab4fdbba09e2463a7119b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
W20260809 19:09:15.368476 10999 tablet.cc:2369] T 362567b5c19b4c5a8c497bc3678dda83 P 7e844fa8c4c2497bbad97852d6dfbbda: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:09:15.368542 11029 raft_consensus.cc:374] T 54d7107abdf84c46985b6758e32f3323 P 64d003a1eeab4fdbba09e2463a7119b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:15.368582 11026 ts_tablet_manager.cc:1397] T 54d7107abdf84c46985b6758e32f3323 P 7e844fa8c4c2497bbad97852d6dfbbda: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260809 19:09:15.368623 11029 raft_consensus.cc:729] T 54d7107abdf84c46985b6758e32f3323 P 64d003a1eeab4fdbba09e2463a7119b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64d003a1eeab4fdbba09e2463a7119b9, State: Initialized, Role: FOLLOWER
I20260809 19:09:15.368850 11029 consensus_queue.cc:260] T 54d7107abdf84c46985b6758e32f3323 P 64d003a1eeab4fdbba09e2463a7119b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
I20260809 19:09:15.369300 11026 raft_consensus.cc:348] T 54d7107abdf84c46985b6758e32f3323 P 7e844fa8c4c2497bbad97852d6dfbbda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
I20260809 19:09:15.369500 11026 raft_consensus.cc:374] T 54d7107abdf84c46985b6758e32f3323 P 7e844fa8c4c2497bbad97852d6dfbbda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:15.369261 11035 tablet_replica.cc:439] T 54d7107abdf84c46985b6758e32f3323 P 64d003a1eeab4fdbba09e2463a7119b9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } } }
I20260809 19:09:15.369594 11026 raft_consensus.cc:729] T 54d7107abdf84c46985b6758e32f3323 P 7e844fa8c4c2497bbad97852d6dfbbda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e844fa8c4c2497bbad97852d6dfbbda, State: Initialized, Role: FOLLOWER
I20260809 19:09:15.369619 11035 tablet_replica.cc:442] T 54d7107abdf84c46985b6758e32f3323 P 64d003a1eeab4fdbba09e2463a7119b9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 19:09:15.369812 11026 consensus_queue.cc:260] T 54d7107abdf84c46985b6758e32f3323 P 7e844fa8c4c2497bbad97852d6dfbbda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
I20260809 19:09:15.370078 11029 ts_tablet_manager.cc:1428] T 54d7107abdf84c46985b6758e32f3323 P 64d003a1eeab4fdbba09e2463a7119b9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 19:09:15.370350 11026 ts_tablet_manager.cc:1428] T 54d7107abdf84c46985b6758e32f3323 P 7e844fa8c4c2497bbad97852d6dfbbda: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260809 19:09:15.370949 11036 tablet_replica.cc:439] T 54d7107abdf84c46985b6758e32f3323 P 7e844fa8c4c2497bbad97852d6dfbbda: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } } }
I20260809 19:09:15.371219 11036 tablet_replica.cc:442] T 54d7107abdf84c46985b6758e32f3323 P 7e844fa8c4c2497bbad97852d6dfbbda: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 19:09:15.371814 11027 tablet_bootstrap.cc:492] T 54d7107abdf84c46985b6758e32f3323 P 681671877b2445079dfb22bf4e0a0d80: No bootstrap required, opened a new log
I20260809 19:09:15.371951 11027 ts_tablet_manager.cc:1397] T 54d7107abdf84c46985b6758e32f3323 P 681671877b2445079dfb22bf4e0a0d80: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260809 19:09:15.372700 11027 raft_consensus.cc:348] T 54d7107abdf84c46985b6758e32f3323 P 681671877b2445079dfb22bf4e0a0d80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
I20260809 19:09:15.372937 11027 raft_consensus.cc:374] T 54d7107abdf84c46985b6758e32f3323 P 681671877b2445079dfb22bf4e0a0d80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:15.373035 11027 raft_consensus.cc:729] T 54d7107abdf84c46985b6758e32f3323 P 681671877b2445079dfb22bf4e0a0d80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 681671877b2445079dfb22bf4e0a0d80, State: Initialized, Role: FOLLOWER
I20260809 19:09:15.373255 11027 consensus_queue.cc:260] T 54d7107abdf84c46985b6758e32f3323 P 681671877b2445079dfb22bf4e0a0d80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
I20260809 19:09:15.373904 11027 ts_tablet_manager.cc:1428] T 54d7107abdf84c46985b6758e32f3323 P 681671877b2445079dfb22bf4e0a0d80: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260809 19:09:15.373732 11039 tablet_replica.cc:439] T 54d7107abdf84c46985b6758e32f3323 P 681671877b2445079dfb22bf4e0a0d80: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } } }
I20260809 19:09:15.374132 11039 tablet_replica.cc:442] T 54d7107abdf84c46985b6758e32f3323 P 681671877b2445079dfb22bf4e0a0d80: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 19:09:15.461829 11039 raft_consensus.cc:482] T 54d7107abdf84c46985b6758e32f3323 P 681671877b2445079dfb22bf4e0a0d80 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:09:15.462037 11039 raft_consensus.cc:504] T 54d7107abdf84c46985b6758e32f3323 P 681671877b2445079dfb22bf4e0a0d80 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
I20260809 19:09:15.463593 11039 leader_election.cc:288] T 54d7107abdf84c46985b6758e32f3323 P 681671877b2445079dfb22bf4e0a0d80 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64d003a1eeab4fdbba09e2463a7119b9 (127.7.39.1:38023), 7e844fa8c4c2497bbad97852d6dfbbda (127.7.39.3:36445)
I20260809 19:09:15.472257 11025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:15.464040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:45923 (local address 127.7.39.1:38023)
0809 19:09:15.464208 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:15.464213 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:15.464796 (+ 583us) server_negotiation.cc:407] Connection header received
0809 19:09:15.464972 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:15.464977 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:15.465077 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:15.465178 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:15.465893 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.467026 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.469864 (+ 2838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.471098 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.471230 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:15.471331 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:15.471844 (+ 513us) server_negotiation.cc:299] Negotiation successful
0809 19:09:15.471982 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 19:09:15.472250 11022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:15.463923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:55581 (local address 127.7.39.3:36445)
0809 19:09:15.464143 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:15.464148 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:15.464838 (+ 690us) server_negotiation.cc:407] Connection header received
0809 19:09:15.465010 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:15.465015 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:15.465087 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:15.465173 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:15.465892 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.467026 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.469861 (+ 2835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.471104 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.471230 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:15.471343 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:15.471844 (+ 501us) server_negotiation.cc:299] Negotiation successful
0809 19:09:15.472011 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260809 19:09:15.472440 11054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:15.463826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:38023 (local address 127.7.39.2:45923)
0809 19:09:15.464653 (+ 827us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:15.464673 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:15.464832 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:15.465204 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:15.465220 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:15.465274 (+ 54us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:15.465754 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:15.465763 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.467143 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.467148 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:15.469682 (+ 2534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:15.469699 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.471318 (+ 1619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.471327 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:15.471574 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:15.471651 (+ 77us) client_negotiation.cc:769] Sending connection context
0809 19:09:15.471791 (+ 140us) client_negotiation.cc:240] Negotiation successful
0809 19:09:15.471975 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":677,"mutex_wait_us":256,"spinlock_wait_cycles":28416,"thread_start_us":479,"threads_started":1}
I20260809 19:09:15.472726 11056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:15.463922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:36445 (local address 127.7.39.2:55581)
0809 19:09:15.464722 (+ 800us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:15.464736 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:15.464885 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:15.465204 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:15.465220 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:15.465249 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:15.465676 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:15.465695 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.467147 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.467151 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:15.469682 (+ 2531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:15.469699 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.471346 (+ 1647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.471351 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:15.471570 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:15.471648 (+ 78us) client_negotiation.cc:769] Sending connection context
0809 19:09:15.471791 (+ 143us) client_negotiation.cc:240] Negotiation successful
0809 19:09:15.472001 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":683,"mutex_wait_us":154,"spinlock_wait_cycles":25472,"thread_start_us":457,"threads_started":1}
I20260809 19:09:15.473161 10458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54d7107abdf84c46985b6758e32f3323" candidate_uuid: "681671877b2445079dfb22bf4e0a0d80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64d003a1eeab4fdbba09e2463a7119b9" is_pre_election: true
I20260809 19:09:15.473416 10458 raft_consensus.cc:2454] T 54d7107abdf84c46985b6758e32f3323 P 64d003a1eeab4fdbba09e2463a7119b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681671877b2445079dfb22bf4e0a0d80 in term 0.
I20260809 19:09:15.473610 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54d7107abdf84c46985b6758e32f3323" candidate_uuid: "681671877b2445079dfb22bf4e0a0d80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" is_pre_election: true
I20260809 19:09:15.473845 10565 leader_election.cc:302] T 54d7107abdf84c46985b6758e32f3323 P 681671877b2445079dfb22bf4e0a0d80 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64d003a1eeab4fdbba09e2463a7119b9, 681671877b2445079dfb22bf4e0a0d80; no voters:
I20260809 19:09:15.474071 10915 raft_consensus.cc:2454] T 54d7107abdf84c46985b6758e32f3323 P 7e844fa8c4c2497bbad97852d6dfbbda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681671877b2445079dfb22bf4e0a0d80 in term 0.
I20260809 19:09:15.474256 11039 raft_consensus.cc:2781] T 54d7107abdf84c46985b6758e32f3323 P 681671877b2445079dfb22bf4e0a0d80 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:09:15.474416 11039 raft_consensus.cc:482] T 54d7107abdf84c46985b6758e32f3323 P 681671877b2445079dfb22bf4e0a0d80 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:09:15.474536 11039 raft_consensus.cc:3037] T 54d7107abdf84c46985b6758e32f3323 P 681671877b2445079dfb22bf4e0a0d80 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:15.476701 11039 raft_consensus.cc:504] T 54d7107abdf84c46985b6758e32f3323 P 681671877b2445079dfb22bf4e0a0d80 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
I20260809 19:09:15.477265 11039 leader_election.cc:288] T 54d7107abdf84c46985b6758e32f3323 P 681671877b2445079dfb22bf4e0a0d80 [CANDIDATE]: Term 1 election: Requested vote from peers 64d003a1eeab4fdbba09e2463a7119b9 (127.7.39.1:38023), 7e844fa8c4c2497bbad97852d6dfbbda (127.7.39.3:36445)
I20260809 19:09:15.477699 10458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54d7107abdf84c46985b6758e32f3323" candidate_uuid: "681671877b2445079dfb22bf4e0a0d80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64d003a1eeab4fdbba09e2463a7119b9"
I20260809 19:09:15.477718 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54d7107abdf84c46985b6758e32f3323" candidate_uuid: "681671877b2445079dfb22bf4e0a0d80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e844fa8c4c2497bbad97852d6dfbbda"
I20260809 19:09:15.477891 10915 raft_consensus.cc:3037] T 54d7107abdf84c46985b6758e32f3323 P 7e844fa8c4c2497bbad97852d6dfbbda [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:15.477916 10458 raft_consensus.cc:3037] T 54d7107abdf84c46985b6758e32f3323 P 64d003a1eeab4fdbba09e2463a7119b9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:15.480037 10458 raft_consensus.cc:2454] T 54d7107abdf84c46985b6758e32f3323 P 64d003a1eeab4fdbba09e2463a7119b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681671877b2445079dfb22bf4e0a0d80 in term 1.
I20260809 19:09:15.480154 10915 raft_consensus.cc:2454] T 54d7107abdf84c46985b6758e32f3323 P 7e844fa8c4c2497bbad97852d6dfbbda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681671877b2445079dfb22bf4e0a0d80 in term 1.
I20260809 19:09:15.480414 10565 leader_election.cc:302] T 54d7107abdf84c46985b6758e32f3323 P 681671877b2445079dfb22bf4e0a0d80 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64d003a1eeab4fdbba09e2463a7119b9, 681671877b2445079dfb22bf4e0a0d80; no voters:
I20260809 19:09:15.480662 11039 raft_consensus.cc:2781] T 54d7107abdf84c46985b6758e32f3323 P 681671877b2445079dfb22bf4e0a0d80 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:09:15.481062 11039 raft_consensus.cc:686] T 54d7107abdf84c46985b6758e32f3323 P 681671877b2445079dfb22bf4e0a0d80 [term 1 LEADER]: Becoming Leader. State: Replica: 681671877b2445079dfb22bf4e0a0d80, State: Running, Role: LEADER
I20260809 19:09:15.481501 11039 consensus_queue.cc:237] T 54d7107abdf84c46985b6758e32f3323 P 681671877b2445079dfb22bf4e0a0d80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
I20260809 19:09:15.484011 11058 tablet_replica.cc:439] T 54d7107abdf84c46985b6758e32f3323 P 681671877b2445079dfb22bf4e0a0d80: TxnStatusTablet state changed. Reason: New leader 681671877b2445079dfb22bf4e0a0d80. Latest consensus state: current_term: 1 leader_uuid: "681671877b2445079dfb22bf4e0a0d80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } } }
I20260809 19:09:15.484452 11058 tablet_replica.cc:442] T 54d7107abdf84c46985b6758e32f3323 P 681671877b2445079dfb22bf4e0a0d80: This TxnStatusTablet replica's current role is: LEADER
I20260809 19:09:15.485128 11061 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 19:09:15.485378 11061 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 19:09:15.485538 10180 catalog_manager.cc:5495] T 54d7107abdf84c46985b6758e32f3323 P 681671877b2445079dfb22bf4e0a0d80 reported cstate change: term changed from 0 to 1, leader changed from <none> to 681671877b2445079dfb22bf4e0a0d80 (127.7.39.2). New cstate: current_term: 1 leader_uuid: "681671877b2445079dfb22bf4e0a0d80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } health_report { overall_health: UNKNOWN } } }
I20260809 19:09:15.521168 11024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:15.515914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33108 (local address 127.7.39.2:46179)
0809 19:09:15.516078 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:15.516084 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:15.516270 (+ 186us) server_negotiation.cc:407] Connection header received
0809 19:09:15.516507 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:15.516511 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:15.516603 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:15.516720 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:09:15.517075 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.517822 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.519113 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.519519 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.519634 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:15.520061 (+ 427us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:09:15.520525 (+ 464us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:09:15.520649 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:15.520761 (+ 112us) server_negotiation.cc:299] Negotiation successful
0809 19:09:15.520837 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 19:09:15.521193 11050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:15.515972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:46179 (local address 127.0.0.1:33108)
0809 19:09:15.516185 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:15.516200 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:15.516330 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:15.516761 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:15.516766 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:15.516779 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 19:09:15.516948 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:15.516957 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.517941 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.517947 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:15.518977 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:15.518989 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.519663 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.519670 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:15.519830 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:15.519886 (+ 56us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 19:09:15.520630 (+ 744us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 19:09:15.520650 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 19:09:15.520730 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 19:09:15.520867 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260809 19:09:15.528091 10915 raft_consensus.cc:1261] T 54d7107abdf84c46985b6758e32f3323 P 7e844fa8c4c2497bbad97852d6dfbbda [term 1 FOLLOWER]: Refusing update from remote peer 681671877b2445079dfb22bf4e0a0d80: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:09:15.528301 10458 raft_consensus.cc:1261] T 54d7107abdf84c46985b6758e32f3323 P 64d003a1eeab4fdbba09e2463a7119b9 [term 1 FOLLOWER]: Refusing update from remote peer 681671877b2445079dfb22bf4e0a0d80: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:09:15.528899 11058 consensus_queue.cc:1035] T 54d7107abdf84c46985b6758e32f3323 P 681671877b2445079dfb22bf4e0a0d80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:09:15.529191 11039 consensus_queue.cc:1035] T 54d7107abdf84c46985b6758e32f3323 P 681671877b2445079dfb22bf4e0a0d80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:09:15.539119 11035 tablet_replica.cc:439] T 54d7107abdf84c46985b6758e32f3323 P 64d003a1eeab4fdbba09e2463a7119b9: TxnStatusTablet state changed. Reason: New leader 681671877b2445079dfb22bf4e0a0d80. Latest consensus state: current_term: 1 leader_uuid: "681671877b2445079dfb22bf4e0a0d80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } } }
I20260809 19:09:15.539552 11035 tablet_replica.cc:442] T 54d7107abdf84c46985b6758e32f3323 P 64d003a1eeab4fdbba09e2463a7119b9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 19:09:15.542150 11065 mvcc.cc:205] Tried to move back new op lower bound from 7316695267434385408 to 7316695267255656448. Current Snapshot: MvccSnapshot[applied={T|T < 7316695267434385408}]
I20260809 19:09:15.542248 11036 tablet_replica.cc:439] T 54d7107abdf84c46985b6758e32f3323 P 7e844fa8c4c2497bbad97852d6dfbbda: TxnStatusTablet state changed. Reason: New leader 681671877b2445079dfb22bf4e0a0d80. Latest consensus state: current_term: 1 leader_uuid: "681671877b2445079dfb22bf4e0a0d80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } } }
I20260809 19:09:15.542585 11036 tablet_replica.cc:442] T 54d7107abdf84c46985b6758e32f3323 P 7e844fa8c4c2497bbad97852d6dfbbda: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 19:09:15.543845 11058 tablet_replica.cc:439] T 54d7107abdf84c46985b6758e32f3323 P 681671877b2445079dfb22bf4e0a0d80: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "681671877b2445079dfb22bf4e0a0d80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } } }
I20260809 19:09:15.544086 11058 tablet_replica.cc:442] T 54d7107abdf84c46985b6758e32f3323 P 681671877b2445079dfb22bf4e0a0d80: This TxnStatusTablet replica's current role is: LEADER
I20260809 19:09:15.547536 11039 tablet_replica.cc:439] T 54d7107abdf84c46985b6758e32f3323 P 681671877b2445079dfb22bf4e0a0d80: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "681671877b2445079dfb22bf4e0a0d80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } } }
I20260809 19:09:15.547796 11039 tablet_replica.cc:442] T 54d7107abdf84c46985b6758e32f3323 P 681671877b2445079dfb22bf4e0a0d80: This TxnStatusTablet replica's current role is: LEADER
I20260809 19:09:15.549108 11068 mvcc.cc:205] Tried to move back new op lower bound from 7316695267434385408 to 7316695267255656448. Current Snapshot: MvccSnapshot[applied={T|T < 7316695267434385408}]
I20260809 19:09:15.550161 11035 tablet_replica.cc:439] T 54d7107abdf84c46985b6758e32f3323 P 64d003a1eeab4fdbba09e2463a7119b9: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "681671877b2445079dfb22bf4e0a0d80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } } }
I20260809 19:09:15.550393 11035 tablet_replica.cc:442] T 54d7107abdf84c46985b6758e32f3323 P 64d003a1eeab4fdbba09e2463a7119b9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 19:09:15.557986 11022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:15.552893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48694 (local address 127.7.39.3:36445)
0809 19:09:15.553079 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:15.553085 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:15.553131 (+ 46us) server_negotiation.cc:407] Connection header received
0809 19:09:15.553223 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:15.553229 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:15.553348 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:15.553503 (+ 155us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:09:15.553861 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.554732 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.555977 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.556403 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.556508 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:15.556944 (+ 436us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:09:15.557377 (+ 433us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:09:15.557503 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:15.557603 (+ 100us) server_negotiation.cc:299] Negotiation successful
0809 19:09:15.557696 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 19:09:15.560931 11036 tablet_replica.cc:439] T 54d7107abdf84c46985b6758e32f3323 P 7e844fa8c4c2497bbad97852d6dfbbda: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "681671877b2445079dfb22bf4e0a0d80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } } }
I20260809 19:09:15.561183 11036 tablet_replica.cc:442] T 54d7107abdf84c46985b6758e32f3323 P 7e844fa8c4c2497bbad97852d6dfbbda: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 19:09:15.572839 11024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:15.568342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:50587 (local address 127.7.39.2:46179)
0809 19:09:15.568663 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:15.568669 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:15.568687 (+ 18us) server_negotiation.cc:407] Connection header received
0809 19:09:15.568785 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:15.568790 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:15.568851 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:15.568927 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:09:15.569241 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.569984 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.571248 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.571667 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.571774 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:15.572172 (+ 398us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:09:15.572285 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:09:15.572356 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:15.572481 (+ 125us) server_negotiation.cc:299] Negotiation successful
0809 19:09:15.572567 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206}
I20260809 19:09:15.572875 10893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:15.568334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:46179 (local address 127.7.39.3:50587)
0809 19:09:15.568533 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:15.568553 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:15.568656 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:15.568952 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:15.568957 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:15.568968 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 19:09:15.569120 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:15.569128 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.570121 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.570125 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:15.571112 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:15.571124 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.571804 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.571810 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:15.571924 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:15.571976 (+ 52us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 19:09:15.572373 (+ 397us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 19:09:15.572385 (+ 12us) client_negotiation.cc:769] Sending connection context
0809 19:09:15.572453 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 19:09:15.572589 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260809 19:09:15.581346 10458 raft_consensus.cc:1261] T 362567b5c19b4c5a8c497bc3678dda83 P 64d003a1eeab4fdbba09e2463a7119b9 [term 1 FOLLOWER]: Refusing update from remote peer 7e844fa8c4c2497bbad97852d6dfbbda: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:09:15.582007 10694 raft_consensus.cc:1261] T 362567b5c19b4c5a8c497bc3678dda83 P 681671877b2445079dfb22bf4e0a0d80 [term 1 FOLLOWER]: Refusing update from remote peer 7e844fa8c4c2497bbad97852d6dfbbda: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:09:15.581943 11036 consensus_queue.cc:1035] T 362567b5c19b4c5a8c497bc3678dda83 P 7e844fa8c4c2497bbad97852d6dfbbda [LEADER]: Connected to new peer: Peer: permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:09:15.582664 11036 consensus_queue.cc:1035] T 362567b5c19b4c5a8c497bc3678dda83 P 7e844fa8c4c2497bbad97852d6dfbbda [LEADER]: Connected to new peer: Peer: permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:09:15.630898 11022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:15.623414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:39277 (local address 127.7.39.3:36445)
0809 19:09:15.623571 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:15.623576 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:15.624663 (+ 1087us) server_negotiation.cc:407] Connection header received
0809 19:09:15.624829 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:15.624834 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:15.624923 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:15.625017 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:09:15.625675 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.626723 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.628822 (+ 2099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.629492 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.629629 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:15.630145 (+ 516us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:09:15.630280 (+ 135us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:09:15.630376 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:15.630566 (+ 190us) server_negotiation.cc:299] Negotiation successful
0809 19:09:15.630645 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 19:09:15.631654 11088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:15.622966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:36445 (local address 127.7.39.2:39277)
0809 19:09:15.624543 (+ 1577us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:15.624571 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:15.624711 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:15.625042 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:15.625054 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:15.625067 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 19:09:15.625483 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:15.625494 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.626881 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.626886 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:15.628679 (+ 1793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:15.628692 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:15.629687 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:15.629695 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:15.629862 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:15.629926 (+ 64us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 19:09:15.630449 (+ 523us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 19:09:15.630458 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 19:09:15.631118 (+ 660us) client_negotiation.cc:240] Negotiation successful
0809 19:09:15.631259 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1373,"thread_start_us":1242,"threads_started":1}
I20260809 19:09:15.668756 10180 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50106:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:09:15.668991 10180 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50106:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:09:15.672282 10180 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8a28432874cf4ec4b00485ee845290ea: Sending DeleteTablet for 3 replicas of tablet 362567b5c19b4c5a8c497bc3678dda83
I20260809 19:09:15.673233 10887 tablet_service.cc:1514] Processing DeleteTablet for tablet 362567b5c19b4c5a8c497bc3678dda83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:09:15 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:48692
I20260809 19:09:15.674073 11095 tablet_replica.cc:330] T 362567b5c19b4c5a8c497bc3678dda83 P 7e844fa8c4c2497bbad97852d6dfbbda: stopping tablet replica
I20260809 19:09:15.674096 10643 tablet_service.cc:1514] Processing DeleteTablet for tablet 362567b5c19b4c5a8c497bc3678dda83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:09:15 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:33104
I20260809 19:09:15.674628 11095 raft_consensus.cc:2229] T 362567b5c19b4c5a8c497bc3678dda83 P 7e844fa8c4c2497bbad97852d6dfbbda [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:09:15.675366 11095 raft_consensus.cc:2258] T 362567b5c19b4c5a8c497bc3678dda83 P 7e844fa8c4c2497bbad97852d6dfbbda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:09:15.675347 10421 tablet_service.cc:1514] Processing DeleteTablet for tablet 362567b5c19b4c5a8c497bc3678dda83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:09:15 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:37178
I20260809 19:09:15.677312 11095 ts_tablet_manager.cc:1905] T 362567b5c19b4c5a8c497bc3678dda83 P 7e844fa8c4c2497bbad97852d6dfbbda: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:09:15.679243 10180 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50106:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:09:15.679915 10180 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:09:15.680181 11099 tablet_replica.cc:330] T 362567b5c19b4c5a8c497bc3678dda83 P 64d003a1eeab4fdbba09e2463a7119b9: stopping tablet replica
I20260809 19:09:15.685868 11099 raft_consensus.cc:2229] T 362567b5c19b4c5a8c497bc3678dda83 P 64d003a1eeab4fdbba09e2463a7119b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:09:15.686364 11099 raft_consensus.cc:2258] T 362567b5c19b4c5a8c497bc3678dda83 P 64d003a1eeab4fdbba09e2463a7119b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:09:15.688057 10642 tablet_service.cc:1467] Processing CreateTablet for tablet 5fd6d96103d84e5b8a4eb36f2b60412f (DEFAULT_TABLE table=test-table [id=7a8b7f7ede724ce3be81a0aa1394a461]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:09:15.688118 10887 tablet_service.cc:1467] Processing CreateTablet for tablet 5fd6d96103d84e5b8a4eb36f2b60412f (DEFAULT_TABLE table=test-table [id=7a8b7f7ede724ce3be81a0aa1394a461]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:09:15.688532 10887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fd6d96103d84e5b8a4eb36f2b60412f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:15.688622 10642 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fd6d96103d84e5b8a4eb36f2b60412f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:15.689955 11099 ts_tablet_manager.cc:1905] T 362567b5c19b4c5a8c497bc3678dda83 P 64d003a1eeab4fdbba09e2463a7119b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:09:15.693893 10421 tablet_service.cc:1467] Processing CreateTablet for tablet 5fd6d96103d84e5b8a4eb36f2b60412f (DEFAULT_TABLE table=test-table [id=7a8b7f7ede724ce3be81a0aa1394a461]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:09:15.694334 10421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fd6d96103d84e5b8a4eb36f2b60412f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:15.694847 11027 tablet_bootstrap.cc:492] T 5fd6d96103d84e5b8a4eb36f2b60412f P 681671877b2445079dfb22bf4e0a0d80: Bootstrap starting.
I20260809 19:09:15.696503 11027 tablet_bootstrap.cc:654] T 5fd6d96103d84e5b8a4eb36f2b60412f P 681671877b2445079dfb22bf4e0a0d80: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:15.696655 11095 ts_tablet_manager.cc:1918] T 362567b5c19b4c5a8c497bc3678dda83 P 7e844fa8c4c2497bbad97852d6dfbbda: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 19:09:15.702116 11095 log.cc:1196] T 362567b5c19b4c5a8c497bc3678dda83 P 7e844fa8c4c2497bbad97852d6dfbbda: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-2/wal/wals/362567b5c19b4c5a8c497bc3678dda83
I20260809 19:09:15.702769 11095 ts_tablet_manager.cc:1939] T 362567b5c19b4c5a8c497bc3678dda83 P 7e844fa8c4c2497bbad97852d6dfbbda: Deleting consensus metadata
I20260809 19:09:15.704298 11026 tablet_bootstrap.cc:492] T 5fd6d96103d84e5b8a4eb36f2b60412f P 7e844fa8c4c2497bbad97852d6dfbbda: Bootstrap starting.
I20260809 19:09:15.705865 11026 tablet_bootstrap.cc:654] T 5fd6d96103d84e5b8a4eb36f2b60412f P 7e844fa8c4c2497bbad97852d6dfbbda: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:15.706626 10162 catalog_manager.cc:4841] TS 7e844fa8c4c2497bbad97852d6dfbbda (127.7.39.3:36445): tablet 362567b5c19b4c5a8c497bc3678dda83 (table test-table [id=df1cce23134448ad909e588849d85a9d]) successfully deleted
I20260809 19:09:15.707736 11099 ts_tablet_manager.cc:1918] T 362567b5c19b4c5a8c497bc3678dda83 P 64d003a1eeab4fdbba09e2463a7119b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 19:09:15.707968 11099 log.cc:1196] T 362567b5c19b4c5a8c497bc3678dda83 P 64d003a1eeab4fdbba09e2463a7119b9: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-0/wal/wals/362567b5c19b4c5a8c497bc3678dda83
I20260809 19:09:15.708559 11099 ts_tablet_manager.cc:1939] T 362567b5c19b4c5a8c497bc3678dda83 P 64d003a1eeab4fdbba09e2463a7119b9: Deleting consensus metadata
I20260809 19:09:15.708623 11027 tablet_bootstrap.cc:492] T 5fd6d96103d84e5b8a4eb36f2b60412f P 681671877b2445079dfb22bf4e0a0d80: No bootstrap required, opened a new log
I20260809 19:09:15.708798 11027 ts_tablet_manager.cc:1397] T 5fd6d96103d84e5b8a4eb36f2b60412f P 681671877b2445079dfb22bf4e0a0d80: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.008s
I20260809 19:09:15.709569 11027 raft_consensus.cc:348] T 5fd6d96103d84e5b8a4eb36f2b60412f P 681671877b2445079dfb22bf4e0a0d80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
I20260809 19:09:15.709821 11027 raft_consensus.cc:374] T 5fd6d96103d84e5b8a4eb36f2b60412f P 681671877b2445079dfb22bf4e0a0d80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:15.709913 11027 raft_consensus.cc:729] T 5fd6d96103d84e5b8a4eb36f2b60412f P 681671877b2445079dfb22bf4e0a0d80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 681671877b2445079dfb22bf4e0a0d80, State: Initialized, Role: FOLLOWER
I20260809 19:09:15.710183 11027 consensus_queue.cc:260] T 5fd6d96103d84e5b8a4eb36f2b60412f P 681671877b2445079dfb22bf4e0a0d80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
I20260809 19:09:15.711624 10159 catalog_manager.cc:4841] TS 64d003a1eeab4fdbba09e2463a7119b9 (127.7.39.1:38023): tablet 362567b5c19b4c5a8c497bc3678dda83 (table test-table [id=df1cce23134448ad909e588849d85a9d]) successfully deleted
I20260809 19:09:15.713570 11027 ts_tablet_manager.cc:1428] T 5fd6d96103d84e5b8a4eb36f2b60412f P 681671877b2445079dfb22bf4e0a0d80: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260809 19:09:15.717610 11029 tablet_bootstrap.cc:492] T 5fd6d96103d84e5b8a4eb36f2b60412f P 64d003a1eeab4fdbba09e2463a7119b9: Bootstrap starting.
I20260809 19:09:15.719244 11029 tablet_bootstrap.cc:654] T 5fd6d96103d84e5b8a4eb36f2b60412f P 64d003a1eeab4fdbba09e2463a7119b9: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:15.726737 11026 tablet_bootstrap.cc:492] T 5fd6d96103d84e5b8a4eb36f2b60412f P 7e844fa8c4c2497bbad97852d6dfbbda: No bootstrap required, opened a new log
I20260809 19:09:15.726919 11026 ts_tablet_manager.cc:1397] T 5fd6d96103d84e5b8a4eb36f2b60412f P 7e844fa8c4c2497bbad97852d6dfbbda: Time spent bootstrapping tablet: real 0.023s user 0.006s sys 0.004s
I20260809 19:09:15.727712 11026 raft_consensus.cc:348] T 5fd6d96103d84e5b8a4eb36f2b60412f P 7e844fa8c4c2497bbad97852d6dfbbda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
I20260809 19:09:15.727959 11026 raft_consensus.cc:374] T 5fd6d96103d84e5b8a4eb36f2b60412f P 7e844fa8c4c2497bbad97852d6dfbbda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:15.728047 11026 raft_consensus.cc:729] T 5fd6d96103d84e5b8a4eb36f2b60412f P 7e844fa8c4c2497bbad97852d6dfbbda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e844fa8c4c2497bbad97852d6dfbbda, State: Initialized, Role: FOLLOWER
I20260809 19:09:15.728334 11026 consensus_queue.cc:260] T 5fd6d96103d84e5b8a4eb36f2b60412f P 7e844fa8c4c2497bbad97852d6dfbbda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
I20260809 19:09:15.731478 11026 ts_tablet_manager.cc:1428] T 5fd6d96103d84e5b8a4eb36f2b60412f P 7e844fa8c4c2497bbad97852d6dfbbda: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260809 19:09:15.732092 11096 tablet_replica.cc:330] T 362567b5c19b4c5a8c497bc3678dda83 P 681671877b2445079dfb22bf4e0a0d80: stopping tablet replica
I20260809 19:09:15.732581 11096 raft_consensus.cc:2229] T 362567b5c19b4c5a8c497bc3678dda83 P 681671877b2445079dfb22bf4e0a0d80 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:09:15.732833 11029 tablet_bootstrap.cc:492] T 5fd6d96103d84e5b8a4eb36f2b60412f P 64d003a1eeab4fdbba09e2463a7119b9: No bootstrap required, opened a new log
I20260809 19:09:15.733685 11029 ts_tablet_manager.cc:1397] T 5fd6d96103d84e5b8a4eb36f2b60412f P 64d003a1eeab4fdbba09e2463a7119b9: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.009s
I20260809 19:09:15.734362 11029 raft_consensus.cc:348] T 5fd6d96103d84e5b8a4eb36f2b60412f P 64d003a1eeab4fdbba09e2463a7119b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
I20260809 19:09:15.734604 11029 raft_consensus.cc:374] T 5fd6d96103d84e5b8a4eb36f2b60412f P 64d003a1eeab4fdbba09e2463a7119b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:15.734691 11029 raft_consensus.cc:729] T 5fd6d96103d84e5b8a4eb36f2b60412f P 64d003a1eeab4fdbba09e2463a7119b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64d003a1eeab4fdbba09e2463a7119b9, State: Initialized, Role: FOLLOWER
I20260809 19:09:15.734956 11029 consensus_queue.cc:260] T 5fd6d96103d84e5b8a4eb36f2b60412f P 64d003a1eeab4fdbba09e2463a7119b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
I20260809 19:09:15.735342 11096 raft_consensus.cc:2258] T 362567b5c19b4c5a8c497bc3678dda83 P 681671877b2445079dfb22bf4e0a0d80 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:09:15.737569 11096 ts_tablet_manager.cc:1905] T 362567b5c19b4c5a8c497bc3678dda83 P 681671877b2445079dfb22bf4e0a0d80: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:09:15.737690 11029 ts_tablet_manager.cc:1428] T 5fd6d96103d84e5b8a4eb36f2b60412f P 64d003a1eeab4fdbba09e2463a7119b9: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260809 19:09:15.745339 11042 raft_consensus.cc:482] T 5fd6d96103d84e5b8a4eb36f2b60412f P 7e844fa8c4c2497bbad97852d6dfbbda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:09:15.745361 11096 ts_tablet_manager.cc:1918] T 362567b5c19b4c5a8c497bc3678dda83 P 681671877b2445079dfb22bf4e0a0d80: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 19:09:15.745538 11096 log.cc:1196] T 362567b5c19b4c5a8c497bc3678dda83 P 681671877b2445079dfb22bf4e0a0d80: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-1/wal/wals/362567b5c19b4c5a8c497bc3678dda83
I20260809 19:09:15.745503 11042 raft_consensus.cc:504] T 5fd6d96103d84e5b8a4eb36f2b60412f P 7e844fa8c4c2497bbad97852d6dfbbda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
I20260809 19:09:15.746117 11096 ts_tablet_manager.cc:1939] T 362567b5c19b4c5a8c497bc3678dda83 P 681671877b2445079dfb22bf4e0a0d80: Deleting consensus metadata
I20260809 19:09:15.746308 11042 leader_election.cc:288] T 5fd6d96103d84e5b8a4eb36f2b60412f P 7e844fa8c4c2497bbad97852d6dfbbda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64d003a1eeab4fdbba09e2463a7119b9 (127.7.39.1:38023), 681671877b2445079dfb22bf4e0a0d80 (127.7.39.2:46179)
I20260809 19:09:15.746979 10690 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd6d96103d84e5b8a4eb36f2b60412f" candidate_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "681671877b2445079dfb22bf4e0a0d80" is_pre_election: true
I20260809 19:09:15.747251 10690 raft_consensus.cc:2454] T 5fd6d96103d84e5b8a4eb36f2b60412f P 681671877b2445079dfb22bf4e0a0d80 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e844fa8c4c2497bbad97852d6dfbbda in term 0.
I20260809 19:09:15.747888 10158 catalog_manager.cc:4841] TS 681671877b2445079dfb22bf4e0a0d80 (127.7.39.2:46179): tablet 362567b5c19b4c5a8c497bc3678dda83 (table test-table [id=df1cce23134448ad909e588849d85a9d]) successfully deleted
I20260809 19:09:15.747999 10458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd6d96103d84e5b8a4eb36f2b60412f" candidate_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64d003a1eeab4fdbba09e2463a7119b9" is_pre_election: true
I20260809 19:09:15.748214 10458 raft_consensus.cc:2454] T 5fd6d96103d84e5b8a4eb36f2b60412f P 64d003a1eeab4fdbba09e2463a7119b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e844fa8c4c2497bbad97852d6dfbbda in term 0.
I20260809 19:09:15.748700 10804 leader_election.cc:302] T 5fd6d96103d84e5b8a4eb36f2b60412f P 7e844fa8c4c2497bbad97852d6dfbbda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 64d003a1eeab4fdbba09e2463a7119b9, 681671877b2445079dfb22bf4e0a0d80, 7e844fa8c4c2497bbad97852d6dfbbda; no voters:
I20260809 19:09:15.749020 11042 raft_consensus.cc:2781] T 5fd6d96103d84e5b8a4eb36f2b60412f P 7e844fa8c4c2497bbad97852d6dfbbda [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:09:15.749147 11042 raft_consensus.cc:482] T 5fd6d96103d84e5b8a4eb36f2b60412f P 7e844fa8c4c2497bbad97852d6dfbbda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:09:15.749239 11042 raft_consensus.cc:3037] T 5fd6d96103d84e5b8a4eb36f2b60412f P 7e844fa8c4c2497bbad97852d6dfbbda [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:15.752420 11042 raft_consensus.cc:504] T 5fd6d96103d84e5b8a4eb36f2b60412f P 7e844fa8c4c2497bbad97852d6dfbbda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
I20260809 19:09:15.753414 10690 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd6d96103d84e5b8a4eb36f2b60412f" candidate_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "681671877b2445079dfb22bf4e0a0d80"
I20260809 19:09:15.753415 10458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd6d96103d84e5b8a4eb36f2b60412f" candidate_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64d003a1eeab4fdbba09e2463a7119b9"
I20260809 19:09:15.753607 10690 raft_consensus.cc:3037] T 5fd6d96103d84e5b8a4eb36f2b60412f P 681671877b2445079dfb22bf4e0a0d80 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:15.753610 10458 raft_consensus.cc:3037] T 5fd6d96103d84e5b8a4eb36f2b60412f P 64d003a1eeab4fdbba09e2463a7119b9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:15.756393 10690 raft_consensus.cc:2454] T 5fd6d96103d84e5b8a4eb36f2b60412f P 681671877b2445079dfb22bf4e0a0d80 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e844fa8c4c2497bbad97852d6dfbbda in term 1.
I20260809 19:09:15.756717 10458 raft_consensus.cc:2454] T 5fd6d96103d84e5b8a4eb36f2b60412f P 64d003a1eeab4fdbba09e2463a7119b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e844fa8c4c2497bbad97852d6dfbbda in term 1.
I20260809 19:09:15.756779 10801 leader_election.cc:302] T 5fd6d96103d84e5b8a4eb36f2b60412f P 7e844fa8c4c2497bbad97852d6dfbbda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681671877b2445079dfb22bf4e0a0d80, 7e844fa8c4c2497bbad97852d6dfbbda; no voters:
I20260809 19:09:15.757041 11036 raft_consensus.cc:2781] T 5fd6d96103d84e5b8a4eb36f2b60412f P 7e844fa8c4c2497bbad97852d6dfbbda [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:09:15.757181 11036 raft_consensus.cc:686] T 5fd6d96103d84e5b8a4eb36f2b60412f P 7e844fa8c4c2497bbad97852d6dfbbda [term 1 LEADER]: Becoming Leader. State: Replica: 7e844fa8c4c2497bbad97852d6dfbbda, State: Running, Role: LEADER
I20260809 19:09:15.757404 11036 consensus_queue.cc:237] T 5fd6d96103d84e5b8a4eb36f2b60412f P 7e844fa8c4c2497bbad97852d6dfbbda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
I20260809 19:09:15.759940 10180 catalog_manager.cc:5495] T 5fd6d96103d84e5b8a4eb36f2b60412f P 7e844fa8c4c2497bbad97852d6dfbbda reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e844fa8c4c2497bbad97852d6dfbbda (127.7.39.3). New cstate: current_term: 1 leader_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } health_report { overall_health: HEALTHY } } }
I20260809 19:09:15.760951 11042 leader_election.cc:288] T 5fd6d96103d84e5b8a4eb36f2b60412f P 7e844fa8c4c2497bbad97852d6dfbbda [CANDIDATE]: Term 1 election: Requested vote from peers 64d003a1eeab4fdbba09e2463a7119b9 (127.7.39.1:38023), 681671877b2445079dfb22bf4e0a0d80 (127.7.39.2:46179)
I20260809 19:09:15.790165 10458 raft_consensus.cc:1261] T 5fd6d96103d84e5b8a4eb36f2b60412f P 64d003a1eeab4fdbba09e2463a7119b9 [term 1 FOLLOWER]: Refusing update from remote peer 7e844fa8c4c2497bbad97852d6dfbbda: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:09:15.790376 10690 raft_consensus.cc:1261] T 5fd6d96103d84e5b8a4eb36f2b60412f P 681671877b2445079dfb22bf4e0a0d80 [term 1 FOLLOWER]: Refusing update from remote peer 7e844fa8c4c2497bbad97852d6dfbbda: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:09:15.790800 11042 consensus_queue.cc:1035] T 5fd6d96103d84e5b8a4eb36f2b60412f P 7e844fa8c4c2497bbad97852d6dfbbda [LEADER]: Connected to new peer: Peer: permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:09:15.791052 11036 consensus_queue.cc:1035] T 5fd6d96103d84e5b8a4eb36f2b60412f P 7e844fa8c4c2497bbad97852d6dfbbda [LEADER]: Connected to new peer: Peer: permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 19:09:15.827849 11068 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 19:09:17.418045 10180 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50106:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:09:17.418257 10180 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50106:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:09:17.422093 10180 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8a28432874cf4ec4b00485ee845290ea: Sending DeleteTablet for 3 replicas of tablet 5fd6d96103d84e5b8a4eb36f2b60412f
I20260809 19:09:17.422851 10421 tablet_service.cc:1514] Processing DeleteTablet for tablet 5fd6d96103d84e5b8a4eb36f2b60412f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:09:17 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:37178
I20260809 19:09:17.423017 10887 tablet_service.cc:1514] Processing DeleteTablet for tablet 5fd6d96103d84e5b8a4eb36f2b60412f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:09:17 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:48692
I20260809 19:09:17.423274 10643 tablet_service.cc:1514] Processing DeleteTablet for tablet 5fd6d96103d84e5b8a4eb36f2b60412f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:09:17 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:33104
I20260809 19:09:17.423879 11142 tablet_replica.cc:330] T 5fd6d96103d84e5b8a4eb36f2b60412f P 64d003a1eeab4fdbba09e2463a7119b9: stopping tablet replica
I20260809 19:09:17.424075 11142 raft_consensus.cc:2229] T 5fd6d96103d84e5b8a4eb36f2b60412f P 64d003a1eeab4fdbba09e2463a7119b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:09:17.424302 11142 raft_consensus.cc:2258] T 5fd6d96103d84e5b8a4eb36f2b60412f P 64d003a1eeab4fdbba09e2463a7119b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:09:17.425112 11142 ts_tablet_manager.cc:1905] T 5fd6d96103d84e5b8a4eb36f2b60412f P 64d003a1eeab4fdbba09e2463a7119b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:09:17.426885 11143 tablet_replica.cc:330] T 5fd6d96103d84e5b8a4eb36f2b60412f P 7e844fa8c4c2497bbad97852d6dfbbda: stopping tablet replica
I20260809 19:09:17.427116 11143 raft_consensus.cc:2229] T 5fd6d96103d84e5b8a4eb36f2b60412f P 7e844fa8c4c2497bbad97852d6dfbbda [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:09:17.427493 11143 raft_consensus.cc:2258] T 5fd6d96103d84e5b8a4eb36f2b60412f P 7e844fa8c4c2497bbad97852d6dfbbda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:09:17.428383 11143 ts_tablet_manager.cc:1905] T 5fd6d96103d84e5b8a4eb36f2b60412f P 7e844fa8c4c2497bbad97852d6dfbbda: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:09:17.431365 11142 ts_tablet_manager.cc:1918] T 5fd6d96103d84e5b8a4eb36f2b60412f P 64d003a1eeab4fdbba09e2463a7119b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 19:09:17.431510 11142 log.cc:1196] T 5fd6d96103d84e5b8a4eb36f2b60412f P 64d003a1eeab4fdbba09e2463a7119b9: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-0/wal/wals/5fd6d96103d84e5b8a4eb36f2b60412f
I20260809 19:09:17.431975 11142 ts_tablet_manager.cc:1939] T 5fd6d96103d84e5b8a4eb36f2b60412f P 64d003a1eeab4fdbba09e2463a7119b9: Deleting consensus metadata
I20260809 19:09:17.433079 10159 catalog_manager.cc:4841] TS 64d003a1eeab4fdbba09e2463a7119b9 (127.7.39.1:38023): tablet 5fd6d96103d84e5b8a4eb36f2b60412f (table test-table [id=7a8b7f7ede724ce3be81a0aa1394a461]) successfully deleted
I20260809 19:09:17.433889 11144 tablet_replica.cc:330] T 5fd6d96103d84e5b8a4eb36f2b60412f P 681671877b2445079dfb22bf4e0a0d80: stopping tablet replica
I20260809 19:09:17.434093 11144 raft_consensus.cc:2229] T 5fd6d96103d84e5b8a4eb36f2b60412f P 681671877b2445079dfb22bf4e0a0d80 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:09:17.434340 11144 raft_consensus.cc:2258] T 5fd6d96103d84e5b8a4eb36f2b60412f P 681671877b2445079dfb22bf4e0a0d80 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:09:17.435204 11144 ts_tablet_manager.cc:1905] T 5fd6d96103d84e5b8a4eb36f2b60412f P 681671877b2445079dfb22bf4e0a0d80: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:09:17.435333 11143 ts_tablet_manager.cc:1918] T 5fd6d96103d84e5b8a4eb36f2b60412f P 7e844fa8c4c2497bbad97852d6dfbbda: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 19:09:17.435462 11143 log.cc:1196] T 5fd6d96103d84e5b8a4eb36f2b60412f P 7e844fa8c4c2497bbad97852d6dfbbda: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-2/wal/wals/5fd6d96103d84e5b8a4eb36f2b60412f
I20260809 19:09:17.435883 11143 ts_tablet_manager.cc:1939] T 5fd6d96103d84e5b8a4eb36f2b60412f P 7e844fa8c4c2497bbad97852d6dfbbda: Deleting consensus metadata
I20260809 19:09:17.436825 10162 catalog_manager.cc:4841] TS 7e844fa8c4c2497bbad97852d6dfbbda (127.7.39.3:36445): tablet 5fd6d96103d84e5b8a4eb36f2b60412f (table test-table [id=7a8b7f7ede724ce3be81a0aa1394a461]) successfully deleted
I20260809 19:09:17.440117 11144 ts_tablet_manager.cc:1918] T 5fd6d96103d84e5b8a4eb36f2b60412f P 681671877b2445079dfb22bf4e0a0d80: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 19:09:17.440223 11144 log.cc:1196] T 5fd6d96103d84e5b8a4eb36f2b60412f P 681671877b2445079dfb22bf4e0a0d80: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-1/wal/wals/5fd6d96103d84e5b8a4eb36f2b60412f
I20260809 19:09:17.440564 11144 ts_tablet_manager.cc:1939] T 5fd6d96103d84e5b8a4eb36f2b60412f P 681671877b2445079dfb22bf4e0a0d80: Deleting consensus metadata
I20260809 19:09:17.441402 10158 catalog_manager.cc:4841] TS 681671877b2445079dfb22bf4e0a0d80 (127.7.39.2:46179): tablet 5fd6d96103d84e5b8a4eb36f2b60412f (table test-table [id=7a8b7f7ede724ce3be81a0aa1394a461]) successfully deleted
Aug 09 19:09:17 dist-test-slave-4tdj krb5kdc[10116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302557, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 19:09:17 dist-test-slave-4tdj krb5kdc[10116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302557, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:17.473417 11154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:17.460021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50136 (local address 127.7.39.62:40951)
0809 19:09:17.460544 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:17.460548 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:17.460568 (+ 20us) server_negotiation.cc:407] Connection header received
0809 19:09:17.460619 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:17.460623 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:17.460681 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:17.460765 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:17.461950 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:17.462783 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:17.464276 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:17.464699 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:17.464808 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:17.468363 (+ 3555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:17.468368 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:17.468371 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:17.468402 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:17.470927 (+ 2525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:17.471545 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:17.471549 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:17.471551 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:17.471680 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:17.472050 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:17.472054 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:17.472056 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:17.472361 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:17.472599 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:17.472869 (+ 270us) server_negotiation.cc:299] Negotiation successful
0809 19:09:17.473077 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":269,"threads_started":1}
I20260809 19:09:17.476935 10180 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50136:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:09:17.477680 10180 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:09:17.484189 10643 tablet_service.cc:1467] Processing CreateTablet for tablet 8cea2b2c5d3d46cc9665362a87c4af60 (DEFAULT_TABLE table=test-table [id=751921790f5b4d01a5d1b6870055f20f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:09:17.484182 10421 tablet_service.cc:1467] Processing CreateTablet for tablet 8cea2b2c5d3d46cc9665362a87c4af60 (DEFAULT_TABLE table=test-table [id=751921790f5b4d01a5d1b6870055f20f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:09:17.484615 10643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cea2b2c5d3d46cc9665362a87c4af60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:17.484664 10421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cea2b2c5d3d46cc9665362a87c4af60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:17.489580 11157 tablet_bootstrap.cc:492] T 8cea2b2c5d3d46cc9665362a87c4af60 P 64d003a1eeab4fdbba09e2463a7119b9: Bootstrap starting.
I20260809 19:09:17.489550 10887 tablet_service.cc:1467] Processing CreateTablet for tablet 8cea2b2c5d3d46cc9665362a87c4af60 (DEFAULT_TABLE table=test-table [id=751921790f5b4d01a5d1b6870055f20f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:09:17.489995 10887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cea2b2c5d3d46cc9665362a87c4af60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:17.490111 11156 tablet_bootstrap.cc:492] T 8cea2b2c5d3d46cc9665362a87c4af60 P 681671877b2445079dfb22bf4e0a0d80: Bootstrap starting.
I20260809 19:09:17.491106 11157 tablet_bootstrap.cc:654] T 8cea2b2c5d3d46cc9665362a87c4af60 P 64d003a1eeab4fdbba09e2463a7119b9: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:17.491706 11156 tablet_bootstrap.cc:654] T 8cea2b2c5d3d46cc9665362a87c4af60 P 681671877b2445079dfb22bf4e0a0d80: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:17.511915 11163 tablet_bootstrap.cc:492] T 8cea2b2c5d3d46cc9665362a87c4af60 P 7e844fa8c4c2497bbad97852d6dfbbda: Bootstrap starting.
I20260809 19:09:17.513291 11157 tablet_bootstrap.cc:492] T 8cea2b2c5d3d46cc9665362a87c4af60 P 64d003a1eeab4fdbba09e2463a7119b9: No bootstrap required, opened a new log
I20260809 19:09:17.513290 11156 tablet_bootstrap.cc:492] T 8cea2b2c5d3d46cc9665362a87c4af60 P 681671877b2445079dfb22bf4e0a0d80: No bootstrap required, opened a new log
I20260809 19:09:17.513446 11157 ts_tablet_manager.cc:1397] T 8cea2b2c5d3d46cc9665362a87c4af60 P 64d003a1eeab4fdbba09e2463a7119b9: Time spent bootstrapping tablet: real 0.024s user 0.011s sys 0.012s
I20260809 19:09:17.513547 11163 tablet_bootstrap.cc:654] T 8cea2b2c5d3d46cc9665362a87c4af60 P 7e844fa8c4c2497bbad97852d6dfbbda: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:17.513653 11156 ts_tablet_manager.cc:1397] T 8cea2b2c5d3d46cc9665362a87c4af60 P 681671877b2445079dfb22bf4e0a0d80: Time spent bootstrapping tablet: real 0.024s user 0.014s sys 0.007s
I20260809 19:09:17.514228 11157 raft_consensus.cc:348] T 8cea2b2c5d3d46cc9665362a87c4af60 P 64d003a1eeab4fdbba09e2463a7119b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
I20260809 19:09:17.514500 11157 raft_consensus.cc:374] T 8cea2b2c5d3d46cc9665362a87c4af60 P 64d003a1eeab4fdbba09e2463a7119b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:17.514616 11157 raft_consensus.cc:729] T 8cea2b2c5d3d46cc9665362a87c4af60 P 64d003a1eeab4fdbba09e2463a7119b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64d003a1eeab4fdbba09e2463a7119b9, State: Initialized, Role: FOLLOWER
I20260809 19:09:17.514458 11156 raft_consensus.cc:348] T 8cea2b2c5d3d46cc9665362a87c4af60 P 681671877b2445079dfb22bf4e0a0d80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
I20260809 19:09:17.514902 11156 raft_consensus.cc:374] T 8cea2b2c5d3d46cc9665362a87c4af60 P 681671877b2445079dfb22bf4e0a0d80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:17.514879 11157 consensus_queue.cc:260] T 8cea2b2c5d3d46cc9665362a87c4af60 P 64d003a1eeab4fdbba09e2463a7119b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
I20260809 19:09:17.516189 11156 raft_consensus.cc:729] T 8cea2b2c5d3d46cc9665362a87c4af60 P 681671877b2445079dfb22bf4e0a0d80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 681671877b2445079dfb22bf4e0a0d80, State: Initialized, Role: FOLLOWER
I20260809 19:09:17.516518 11156 consensus_queue.cc:260] T 8cea2b2c5d3d46cc9665362a87c4af60 P 681671877b2445079dfb22bf4e0a0d80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
I20260809 19:09:17.517210 11156 ts_tablet_manager.cc:1428] T 8cea2b2c5d3d46cc9665362a87c4af60 P 681671877b2445079dfb22bf4e0a0d80: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260809 19:09:17.521598 11157 ts_tablet_manager.cc:1428] T 8cea2b2c5d3d46cc9665362a87c4af60 P 64d003a1eeab4fdbba09e2463a7119b9: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260809 19:09:17.522234 11163 tablet_bootstrap.cc:492] T 8cea2b2c5d3d46cc9665362a87c4af60 P 7e844fa8c4c2497bbad97852d6dfbbda: No bootstrap required, opened a new log
I20260809 19:09:17.522411 11163 ts_tablet_manager.cc:1397] T 8cea2b2c5d3d46cc9665362a87c4af60 P 7e844fa8c4c2497bbad97852d6dfbbda: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.005s
I20260809 19:09:17.523231 11163 raft_consensus.cc:348] T 8cea2b2c5d3d46cc9665362a87c4af60 P 7e844fa8c4c2497bbad97852d6dfbbda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
I20260809 19:09:17.523435 11163 raft_consensus.cc:374] T 8cea2b2c5d3d46cc9665362a87c4af60 P 7e844fa8c4c2497bbad97852d6dfbbda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:17.523518 11163 raft_consensus.cc:729] T 8cea2b2c5d3d46cc9665362a87c4af60 P 7e844fa8c4c2497bbad97852d6dfbbda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e844fa8c4c2497bbad97852d6dfbbda, State: Initialized, Role: FOLLOWER
I20260809 19:09:17.523780 11163 consensus_queue.cc:260] T 8cea2b2c5d3d46cc9665362a87c4af60 P 7e844fa8c4c2497bbad97852d6dfbbda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
I20260809 19:09:17.524351 11163 ts_tablet_manager.cc:1428] T 8cea2b2c5d3d46cc9665362a87c4af60 P 7e844fa8c4c2497bbad97852d6dfbbda: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260809 19:09:17.615025 11111 raft_consensus.cc:482] T 8cea2b2c5d3d46cc9665362a87c4af60 P 681671877b2445079dfb22bf4e0a0d80 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:09:17.615201 11111 raft_consensus.cc:504] T 8cea2b2c5d3d46cc9665362a87c4af60 P 681671877b2445079dfb22bf4e0a0d80 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
I20260809 19:09:17.615875 11111 leader_election.cc:288] T 8cea2b2c5d3d46cc9665362a87c4af60 P 681671877b2445079dfb22bf4e0a0d80 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64d003a1eeab4fdbba09e2463a7119b9 (127.7.39.1:38023), 7e844fa8c4c2497bbad97852d6dfbbda (127.7.39.3:36445)
I20260809 19:09:17.616405 10458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cea2b2c5d3d46cc9665362a87c4af60" candidate_uuid: "681671877b2445079dfb22bf4e0a0d80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64d003a1eeab4fdbba09e2463a7119b9" is_pre_election: true
I20260809 19:09:17.616428 10924 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cea2b2c5d3d46cc9665362a87c4af60" candidate_uuid: "681671877b2445079dfb22bf4e0a0d80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" is_pre_election: true
I20260809 19:09:17.616667 10458 raft_consensus.cc:2454] T 8cea2b2c5d3d46cc9665362a87c4af60 P 64d003a1eeab4fdbba09e2463a7119b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681671877b2445079dfb22bf4e0a0d80 in term 0.
I20260809 19:09:17.616696 10924 raft_consensus.cc:2454] T 8cea2b2c5d3d46cc9665362a87c4af60 P 7e844fa8c4c2497bbad97852d6dfbbda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681671877b2445079dfb22bf4e0a0d80 in term 0.
I20260809 19:09:17.617130 10565 leader_election.cc:302] T 8cea2b2c5d3d46cc9665362a87c4af60 P 681671877b2445079dfb22bf4e0a0d80 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 64d003a1eeab4fdbba09e2463a7119b9, 681671877b2445079dfb22bf4e0a0d80, 7e844fa8c4c2497bbad97852d6dfbbda; no voters:
I20260809 19:09:17.617409 11111 raft_consensus.cc:2781] T 8cea2b2c5d3d46cc9665362a87c4af60 P 681671877b2445079dfb22bf4e0a0d80 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:09:17.617515 11111 raft_consensus.cc:482] T 8cea2b2c5d3d46cc9665362a87c4af60 P 681671877b2445079dfb22bf4e0a0d80 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:09:17.617601 11111 raft_consensus.cc:3037] T 8cea2b2c5d3d46cc9665362a87c4af60 P 681671877b2445079dfb22bf4e0a0d80 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:17.619758 11111 raft_consensus.cc:504] T 8cea2b2c5d3d46cc9665362a87c4af60 P 681671877b2445079dfb22bf4e0a0d80 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
I20260809 19:09:17.620246 11111 leader_election.cc:288] T 8cea2b2c5d3d46cc9665362a87c4af60 P 681671877b2445079dfb22bf4e0a0d80 [CANDIDATE]: Term 1 election: Requested vote from peers 64d003a1eeab4fdbba09e2463a7119b9 (127.7.39.1:38023), 7e844fa8c4c2497bbad97852d6dfbbda (127.7.39.3:36445)
I20260809 19:09:17.620718 10458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cea2b2c5d3d46cc9665362a87c4af60" candidate_uuid: "681671877b2445079dfb22bf4e0a0d80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64d003a1eeab4fdbba09e2463a7119b9"
I20260809 19:09:17.620743 10924 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cea2b2c5d3d46cc9665362a87c4af60" candidate_uuid: "681671877b2445079dfb22bf4e0a0d80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e844fa8c4c2497bbad97852d6dfbbda"
I20260809 19:09:17.620894 10924 raft_consensus.cc:3037] T 8cea2b2c5d3d46cc9665362a87c4af60 P 7e844fa8c4c2497bbad97852d6dfbbda [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:17.620890 10458 raft_consensus.cc:3037] T 8cea2b2c5d3d46cc9665362a87c4af60 P 64d003a1eeab4fdbba09e2463a7119b9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:17.623206 10458 raft_consensus.cc:2454] T 8cea2b2c5d3d46cc9665362a87c4af60 P 64d003a1eeab4fdbba09e2463a7119b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681671877b2445079dfb22bf4e0a0d80 in term 1.
I20260809 19:09:17.623212 10924 raft_consensus.cc:2454] T 8cea2b2c5d3d46cc9665362a87c4af60 P 7e844fa8c4c2497bbad97852d6dfbbda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681671877b2445079dfb22bf4e0a0d80 in term 1.
I20260809 19:09:17.623586 10566 leader_election.cc:302] T 8cea2b2c5d3d46cc9665362a87c4af60 P 681671877b2445079dfb22bf4e0a0d80 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681671877b2445079dfb22bf4e0a0d80, 7e844fa8c4c2497bbad97852d6dfbbda; no voters:
I20260809 19:09:17.623864 11111 raft_consensus.cc:2781] T 8cea2b2c5d3d46cc9665362a87c4af60 P 681671877b2445079dfb22bf4e0a0d80 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:09:17.624001 11111 raft_consensus.cc:686] T 8cea2b2c5d3d46cc9665362a87c4af60 P 681671877b2445079dfb22bf4e0a0d80 [term 1 LEADER]: Becoming Leader. State: Replica: 681671877b2445079dfb22bf4e0a0d80, State: Running, Role: LEADER
I20260809 19:09:17.624276 11111 consensus_queue.cc:237] T 8cea2b2c5d3d46cc9665362a87c4af60 P 681671877b2445079dfb22bf4e0a0d80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
I20260809 19:09:17.626616 10178 catalog_manager.cc:5495] T 8cea2b2c5d3d46cc9665362a87c4af60 P 681671877b2445079dfb22bf4e0a0d80 reported cstate change: term changed from 0 to 1, leader changed from <none> to 681671877b2445079dfb22bf4e0a0d80 (127.7.39.2). New cstate: current_term: 1 leader_uuid: "681671877b2445079dfb22bf4e0a0d80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } health_report { overall_health: UNKNOWN } } }
I20260809 19:09:17.651475 11173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:17.647125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33124 (local address 127.7.39.2:46179)
0809 19:09:17.647596 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:17.647600 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:17.647618 (+ 18us) server_negotiation.cc:407] Connection header received
0809 19:09:17.647663 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:17.647666 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:17.647721 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:17.647796 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:09:17.648094 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:17.648796 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:17.649997 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:17.650423 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:17.650505 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:17.650849 (+ 344us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:09:17.650951 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:09:17.651012 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:17.651113 (+ 101us) server_negotiation.cc:299] Negotiation successful
0809 19:09:17.651170 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":255,"threads_started":1}
I20260809 19:09:17.663597 11173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:17.658788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:59787 (local address 127.7.39.2:46179)
0809 19:09:17.658915 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:17.658919 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:17.659454 (+ 535us) server_negotiation.cc:407] Connection header received
0809 19:09:17.659617 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:17.659621 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:17.659674 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:17.659737 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:09:17.660127 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:17.660781 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:17.662075 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:17.662507 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:17.662610 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:17.662962 (+ 352us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:09:17.663060 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:09:17.663130 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:17.663244 (+ 114us) server_negotiation.cc:299] Negotiation successful
0809 19:09:17.663308 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 19:09:17.663695 11177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:17.658781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:46179 (local address 127.7.39.2:59787)
0809 19:09:17.659362 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:17.659377 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:17.659501 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:17.659763 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:17.659767 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:17.659778 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 19:09:17.660004 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:17.660012 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:17.660921 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:17.660925 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:17.661949 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:17.661961 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:17.662656 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:17.662662 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:17.662783 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:17.662814 (+ 31us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 19:09:17.663144 (+ 330us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 19:09:17.663155 (+ 11us) client_negotiation.cc:769] Sending connection context
0809 19:09:17.663221 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 19:09:17.663343 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":347,"threads_started":1}
I20260809 19:09:17.670634 10458 raft_consensus.cc:1261] T 8cea2b2c5d3d46cc9665362a87c4af60 P 64d003a1eeab4fdbba09e2463a7119b9 [term 1 FOLLOWER]: Refusing update from remote peer 681671877b2445079dfb22bf4e0a0d80: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:09:17.670776 10924 raft_consensus.cc:1261] T 8cea2b2c5d3d46cc9665362a87c4af60 P 7e844fa8c4c2497bbad97852d6dfbbda [term 1 FOLLOWER]: Refusing update from remote peer 681671877b2445079dfb22bf4e0a0d80: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:09:17.671185 11115 consensus_queue.cc:1035] T 8cea2b2c5d3d46cc9665362a87c4af60 P 681671877b2445079dfb22bf4e0a0d80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:09:17.671478 11111 consensus_queue.cc:1035] T 8cea2b2c5d3d46cc9665362a87c4af60 P 681671877b2445079dfb22bf4e0a0d80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:09:17.714864 10180 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50136:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:09:17.715106 10180 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50136:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:09:17.718086 10180 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8a28432874cf4ec4b00485ee845290ea: Sending DeleteTablet for 3 replicas of tablet 8cea2b2c5d3d46cc9665362a87c4af60
I20260809 19:09:17.718858 10421 tablet_service.cc:1514] Processing DeleteTablet for tablet 8cea2b2c5d3d46cc9665362a87c4af60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:09:17 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:37178
I20260809 19:09:17.718935 10642 tablet_service.cc:1514] Processing DeleteTablet for tablet 8cea2b2c5d3d46cc9665362a87c4af60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:09:17 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:33104
I20260809 19:09:17.719143 11142 tablet_replica.cc:330] T 8cea2b2c5d3d46cc9665362a87c4af60 P 64d003a1eeab4fdbba09e2463a7119b9: stopping tablet replica
I20260809 19:09:17.719329 11142 raft_consensus.cc:2229] T 8cea2b2c5d3d46cc9665362a87c4af60 P 64d003a1eeab4fdbba09e2463a7119b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:09:17.719517 11142 raft_consensus.cc:2258] T 8cea2b2c5d3d46cc9665362a87c4af60 P 64d003a1eeab4fdbba09e2463a7119b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:09:17.719806 11144 tablet_replica.cc:330] T 8cea2b2c5d3d46cc9665362a87c4af60 P 681671877b2445079dfb22bf4e0a0d80: stopping tablet replica
I20260809 19:09:17.719934 10887 tablet_service.cc:1514] Processing DeleteTablet for tablet 8cea2b2c5d3d46cc9665362a87c4af60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:09:17 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:48692
I20260809 19:09:17.720005 11144 raft_consensus.cc:2229] T 8cea2b2c5d3d46cc9665362a87c4af60 P 681671877b2445079dfb22bf4e0a0d80 [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:09:17.720259 11143 tablet_replica.cc:330] T 8cea2b2c5d3d46cc9665362a87c4af60 P 7e844fa8c4c2497bbad97852d6dfbbda: stopping tablet replica
I20260809 19:09:17.720451 11143 raft_consensus.cc:2229] T 8cea2b2c5d3d46cc9665362a87c4af60 P 7e844fa8c4c2497bbad97852d6dfbbda [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:09:17.720521 11144 raft_consensus.cc:2258] T 8cea2b2c5d3d46cc9665362a87c4af60 P 681671877b2445079dfb22bf4e0a0d80 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:09:17.720402 10180 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50136:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 19:09:17.720629 11143 raft_consensus.cc:2258] T 8cea2b2c5d3d46cc9665362a87c4af60 P 7e844fa8c4c2497bbad97852d6dfbbda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:09:17.721818 11143 ts_tablet_manager.cc:1905] T 8cea2b2c5d3d46cc9665362a87c4af60 P 7e844fa8c4c2497bbad97852d6dfbbda: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:09:17.722414 11142 ts_tablet_manager.cc:1905] T 8cea2b2c5d3d46cc9665362a87c4af60 P 64d003a1eeab4fdbba09e2463a7119b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260809 19:09:17.726476 10180 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:09:17.728169 11143 ts_tablet_manager.cc:1918] T 8cea2b2c5d3d46cc9665362a87c4af60 P 7e844fa8c4c2497bbad97852d6dfbbda: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 19:09:17.728309 11143 log.cc:1196] T 8cea2b2c5d3d46cc9665362a87c4af60 P 7e844fa8c4c2497bbad97852d6dfbbda: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-2/wal/wals/8cea2b2c5d3d46cc9665362a87c4af60
I20260809 19:09:17.728704 11143 ts_tablet_manager.cc:1939] T 8cea2b2c5d3d46cc9665362a87c4af60 P 7e844fa8c4c2497bbad97852d6dfbbda: Deleting consensus metadata
I20260809 19:09:17.728922 11144 ts_tablet_manager.cc:1905] T 8cea2b2c5d3d46cc9665362a87c4af60 P 681671877b2445079dfb22bf4e0a0d80: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:09:17.729718 10162 catalog_manager.cc:4841] TS 7e844fa8c4c2497bbad97852d6dfbbda (127.7.39.3:36445): tablet 8cea2b2c5d3d46cc9665362a87c4af60 (table test-table [id=751921790f5b4d01a5d1b6870055f20f]) successfully deleted
I20260809 19:09:17.730751 11142 ts_tablet_manager.cc:1918] T 8cea2b2c5d3d46cc9665362a87c4af60 P 64d003a1eeab4fdbba09e2463a7119b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 19:09:17.730906 11142 log.cc:1196] T 8cea2b2c5d3d46cc9665362a87c4af60 P 64d003a1eeab4fdbba09e2463a7119b9: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-0/wal/wals/8cea2b2c5d3d46cc9665362a87c4af60
I20260809 19:09:17.731314 11142 ts_tablet_manager.cc:1939] T 8cea2b2c5d3d46cc9665362a87c4af60 P 64d003a1eeab4fdbba09e2463a7119b9: Deleting consensus metadata
I20260809 19:09:17.732323 10159 catalog_manager.cc:4841] TS 64d003a1eeab4fdbba09e2463a7119b9 (127.7.39.1:38023): tablet 8cea2b2c5d3d46cc9665362a87c4af60 (table test-table [id=751921790f5b4d01a5d1b6870055f20f]) successfully deleted
I20260809 19:09:17.734560 10887 tablet_service.cc:1467] Processing CreateTablet for tablet 041cf3dbde9a4760bb2086592b3c52f8 (DEFAULT_TABLE table=test-table [id=df6fba57edc14d7d823c229f751eebd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:09:17.734545 10421 tablet_service.cc:1467] Processing CreateTablet for tablet 041cf3dbde9a4760bb2086592b3c52f8 (DEFAULT_TABLE table=test-table [id=df6fba57edc14d7d823c229f751eebd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:09:17.734575 10642 tablet_service.cc:1467] Processing CreateTablet for tablet 041cf3dbde9a4760bb2086592b3c52f8 (DEFAULT_TABLE table=test-table [id=df6fba57edc14d7d823c229f751eebd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:09:17.734956 10887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 041cf3dbde9a4760bb2086592b3c52f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:17.734948 10421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 041cf3dbde9a4760bb2086592b3c52f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:17.735018 10642 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 041cf3dbde9a4760bb2086592b3c52f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:17.740774 11163 tablet_bootstrap.cc:492] T 041cf3dbde9a4760bb2086592b3c52f8 P 7e844fa8c4c2497bbad97852d6dfbbda: Bootstrap starting.
I20260809 19:09:17.741400 11157 tablet_bootstrap.cc:492] T 041cf3dbde9a4760bb2086592b3c52f8 P 64d003a1eeab4fdbba09e2463a7119b9: Bootstrap starting.
I20260809 19:09:17.742391 11163 tablet_bootstrap.cc:654] T 041cf3dbde9a4760bb2086592b3c52f8 P 7e844fa8c4c2497bbad97852d6dfbbda: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:17.742955 11157 tablet_bootstrap.cc:654] T 041cf3dbde9a4760bb2086592b3c52f8 P 64d003a1eeab4fdbba09e2463a7119b9: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:17.743304 11156 tablet_bootstrap.cc:492] T 041cf3dbde9a4760bb2086592b3c52f8 P 681671877b2445079dfb22bf4e0a0d80: Bootstrap starting.
I20260809 19:09:17.744937 11156 tablet_bootstrap.cc:654] T 041cf3dbde9a4760bb2086592b3c52f8 P 681671877b2445079dfb22bf4e0a0d80: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:17.749104 11144 ts_tablet_manager.cc:1918] T 8cea2b2c5d3d46cc9665362a87c4af60 P 681671877b2445079dfb22bf4e0a0d80: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 19:09:17.750435 11144 log.cc:1196] T 8cea2b2c5d3d46cc9665362a87c4af60 P 681671877b2445079dfb22bf4e0a0d80: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-1/wal/wals/8cea2b2c5d3d46cc9665362a87c4af60
I20260809 19:09:17.751060 11144 ts_tablet_manager.cc:1939] T 8cea2b2c5d3d46cc9665362a87c4af60 P 681671877b2445079dfb22bf4e0a0d80: Deleting consensus metadata
I20260809 19:09:17.752662 10158 catalog_manager.cc:4841] TS 681671877b2445079dfb22bf4e0a0d80 (127.7.39.2:46179): tablet 8cea2b2c5d3d46cc9665362a87c4af60 (table test-table [id=751921790f5b4d01a5d1b6870055f20f]) successfully deleted
I20260809 19:09:17.754669 11163 tablet_bootstrap.cc:492] T 041cf3dbde9a4760bb2086592b3c52f8 P 7e844fa8c4c2497bbad97852d6dfbbda: No bootstrap required, opened a new log
I20260809 19:09:17.754843 11163 ts_tablet_manager.cc:1397] T 041cf3dbde9a4760bb2086592b3c52f8 P 7e844fa8c4c2497bbad97852d6dfbbda: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.009s
I20260809 19:09:17.755610 11163 raft_consensus.cc:348] T 041cf3dbde9a4760bb2086592b3c52f8 P 7e844fa8c4c2497bbad97852d6dfbbda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
I20260809 19:09:17.755856 11163 raft_consensus.cc:374] T 041cf3dbde9a4760bb2086592b3c52f8 P 7e844fa8c4c2497bbad97852d6dfbbda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:17.755945 11163 raft_consensus.cc:729] T 041cf3dbde9a4760bb2086592b3c52f8 P 7e844fa8c4c2497bbad97852d6dfbbda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e844fa8c4c2497bbad97852d6dfbbda, State: Initialized, Role: FOLLOWER
I20260809 19:09:17.756215 11163 consensus_queue.cc:260] T 041cf3dbde9a4760bb2086592b3c52f8 P 7e844fa8c4c2497bbad97852d6dfbbda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
I20260809 19:09:17.756918 11163 ts_tablet_manager.cc:1428] T 041cf3dbde9a4760bb2086592b3c52f8 P 7e844fa8c4c2497bbad97852d6dfbbda: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 19:09:17.757743 11157 tablet_bootstrap.cc:492] T 041cf3dbde9a4760bb2086592b3c52f8 P 64d003a1eeab4fdbba09e2463a7119b9: No bootstrap required, opened a new log
I20260809 19:09:17.757965 11157 ts_tablet_manager.cc:1397] T 041cf3dbde9a4760bb2086592b3c52f8 P 64d003a1eeab4fdbba09e2463a7119b9: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.011s
I20260809 19:09:17.757965 11156 tablet_bootstrap.cc:492] T 041cf3dbde9a4760bb2086592b3c52f8 P 681671877b2445079dfb22bf4e0a0d80: No bootstrap required, opened a new log
I20260809 19:09:17.758140 11156 ts_tablet_manager.cc:1397] T 041cf3dbde9a4760bb2086592b3c52f8 P 681671877b2445079dfb22bf4e0a0d80: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.006s
I20260809 19:09:17.758829 11157 raft_consensus.cc:348] T 041cf3dbde9a4760bb2086592b3c52f8 P 64d003a1eeab4fdbba09e2463a7119b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
I20260809 19:09:17.759146 11157 raft_consensus.cc:374] T 041cf3dbde9a4760bb2086592b3c52f8 P 64d003a1eeab4fdbba09e2463a7119b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:17.759063 11156 raft_consensus.cc:348] T 041cf3dbde9a4760bb2086592b3c52f8 P 681671877b2445079dfb22bf4e0a0d80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
I20260809 19:09:17.759303 11157 raft_consensus.cc:729] T 041cf3dbde9a4760bb2086592b3c52f8 P 64d003a1eeab4fdbba09e2463a7119b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64d003a1eeab4fdbba09e2463a7119b9, State: Initialized, Role: FOLLOWER
I20260809 19:09:17.759624 11157 consensus_queue.cc:260] T 041cf3dbde9a4760bb2086592b3c52f8 P 64d003a1eeab4fdbba09e2463a7119b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
I20260809 19:09:17.760291 11156 raft_consensus.cc:374] T 041cf3dbde9a4760bb2086592b3c52f8 P 681671877b2445079dfb22bf4e0a0d80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:17.760411 11156 raft_consensus.cc:729] T 041cf3dbde9a4760bb2086592b3c52f8 P 681671877b2445079dfb22bf4e0a0d80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 681671877b2445079dfb22bf4e0a0d80, State: Initialized, Role: FOLLOWER
I20260809 19:09:17.760648 11156 consensus_queue.cc:260] T 041cf3dbde9a4760bb2086592b3c52f8 P 681671877b2445079dfb22bf4e0a0d80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
I20260809 19:09:17.761237 11156 ts_tablet_manager.cc:1428] T 041cf3dbde9a4760bb2086592b3c52f8 P 681671877b2445079dfb22bf4e0a0d80: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260809 19:09:17.761739 11157 ts_tablet_manager.cc:1428] T 041cf3dbde9a4760bb2086592b3c52f8 P 64d003a1eeab4fdbba09e2463a7119b9: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260809 19:09:17.915100 11111 raft_consensus.cc:482] T 041cf3dbde9a4760bb2086592b3c52f8 P 681671877b2445079dfb22bf4e0a0d80 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:09:17.915325 11111 raft_consensus.cc:504] T 041cf3dbde9a4760bb2086592b3c52f8 P 681671877b2445079dfb22bf4e0a0d80 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
I20260809 19:09:17.916199 11111 leader_election.cc:288] T 041cf3dbde9a4760bb2086592b3c52f8 P 681671877b2445079dfb22bf4e0a0d80 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64d003a1eeab4fdbba09e2463a7119b9 (127.7.39.1:38023), 7e844fa8c4c2497bbad97852d6dfbbda (127.7.39.3:36445)
I20260809 19:09:17.916806 10924 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "041cf3dbde9a4760bb2086592b3c52f8" candidate_uuid: "681671877b2445079dfb22bf4e0a0d80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" is_pre_election: true
I20260809 19:09:17.917098 10924 raft_consensus.cc:2454] T 041cf3dbde9a4760bb2086592b3c52f8 P 7e844fa8c4c2497bbad97852d6dfbbda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681671877b2445079dfb22bf4e0a0d80 in term 0.
I20260809 19:09:17.917534 10566 leader_election.cc:302] T 041cf3dbde9a4760bb2086592b3c52f8 P 681671877b2445079dfb22bf4e0a0d80 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681671877b2445079dfb22bf4e0a0d80, 7e844fa8c4c2497bbad97852d6dfbbda; no voters:
I20260809 19:09:17.917552 10458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "041cf3dbde9a4760bb2086592b3c52f8" candidate_uuid: "681671877b2445079dfb22bf4e0a0d80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64d003a1eeab4fdbba09e2463a7119b9" is_pre_election: true
I20260809 19:09:17.917842 11111 raft_consensus.cc:2781] T 041cf3dbde9a4760bb2086592b3c52f8 P 681671877b2445079dfb22bf4e0a0d80 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:09:17.917868 10458 raft_consensus.cc:2454] T 041cf3dbde9a4760bb2086592b3c52f8 P 64d003a1eeab4fdbba09e2463a7119b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681671877b2445079dfb22bf4e0a0d80 in term 0.
I20260809 19:09:17.917972 11111 raft_consensus.cc:482] T 041cf3dbde9a4760bb2086592b3c52f8 P 681671877b2445079dfb22bf4e0a0d80 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:09:17.918071 11111 raft_consensus.cc:3037] T 041cf3dbde9a4760bb2086592b3c52f8 P 681671877b2445079dfb22bf4e0a0d80 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:17.920800 11111 raft_consensus.cc:504] T 041cf3dbde9a4760bb2086592b3c52f8 P 681671877b2445079dfb22bf4e0a0d80 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
I20260809 19:09:17.921437 11111 leader_election.cc:288] T 041cf3dbde9a4760bb2086592b3c52f8 P 681671877b2445079dfb22bf4e0a0d80 [CANDIDATE]: Term 1 election: Requested vote from peers 64d003a1eeab4fdbba09e2463a7119b9 (127.7.39.1:38023), 7e844fa8c4c2497bbad97852d6dfbbda (127.7.39.3:36445)
I20260809 19:09:17.922057 10458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "041cf3dbde9a4760bb2086592b3c52f8" candidate_uuid: "681671877b2445079dfb22bf4e0a0d80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64d003a1eeab4fdbba09e2463a7119b9"
I20260809 19:09:17.922091 10924 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "041cf3dbde9a4760bb2086592b3c52f8" candidate_uuid: "681671877b2445079dfb22bf4e0a0d80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e844fa8c4c2497bbad97852d6dfbbda"
I20260809 19:09:17.922262 10458 raft_consensus.cc:3037] T 041cf3dbde9a4760bb2086592b3c52f8 P 64d003a1eeab4fdbba09e2463a7119b9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:17.922329 10924 raft_consensus.cc:3037] T 041cf3dbde9a4760bb2086592b3c52f8 P 7e844fa8c4c2497bbad97852d6dfbbda [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:17.924258 10458 raft_consensus.cc:2454] T 041cf3dbde9a4760bb2086592b3c52f8 P 64d003a1eeab4fdbba09e2463a7119b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681671877b2445079dfb22bf4e0a0d80 in term 1.
I20260809 19:09:17.924688 10565 leader_election.cc:302] T 041cf3dbde9a4760bb2086592b3c52f8 P 681671877b2445079dfb22bf4e0a0d80 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64d003a1eeab4fdbba09e2463a7119b9, 681671877b2445079dfb22bf4e0a0d80; no voters:
I20260809 19:09:17.924968 11111 raft_consensus.cc:2781] T 041cf3dbde9a4760bb2086592b3c52f8 P 681671877b2445079dfb22bf4e0a0d80 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:09:17.925118 11111 raft_consensus.cc:686] T 041cf3dbde9a4760bb2086592b3c52f8 P 681671877b2445079dfb22bf4e0a0d80 [term 1 LEADER]: Becoming Leader. State: Replica: 681671877b2445079dfb22bf4e0a0d80, State: Running, Role: LEADER
I20260809 19:09:17.925181 10924 raft_consensus.cc:2454] T 041cf3dbde9a4760bb2086592b3c52f8 P 7e844fa8c4c2497bbad97852d6dfbbda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681671877b2445079dfb22bf4e0a0d80 in term 1.
I20260809 19:09:17.925424 11111 consensus_queue.cc:237] T 041cf3dbde9a4760bb2086592b3c52f8 P 681671877b2445079dfb22bf4e0a0d80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } }
I20260809 19:09:17.928225 10178 catalog_manager.cc:5495] T 041cf3dbde9a4760bb2086592b3c52f8 P 681671877b2445079dfb22bf4e0a0d80 reported cstate change: term changed from 0 to 1, leader changed from <none> to 681671877b2445079dfb22bf4e0a0d80 (127.7.39.2). New cstate: current_term: 1 leader_uuid: "681671877b2445079dfb22bf4e0a0d80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681671877b2445079dfb22bf4e0a0d80" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 } health_report { overall_health: UNKNOWN } } }
I20260809 19:09:17.996150 10458 raft_consensus.cc:1261] T 041cf3dbde9a4760bb2086592b3c52f8 P 64d003a1eeab4fdbba09e2463a7119b9 [term 1 FOLLOWER]: Refusing update from remote peer 681671877b2445079dfb22bf4e0a0d80: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:09:17.996213 10915 raft_consensus.cc:1261] T 041cf3dbde9a4760bb2086592b3c52f8 P 7e844fa8c4c2497bbad97852d6dfbbda [term 1 FOLLOWER]: Refusing update from remote peer 681671877b2445079dfb22bf4e0a0d80: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:09:17.996829 11192 consensus_queue.cc:1035] T 041cf3dbde9a4760bb2086592b3c52f8 P 681671877b2445079dfb22bf4e0a0d80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64d003a1eeab4fdbba09e2463a7119b9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:09:17.997251 11133 consensus_queue.cc:1035] T 041cf3dbde9a4760bb2086592b3c52f8 P 681671877b2445079dfb22bf4e0a0d80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e844fa8c4c2497bbad97852d6dfbbda" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 19:09:18.020893 11113 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 19:09:19.607779 10178 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50136:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:09:19.608007 10178 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50136:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:09:19.611966 10178 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8a28432874cf4ec4b00485ee845290ea: Sending DeleteTablet for 3 replicas of tablet 041cf3dbde9a4760bb2086592b3c52f8
I20260809 19:09:19.612703 10421 tablet_service.cc:1514] Processing DeleteTablet for tablet 041cf3dbde9a4760bb2086592b3c52f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:09:19 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:37178
I20260809 19:09:19.612802 10642 tablet_service.cc:1514] Processing DeleteTablet for tablet 041cf3dbde9a4760bb2086592b3c52f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:09:19 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:33104
I20260809 19:09:19.612987 10887 tablet_service.cc:1514] Processing DeleteTablet for tablet 041cf3dbde9a4760bb2086592b3c52f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:09:19 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:48692
I20260809 19:09:19.613373 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 10311
I20260809 19:09:19.623936 11233 tablet_replica.cc:330] T 041cf3dbde9a4760bb2086592b3c52f8 P 7e844fa8c4c2497bbad97852d6dfbbda: stopping tablet replica
I20260809 19:09:19.624253 11233 raft_consensus.cc:2229] T 041cf3dbde9a4760bb2086592b3c52f8 P 7e844fa8c4c2497bbad97852d6dfbbda [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:09:19.624580 11233 raft_consensus.cc:2258] T 041cf3dbde9a4760bb2086592b3c52f8 P 7e844fa8c4c2497bbad97852d6dfbbda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:09:19.625685 11233 ts_tablet_manager.cc:1905] T 041cf3dbde9a4760bb2086592b3c52f8 P 7e844fa8c4c2497bbad97852d6dfbbda: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:09:19.630667 11232 tablet_replica.cc:330] T 041cf3dbde9a4760bb2086592b3c52f8 P 681671877b2445079dfb22bf4e0a0d80: stopping tablet replica
I20260809 19:09:19.630846 11232 raft_consensus.cc:2229] T 041cf3dbde9a4760bb2086592b3c52f8 P 681671877b2445079dfb22bf4e0a0d80 [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:09:19.631170 11232 raft_consensus.cc:2258] T 041cf3dbde9a4760bb2086592b3c52f8 P 681671877b2445079dfb22bf4e0a0d80 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:09:19.633253 11233 ts_tablet_manager.cc:1918] T 041cf3dbde9a4760bb2086592b3c52f8 P 7e844fa8c4c2497bbad97852d6dfbbda: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 19:09:19.633389 11233 log.cc:1196] T 041cf3dbde9a4760bb2086592b3c52f8 P 7e844fa8c4c2497bbad97852d6dfbbda: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-2/wal/wals/041cf3dbde9a4760bb2086592b3c52f8
I20260809 19:09:19.633788 11233 ts_tablet_manager.cc:1939] T 041cf3dbde9a4760bb2086592b3c52f8 P 7e844fa8c4c2497bbad97852d6dfbbda: Deleting consensus metadata
I20260809 19:09:19.634780 10162 catalog_manager.cc:4841] TS 7e844fa8c4c2497bbad97852d6dfbbda (127.7.39.3:36445): tablet 041cf3dbde9a4760bb2086592b3c52f8 (table test-table [id=df6fba57edc14d7d823c229f751eebd5]) successfully deleted
I20260809 19:09:19.634980 11232 ts_tablet_manager.cc:1905] T 041cf3dbde9a4760bb2086592b3c52f8 P 681671877b2445079dfb22bf4e0a0d80: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:09:19.638669 11231 tablet_replica.cc:330] T 041cf3dbde9a4760bb2086592b3c52f8 P 64d003a1eeab4fdbba09e2463a7119b9: stopping tablet replica
I20260809 19:09:19.638878 11231 raft_consensus.cc:2229] T 041cf3dbde9a4760bb2086592b3c52f8 P 64d003a1eeab4fdbba09e2463a7119b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:09:19.639125 11231 raft_consensus.cc:2258] T 041cf3dbde9a4760bb2086592b3c52f8 P 64d003a1eeab4fdbba09e2463a7119b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:09:19.641284 11232 ts_tablet_manager.cc:1918] T 041cf3dbde9a4760bb2086592b3c52f8 P 681671877b2445079dfb22bf4e0a0d80: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 19:09:19.641417 11232 log.cc:1196] T 041cf3dbde9a4760bb2086592b3c52f8 P 681671877b2445079dfb22bf4e0a0d80: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-1/wal/wals/041cf3dbde9a4760bb2086592b3c52f8
I20260809 19:09:19.641510 11231 ts_tablet_manager.cc:1905] T 041cf3dbde9a4760bb2086592b3c52f8 P 64d003a1eeab4fdbba09e2463a7119b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:09:19.641856 11232 ts_tablet_manager.cc:1939] T 041cf3dbde9a4760bb2086592b3c52f8 P 681671877b2445079dfb22bf4e0a0d80: Deleting consensus metadata
I20260809 19:09:19.642835 10158 catalog_manager.cc:4841] TS 681671877b2445079dfb22bf4e0a0d80 (127.7.39.2:46179): tablet 041cf3dbde9a4760bb2086592b3c52f8 (table test-table [id=df6fba57edc14d7d823c229f751eebd5]) successfully deleted
I20260809 19:09:19.646956 11231 ts_tablet_manager.cc:1918] T 041cf3dbde9a4760bb2086592b3c52f8 P 64d003a1eeab4fdbba09e2463a7119b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 19:09:19.647081 11231 log.cc:1196] T 041cf3dbde9a4760bb2086592b3c52f8 P 64d003a1eeab4fdbba09e2463a7119b9: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786302538618573-7324-0/minicluster-data/ts-0/wal/wals/041cf3dbde9a4760bb2086592b3c52f8
I20260809 19:09:19.647464 11231 ts_tablet_manager.cc:1939] T 041cf3dbde9a4760bb2086592b3c52f8 P 64d003a1eeab4fdbba09e2463a7119b9: Deleting consensus metadata
I20260809 19:09:19.648262 10159 catalog_manager.cc:4841] TS 64d003a1eeab4fdbba09e2463a7119b9 (127.7.39.1:38023): tablet 041cf3dbde9a4760bb2086592b3c52f8 (table test-table [id=df6fba57edc14d7d823c229f751eebd5]) successfully deleted
Aug 09 19:09:19 dist-test-slave-4tdj krb5kdc[10116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302557, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.39.1@KRBTEST.COM
I20260809 19:09:19.658088 11234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:19.614526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57880 (local address 127.7.39.1:38023)
0809 19:09:19.638491 (+ 23965us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:19.638498 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:19.638526 (+ 28us) server_negotiation.cc:407] Connection header received
0809 19:09:19.638585 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:19.638590 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:19.638667 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:19.638764 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:19.642236 (+ 3472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:19.643459 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:19.644752 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:19.645445 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:19.645591 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:19.653268 (+ 7677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:19.653282 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:19.653300 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:19.653331 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:19.655947 (+ 2616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:19.656512 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:19.656519 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:19.656521 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:19.656640 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:19.656930 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:19.656933 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:19.656935 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:19.657264 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:19.657465 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:19.657668 (+ 203us) server_negotiation.cc:299] Negotiation successful
0809 19:09:19.657827 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23729,"thread_start_us":23604,"threads_started":1}
W20260809 19:09:19.658697 10517 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57880
W20260809 19:09:19.659198 7324 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 10311: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 19:09:19.659394 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 10311
I20260809 19:09:19.683279 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 10533
Aug 09 19:09:19 dist-test-slave-4tdj krb5kdc[10116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302557, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.39.2@KRBTEST.COM
I20260809 19:09:19.697086 11238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:19.683889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55884 (local address 127.7.39.2:46179)
0809 19:09:19.684352 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:19.684356 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:19.684372 (+ 16us) server_negotiation.cc:407] Connection header received
0809 19:09:19.684422 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:19.684425 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:19.684482 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:19.684577 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:19.685803 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:19.686693 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:19.687831 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:19.688205 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:19.688294 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:19.692024 (+ 3730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:19.692036 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:19.692051 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:19.692088 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:19.694570 (+ 2482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:19.695176 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:19.695183 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:19.695185 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:19.695333 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:19.695667 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:19.695671 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:19.695673 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:19.696009 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:19.696298 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:19.696573 (+ 275us) server_negotiation.cc:299] Negotiation successful
0809 19:09:19.696777 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":234,"threads_started":1}
W20260809 19:09:19.697705 10763 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55884
W20260809 19:09:19.698244 7324 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 10533: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 19:09:19.698403 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 10533
I20260809 19:09:19.727742 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 10772
Aug 09 19:09:19 dist-test-slave-4tdj krb5kdc[10116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302557, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.39.3@KRBTEST.COM
I20260809 19:09:19.741700 11240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:19.728465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46312 (local address 127.7.39.3:36445)
0809 19:09:19.728969 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:19.728973 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:19.728991 (+ 18us) server_negotiation.cc:407] Connection header received
0809 19:09:19.729043 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:19.729046 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:19.729103 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:19.729185 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:19.730363 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:19.731102 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:19.732220 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:19.732607 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:19.732720 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:19.736682 (+ 3962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:19.736696 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:19.736713 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:19.736748 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:19.739394 (+ 2646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:19.740000 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:19.740007 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:19.740010 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:19.740155 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:19.740457 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:19.740460 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:19.740462 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:19.740792 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:19.740999 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:19.741187 (+ 188us) server_negotiation.cc:299] Negotiation successful
0809 19:09:19.741340 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":279,"threads_started":1}
W20260809 19:09:19.742363 10990 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46312
W20260809 19:09:19.742962 7324 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 10772: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 19:09:19.743113 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 10772
I20260809 19:09:19.767917 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 10134
I20260809 19:09:19.768981 10259 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:19.880846 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 10134
2026-08-09T19:09:19Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (8190 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:09:19 dist-test-slave-4tdj krb5kdc[11245](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:09:19 dist-test-slave-4tdj krb5kdc[11245](info): set up 2 sockets
Aug 09 19:09:19 dist-test-slave-4tdj krb5kdc[11245](info): commencing operation
krb5kdc: starting...
W20260809 19:09:21.075730 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.148s user 0.002s sys 0.015s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:09:21 dist-test-slave-4tdj krb5kdc[11245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302561, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:09:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:09:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.39.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
I20260809 19:09:21.249409 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:44075
--webserver_interface=127.7.39.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:42053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:44075
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:21.556835 11262 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:21.557087 11262 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:21.557197 11262 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:21.563948 11262 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:09:21.564041 11262 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:21.564113 11262 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:21.564183 11262 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:09:21.564241 11262 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:09:21.573298 11262 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:42053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:44075
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:44075
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:21.574421 11262 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:21.575683 11262 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:21.586429 11269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:21.586488 11270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:21.586513 11272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:21.587210 11262 server_base.cc:1034] running on GCE node
I20260809 19:09:21.587890 11262 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:21.589093 11262 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:21.590284 11262 hybrid_clock.cc:648] HybridClock initialized: now 1786302561590237 us; error 39 us; skew 500 ppm
I20260809 19:09:21.590617 11262 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:21 dist-test-slave-4tdj krb5kdc[11245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302561, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:21.593367 11262 init.cc:377] Logged in from keytab as kudu/127.7.39.62@KRBTEST.COM (short username kudu)
I20260809 19:09:21.594731 11262 webserver.cc:460] Webserver started at http://127.7.39.62:33173/ using document root <none> and password file <none>
I20260809 19:09:21.595323 11262 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:21.595435 11262 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:21.595724 11262 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:21.598475 11262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "7d6390d5266d4e63bed54c4793384b62"
format_stamp: "Formatted at 2026-08-09 19:09:21 on dist-test-slave-4tdj"
server_key: "228fe414ae12cbff6625a9037b09b9bb"
server_key_iv: "3e4a98fc13defe7ab947c6fd5ba8b986"
server_key_version: "encryptionkey@0"
I20260809 19:09:21.599200 11262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "7d6390d5266d4e63bed54c4793384b62"
format_stamp: "Formatted at 2026-08-09 19:09:21 on dist-test-slave-4tdj"
server_key: "228fe414ae12cbff6625a9037b09b9bb"
server_key_iv: "3e4a98fc13defe7ab947c6fd5ba8b986"
server_key_version: "encryptionkey@0"
I20260809 19:09:21.603847 11262 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 19:09:21.607000 11287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:21.608239 11262 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:09:21.608388 11262 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "7d6390d5266d4e63bed54c4793384b62"
format_stamp: "Formatted at 2026-08-09 19:09:21 on dist-test-slave-4tdj"
server_key: "228fe414ae12cbff6625a9037b09b9bb"
server_key_iv: "3e4a98fc13defe7ab947c6fd5ba8b986"
server_key_version: "encryptionkey@0"
I20260809 19:09:21.608566 11262 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:21.631188 11262 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:21.634712 11262 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:21.634949 11262 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:21.651510 11262 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:44075
I20260809 19:09:21.651543 11357 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:44075 every 8 connection(s)
I20260809 19:09:21.652774 11262 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:09:21.654632 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 11262
I20260809 19:09:21.654881 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:09:21.655776 7324 external_mini_cluster.cc:1428] Setting key 08a5ce3e8438e1d54c0f832951239391
I20260809 19:09:21.657233 11358 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 19:09:21 dist-test-slave-4tdj krb5kdc[11245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302561, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:21.670907 11358 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d6390d5266d4e63bed54c4793384b62: Bootstrap starting.
I20260809 19:09:21.673987 11358 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7d6390d5266d4e63bed54c4793384b62: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:21.675066 11358 log.cc:824] T 00000000000000000000000000000000 P 7d6390d5266d4e63bed54c4793384b62: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:21.678427 11358 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d6390d5266d4e63bed54c4793384b62: No bootstrap required, opened a new log
I20260809 19:09:21.679929 11366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:21.657869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58328 (local address 127.7.39.62:44075)
0809 19:09:21.658624 (+ 755us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:21.658635 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:21.658675 (+ 40us) server_negotiation.cc:407] Connection header received
0809 19:09:21.660573 (+ 1898us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:21.660595 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:21.660951 (+ 356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:21.661278 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:21.663095 (+ 1817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:21.664496 (+ 1401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:21.666189 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:21.666938 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:21.667098 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:21.671681 (+ 4583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:21.671689 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:21.671702 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:21.671739 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:21.674831 (+ 3092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:21.675599 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:21.675608 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:21.675617 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:21.675866 (+ 249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:21.676221 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:21.676227 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:21.676230 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:21.676932 (+ 702us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:21.677245 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:21.677996 (+ 751us) server_negotiation.cc:299] Negotiation successful
0809 19:09:21.678549 (+ 553us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":569,"thread_start_us":344,"threads_started":1}
I20260809 19:09:21.686106 11358 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7d6390d5266d4e63bed54c4793384b62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d6390d5266d4e63bed54c4793384b62" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 44075 } }
I20260809 19:09:21.686465 11358 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7d6390d5266d4e63bed54c4793384b62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:21.686555 11358 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7d6390d5266d4e63bed54c4793384b62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d6390d5266d4e63bed54c4793384b62, State: Initialized, Role: FOLLOWER
I20260809 19:09:21.687074 11358 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7d6390d5266d4e63bed54c4793384b62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d6390d5266d4e63bed54c4793384b62" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 44075 } }
I20260809 19:09:21.687325 11358 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7d6390d5266d4e63bed54c4793384b62 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:09:21.687464 11358 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7d6390d5266d4e63bed54c4793384b62 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:09:21.687652 11358 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7d6390d5266d4e63bed54c4793384b62 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:21.689729 11358 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7d6390d5266d4e63bed54c4793384b62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d6390d5266d4e63bed54c4793384b62" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 44075 } }
I20260809 19:09:21.690187 11358 leader_election.cc:302] T 00000000000000000000000000000000 P 7d6390d5266d4e63bed54c4793384b62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7d6390d5266d4e63bed54c4793384b62; no voters:
I20260809 19:09:21.690724 11358 leader_election.cc:288] T 00000000000000000000000000000000 P 7d6390d5266d4e63bed54c4793384b62 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:09:21.690837 11368 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7d6390d5266d4e63bed54c4793384b62 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:09:21.691452 11368 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7d6390d5266d4e63bed54c4793384b62 [term 1 LEADER]: Becoming Leader. State: Replica: 7d6390d5266d4e63bed54c4793384b62, State: Running, Role: LEADER
I20260809 19:09:21.691951 11368 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7d6390d5266d4e63bed54c4793384b62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d6390d5266d4e63bed54c4793384b62" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 44075 } }
I20260809 19:09:21.692757 11358 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7d6390d5266d4e63bed54c4793384b62 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:09:21.694720 11371 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d6390d5266d4e63bed54c4793384b62 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7d6390d5266d4e63bed54c4793384b62. Latest consensus state: current_term: 1 leader_uuid: "7d6390d5266d4e63bed54c4793384b62" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d6390d5266d4e63bed54c4793384b62" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 44075 } } }
I20260809 19:09:21.695099 11371 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d6390d5266d4e63bed54c4793384b62 [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:21.698486 11370 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d6390d5266d4e63bed54c4793384b62 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7d6390d5266d4e63bed54c4793384b62" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d6390d5266d4e63bed54c4793384b62" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 44075 } } }
I20260809 19:09:21.698884 11370 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d6390d5266d4e63bed54c4793384b62 [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:21.699129 11382 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:09:21.703809 11382 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:09:21.711021 11382 catalog_manager.cc:1347] Generated new cluster ID: f35676b6b136477a84a5cad6661ccd00
I20260809 19:09:21.711117 11382 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:09:21.719898 11382 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:09:21.721635 11382 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:09:21.734375 11382 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7d6390d5266d4e63bed54c4793384b62: Generated new TSK 0
I20260809 19:09:21.735110 11382 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.39.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
I20260809 19:09:21.783782 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.1:0
--local_ip_for_outbound_sockets=127.7.39.1
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:44075
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:42053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:22.095474 11405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:22.095739 11405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:22.095865 11405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:22.102844 11405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:22.102943 11405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:22.103088 11405 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.1
I20260809 19:09:22.112634 11405 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:42053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:44075
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.1
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:22.113812 11405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:22.115087 11405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:22.127177 11416 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:22.127138 11419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:22.127207 11417 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:22.128273 11405 server_base.cc:1034] running on GCE node
I20260809 19:09:22.128831 11405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:22.129669 11405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:22.130864 11405 hybrid_clock.cc:648] HybridClock initialized: now 1786302562130823 us; error 27 us; skew 500 ppm
I20260809 19:09:22.131150 11405 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:22 dist-test-slave-4tdj krb5kdc[11245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302562, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:22.134016 11405 init.cc:377] Logged in from keytab as kudu/127.7.39.1@KRBTEST.COM (short username kudu)
I20260809 19:09:22.135403 11405 webserver.cc:460] Webserver started at http://127.7.39.1:44669/ using document root <none> and password file <none>
I20260809 19:09:22.136046 11405 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:22.136164 11405 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:22.136452 11405 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:22.139417 11405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-0/data/instance:
uuid: "930b274039f94f99976a93b29441eddd"
format_stamp: "Formatted at 2026-08-09 19:09:22 on dist-test-slave-4tdj"
server_key: "d91ca4932ed68df2bd88e050f842f31b"
server_key_iv: "ae9be843debd23c29f3682fc2109f269"
server_key_version: "encryptionkey@0"
I20260809 19:09:22.140166 11405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance:
uuid: "930b274039f94f99976a93b29441eddd"
format_stamp: "Formatted at 2026-08-09 19:09:22 on dist-test-slave-4tdj"
server_key: "d91ca4932ed68df2bd88e050f842f31b"
server_key_iv: "ae9be843debd23c29f3682fc2109f269"
server_key_version: "encryptionkey@0"
I20260809 19:09:22.145145 11405 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 19:09:22.148444 11427 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:22.149672 11405 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 19:09:22.149820 11405 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-0/wal
uuid: "930b274039f94f99976a93b29441eddd"
format_stamp: "Formatted at 2026-08-09 19:09:22 on dist-test-slave-4tdj"
server_key: "d91ca4932ed68df2bd88e050f842f31b"
server_key_iv: "ae9be843debd23c29f3682fc2109f269"
server_key_version: "encryptionkey@0"
I20260809 19:09:22.149991 11405 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:22.174584 11405 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:22.178149 11405 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:22.178442 11405 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:22.179316 11405 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:09:22.180557 11405 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:22.180634 11405 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:22.180749 11405 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:22.180802 11405 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:22.212909 11405 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.1:45157
I20260809 19:09:22.212968 11606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.1:45157 every 8 connection(s)
I20260809 19:09:22.214051 11405 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
I20260809 19:09:22.219031 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 11405
I20260809 19:09:22.219236 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance
I20260809 19:09:22.219808 7324 external_mini_cluster.cc:1428] Setting key f3368eb904fca7d897a2ca7ad268d931
Aug 09 19:09:22 dist-test-slave-4tdj krb5kdc[11245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302562, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:22.232702 11609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:22.216357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:52909 (local address 127.7.39.62:44075)
0809 19:09:22.216758 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:22.216762 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:22.217617 (+ 855us) server_negotiation.cc:407] Connection header received
0809 19:09:22.219436 (+ 1819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:22.219442 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:22.219521 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:22.219623 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:22.221156 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:22.221926 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:22.223417 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:22.223822 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:22.223931 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:22.227282 (+ 3351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:22.227286 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:22.227290 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:22.227319 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:22.229853 (+ 2534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:22.230561 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:22.230565 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:22.230568 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:22.230686 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:22.231088 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:22.231091 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:22.231093 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:22.231357 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:22.231485 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:22.232135 (+ 650us) server_negotiation.cc:299] Negotiation successful
0809 19:09:22.232346 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":216,"threads_started":1}
I20260809 19:09:22.233629 11610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:22.216799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:44075 (local address 127.7.39.1:52909)
0809 19:09:22.217470 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:22.217506 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:22.219184 (+ 1678us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:22.219852 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:22.219859 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:22.220363 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:22.220993 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:22.221011 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:22.222068 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:22.222072 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:22.223281 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:22.223293 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:22.224031 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:22.224049 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:22.224250 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:22.224878 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:22.224900 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:22.227079 (+ 2179us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:22.229978 (+ 2899us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:22.229987 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:22.230002 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:22.230446 (+ 444us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:22.230785 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:22.230790 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:22.230794 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:22.230971 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:22.231483 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:22.231491 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:22.231785 (+ 294us) client_negotiation.cc:769] Sending connection context
0809 19:09:22.232008 (+ 223us) client_negotiation.cc:240] Negotiation successful
0809 19:09:22.232479 (+ 471us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":265,"threads_started":1}
I20260809 19:09:22.235321 11607 heartbeater.cc:347] Connected to a master server at 127.7.39.62:44075
I20260809 19:09:22.235608 11607 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:22.236256 11607 heartbeater.cc:511] Master 127.7.39.62:44075 requested a full tablet report, sending...
I20260809 19:09:22.238547 11308 ts_manager.cc:194] Registered new tserver with Master: 930b274039f94f99976a93b29441eddd (127.7.39.1:45157)
WARNING: no policy specified for kudu/127.7.39.2@KRBTEST.COM; defaulting to no policy
I20260809 19:09:22.240099 11308 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.1@KRBTEST.COM'} at 127.7.39.1:52909
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
I20260809 19:09:22.263206 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.2:0
--local_ip_for_outbound_sockets=127.7.39.2
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:44075
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:42053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:22.569264 11617 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:22.569520 11617 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:22.569615 11617 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:22.576444 11617 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:22.576545 11617 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:22.576659 11617 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.2
I20260809 19:09:22.585659 11617 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:42053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:44075
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.2
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:22.586797 11617 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:22.588008 11617 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:22.600244 11625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:22.600179 11626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:22.600221 11632 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:22.601123 11617 server_base.cc:1034] running on GCE node
I20260809 19:09:22.601694 11617 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:22.602595 11617 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:22.603791 11617 hybrid_clock.cc:648] HybridClock initialized: now 1786302562603740 us; error 48 us; skew 500 ppm
I20260809 19:09:22.604075 11617 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:22 dist-test-slave-4tdj krb5kdc[11245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302562, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:22.607012 11617 init.cc:377] Logged in from keytab as kudu/127.7.39.2@KRBTEST.COM (short username kudu)
I20260809 19:09:22.608348 11617 webserver.cc:460] Webserver started at http://127.7.39.2:39527/ using document root <none> and password file <none>
I20260809 19:09:22.608945 11617 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:22.609053 11617 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:22.609310 11617 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:22.612075 11617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-1/data/instance:
uuid: "3c013f672a8e4f4b9ff351f2f69fd2fd"
format_stamp: "Formatted at 2026-08-09 19:09:22 on dist-test-slave-4tdj"
server_key: "4d97ecfd9bfea7f1967ea14f55055bd1"
server_key_iv: "bc3e52c855dd428ab67a7a40d59b6ddf"
server_key_version: "encryptionkey@0"
I20260809 19:09:22.612797 11617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance:
uuid: "3c013f672a8e4f4b9ff351f2f69fd2fd"
format_stamp: "Formatted at 2026-08-09 19:09:22 on dist-test-slave-4tdj"
server_key: "4d97ecfd9bfea7f1967ea14f55055bd1"
server_key_iv: "bc3e52c855dd428ab67a7a40d59b6ddf"
server_key_version: "encryptionkey@0"
I20260809 19:09:22.617522 11617 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 19:09:22.620675 11645 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:22.621860 11617 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 19:09:22.621994 11617 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-1/wal
uuid: "3c013f672a8e4f4b9ff351f2f69fd2fd"
format_stamp: "Formatted at 2026-08-09 19:09:22 on dist-test-slave-4tdj"
server_key: "4d97ecfd9bfea7f1967ea14f55055bd1"
server_key_iv: "bc3e52c855dd428ab67a7a40d59b6ddf"
server_key_version: "encryptionkey@0"
I20260809 19:09:22.622172 11617 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:22.644176 11617 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:22.648098 11617 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:22.648343 11617 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:22.649225 11617 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:09:22.650494 11617 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:22.650568 11617 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:22.650674 11617 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:22.650723 11617 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:22.681602 11617 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.2:38023
I20260809 19:09:22.681679 11832 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.2:38023 every 8 connection(s)
I20260809 19:09:22.683107 11617 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
I20260809 19:09:22.687924 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 11617
I20260809 19:09:22.688090 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance
I20260809 19:09:22.688488 7324 external_mini_cluster.cc:1428] Setting key 67bdc6d7b1d48ddbbc548b657f2f71fb
Aug 09 19:09:22 dist-test-slave-4tdj krb5kdc[11245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302562, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:22.702351 11609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:22.685522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:46043 (local address 127.7.39.62:44075)
0809 19:09:22.685691 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:22.685696 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:22.686811 (+ 1115us) server_negotiation.cc:407] Connection header received
0809 19:09:22.688637 (+ 1826us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:22.688642 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:22.688725 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:22.688833 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:22.690356 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:22.691056 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:22.692512 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:22.693009 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:22.693117 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:22.696571 (+ 3454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:22.696577 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:22.696582 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:22.696619 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:22.699584 (+ 2965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:22.700234 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:22.700244 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:22.700246 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:22.700380 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:22.700770 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:22.700773 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:22.700775 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:22.701030 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:22.701161 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:22.701777 (+ 616us) server_negotiation.cc:299] Negotiation successful
0809 19:09:22.701998 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 19:09:22.703222 11836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:22.685935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:44075 (local address 127.7.39.2:46043)
0809 19:09:22.686667 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:22.686703 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:22.688379 (+ 1676us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:22.689003 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:22.689010 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:22.689597 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:22.690185 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:22.690205 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:22.691198 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:22.691202 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:22.692371 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:22.692382 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:22.693218 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:22.693226 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:22.693425 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:22.694021 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:22.694043 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:22.696352 (+ 2309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:22.699704 (+ 3352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:22.699710 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:22.699721 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:22.700118 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:22.700485 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:22.700488 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:22.700491 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:22.700665 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:22.701160 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:22.701168 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:22.701442 (+ 274us) client_negotiation.cc:769] Sending connection context
0809 19:09:22.701669 (+ 227us) client_negotiation.cc:240] Negotiation successful
0809 19:09:22.702144 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":304,"threads_started":1}
I20260809 19:09:22.704490 11833 heartbeater.cc:347] Connected to a master server at 127.7.39.62:44075
I20260809 19:09:22.704759 11833 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:22.705403 11833 heartbeater.cc:511] Master 127.7.39.62:44075 requested a full tablet report, sending...
I20260809 19:09:22.706729 11308 ts_manager.cc:194] Registered new tserver with Master: 3c013f672a8e4f4b9ff351f2f69fd2fd (127.7.39.2:38023)
WARNING: no policy specified for kudu/127.7.39.3@KRBTEST.COM; defaulting to no policy
I20260809 19:09:22.707494 11308 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.2@KRBTEST.COM'} at 127.7.39.2:46043
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
I20260809 19:09:22.729264 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.3:0
--local_ip_for_outbound_sockets=127.7.39.3
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:44075
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:42053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:23.037878 11841 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:23.038151 11841 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:23.038470 11841 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:23.045572 11841 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:23.045682 11841 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:23.045845 11841 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.3
I20260809 19:09:23.055330 11841 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:42053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:44075
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.3
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:23.056505 11841 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:23.057754 11841 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:23.070096 11850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:23.070194 11851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:23.070155 11854 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:23.071031 11841 server_base.cc:1034] running on GCE node
I20260809 19:09:23.071650 11841 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:23.072510 11841 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:23.073726 11841 hybrid_clock.cc:648] HybridClock initialized: now 1786302563073679 us; error 38 us; skew 500 ppm
I20260809 19:09:23.073992 11841 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:23 dist-test-slave-4tdj krb5kdc[11245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302563, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:23.076915 11841 init.cc:377] Logged in from keytab as kudu/127.7.39.3@KRBTEST.COM (short username kudu)
I20260809 19:09:23.078190 11841 webserver.cc:460] Webserver started at http://127.7.39.3:36751/ using document root <none> and password file <none>
I20260809 19:09:23.078828 11841 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:23.078927 11841 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:23.079171 11841 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:23.081890 11841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-2/data/instance:
uuid: "c7c080ab396d4b969d130bb524ba504c"
format_stamp: "Formatted at 2026-08-09 19:09:23 on dist-test-slave-4tdj"
server_key: "122a441cd9f77023372bd1ac5d697bd0"
server_key_iv: "3a1dd32dc91d90608dce6a70ddcf0499"
server_key_version: "encryptionkey@0"
I20260809 19:09:23.082643 11841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance:
uuid: "c7c080ab396d4b969d130bb524ba504c"
format_stamp: "Formatted at 2026-08-09 19:09:23 on dist-test-slave-4tdj"
server_key: "122a441cd9f77023372bd1ac5d697bd0"
server_key_iv: "3a1dd32dc91d90608dce6a70ddcf0499"
server_key_version: "encryptionkey@0"
I20260809 19:09:23.087387 11841 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260809 19:09:23.090575 11871 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:23.091775 11841 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 19:09:23.091917 11841 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-2/wal
uuid: "c7c080ab396d4b969d130bb524ba504c"
format_stamp: "Formatted at 2026-08-09 19:09:23 on dist-test-slave-4tdj"
server_key: "122a441cd9f77023372bd1ac5d697bd0"
server_key_iv: "3a1dd32dc91d90608dce6a70ddcf0499"
server_key_version: "encryptionkey@0"
I20260809 19:09:23.092083 11841 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:23.105472 11841 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:23.108882 11841 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:23.109133 11841 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:23.109997 11841 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:09:23.111380 11841 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:23.111450 11841 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:23.111569 11841 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:23.111624 11841 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:23.139952 11841 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.3:33089
I20260809 19:09:23.140012 12040 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.3:33089 every 8 connection(s)
I20260809 19:09:23.141088 11841 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
I20260809 19:09:23.143844 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 11841
I20260809 19:09:23.144012 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance
I20260809 19:09:23.144522 7324 external_mini_cluster.cc:1428] Setting key 38006e36f3dd5a091d01fb86774351fa
Aug 09 19:09:23 dist-test-slave-4tdj krb5kdc[11245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302563, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:23.159641 11609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:23.143488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:36835 (local address 127.7.39.62:44075)
0809 19:09:23.143719 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:23.143726 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:23.144928 (+ 1202us) server_negotiation.cc:407] Connection header received
0809 19:09:23.147020 (+ 2092us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:23.147025 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:23.147114 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:23.147203 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:23.148662 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:23.149389 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:23.150912 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:23.151318 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:23.151428 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:23.154610 (+ 3182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:23.154616 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:23.154619 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:23.154650 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:23.156829 (+ 2179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:23.157476 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:23.157481 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:23.157483 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:23.157595 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:23.157992 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:23.157996 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:23.157998 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:23.158279 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:23.158438 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:23.159101 (+ 663us) server_negotiation.cc:299] Negotiation successful
0809 19:09:23.159319 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260809 19:09:23.160460 12044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:23.143929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:44075 (local address 127.7.39.3:36835)
0809 19:09:23.144759 (+ 830us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:23.144808 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:23.146787 (+ 1979us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:23.147435 (+ 648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:23.147445 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:23.147979 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:23.148500 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:23.148516 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:23.149524 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:23.149529 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:23.150783 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:23.150794 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:23.151525 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:23.151533 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:23.151758 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:23.152266 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:23.152286 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:23.154417 (+ 2131us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:23.156958 (+ 2541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:23.156966 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:23.156981 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:23.157356 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:23.157698 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:23.157703 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:23.157707 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:23.157882 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:23.158417 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:23.158424 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:23.158727 (+ 303us) client_negotiation.cc:769] Sending connection context
0809 19:09:23.158939 (+ 212us) client_negotiation.cc:240] Negotiation successful
0809 19:09:23.159395 (+ 456us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":293,"threads_started":1}
I20260809 19:09:23.161600 12041 heartbeater.cc:347] Connected to a master server at 127.7.39.62:44075
I20260809 19:09:23.161868 12041 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:23.162554 12041 heartbeater.cc:511] Master 127.7.39.62:44075 requested a full tablet report, sending...
I20260809 19:09:23.163805 11308 ts_manager.cc:194] Registered new tserver with Master: c7c080ab396d4b969d130bb524ba504c (127.7.39.3:33089)
I20260809 19:09:23.164551 11308 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.3@KRBTEST.COM'} at 127.7.39.3:36835
I20260809 19:09:23.171271 7324 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 19:09:23.201990 11609 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:09:23.199692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58344 (local address 127.7.39.62:44075)
0809 19:09:23.199871 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:23.199876 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:23.200328 (+ 452us) server_negotiation.cc:407] Connection header received
0809 19:09:23.200490 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:23.200494 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:23.200563 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:23.200641 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:23.201772 (+ 1131us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58344: BlockingRecv error: recv got EOF from 127.0.0.1:58344 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 19:09:23.205305 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 11405
W20260809 19:09:23.207765 7324 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 11405: Not authorized: Client connection negotiation failed: client connection to 127.7.39.1:45157: server requires authentication, but client does not have Kerberos credentials available
I20260809 19:09:23.207911 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 11405
I20260809 19:09:23.228572 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 11617
W20260809 19:09:23.231009 7324 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 11617: Not authorized: Client connection negotiation failed: client connection to 127.7.39.2:38023: server requires authentication, but client does not have Kerberos credentials available
I20260809 19:09:23.231146 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 11617
I20260809 19:09:23.257292 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 11841
W20260809 19:09:23.259852 7324 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 11841: Not authorized: Client connection negotiation failed: client connection to 127.7.39.3:33089: server requires authentication, but client does not have Kerberos credentials available
I20260809 19:09:23.259974 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 11841
I20260809 19:09:23.279297 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 11262
I20260809 19:09:23.280375 11352 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:23.377808 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 11262
2026-08-09T19:09:23Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (3494 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:09:23 dist-test-slave-4tdj krb5kdc[12065](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:09:23 dist-test-slave-4tdj krb5kdc[12065](info): set up 2 sockets
Aug 09 19:09:23 dist-test-slave-4tdj krb5kdc[12065](info): commencing operation
krb5kdc: starting...
W20260809 19:09:24.574998 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.152s user 0.004s sys 0.014s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:09:24 dist-test-slave-4tdj krb5kdc[12065](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302564, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:09:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:09:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.39.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
I20260809 19:09:24.740734 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:37989
--webserver_interface=127.7.39.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:36159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:37989
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:25.050894 12081 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:25.051163 12081 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:25.051285 12081 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:25.058192 12081 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:09:25.058284 12081 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:25.058379 12081 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:25.058450 12081 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:09:25.058517 12081 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:09:25.067927 12081 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:36159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:37989
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:37989
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:25.069068 12081 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:25.070369 12081 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:25.081149 12090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:25.081218 12092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:25.081168 12095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:25.082509 12081 server_base.cc:1034] running on GCE node
I20260809 19:09:25.083207 12081 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:25.084420 12081 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:25.085608 12081 hybrid_clock.cc:648] HybridClock initialized: now 1786302565085561 us; error 41 us; skew 500 ppm
I20260809 19:09:25.085886 12081 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:25 dist-test-slave-4tdj krb5kdc[12065](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302565, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:25.092371 12081 init.cc:377] Logged in from keytab as kudu/127.7.39.62@KRBTEST.COM (short username kudu)
I20260809 19:09:25.093775 12081 webserver.cc:460] Webserver started at http://127.7.39.62:35663/ using document root <none> and password file <none>
I20260809 19:09:25.094415 12081 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:25.094517 12081 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:25.094774 12081 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:25.097505 12081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "f56be6ea707f404793439a6c018887ad"
format_stamp: "Formatted at 2026-08-09 19:09:25 on dist-test-slave-4tdj"
server_key: "77cd78520013f3caa3b08bcdaf2fbf1b"
server_key_iv: "f77c10798b9591bd57b17f9d28c999bd"
server_key_version: "encryptionkey@0"
I20260809 19:09:25.098204 12081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "f56be6ea707f404793439a6c018887ad"
format_stamp: "Formatted at 2026-08-09 19:09:25 on dist-test-slave-4tdj"
server_key: "77cd78520013f3caa3b08bcdaf2fbf1b"
server_key_iv: "f77c10798b9591bd57b17f9d28c999bd"
server_key_version: "encryptionkey@0"
I20260809 19:09:25.102861 12081 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 19:09:25.105979 12105 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:25.107213 12081 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 19:09:25.107338 12081 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "f56be6ea707f404793439a6c018887ad"
format_stamp: "Formatted at 2026-08-09 19:09:25 on dist-test-slave-4tdj"
server_key: "77cd78520013f3caa3b08bcdaf2fbf1b"
server_key_iv: "f77c10798b9591bd57b17f9d28c999bd"
server_key_version: "encryptionkey@0"
I20260809 19:09:25.107483 12081 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:25.124814 12081 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:25.128559 12081 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:25.128767 12081 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:25.145236 12081 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:37989
I20260809 19:09:25.145295 12185 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:37989 every 8 connection(s)
I20260809 19:09:25.146432 12081 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:09:25.149785 12186 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:25.154649 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 12081
I20260809 19:09:25.154850 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:09:25.155627 7324 external_mini_cluster.cc:1428] Setting key 5de752782a39d9e0899aa1e785059531
I20260809 19:09:25.160718 12186 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f56be6ea707f404793439a6c018887ad: Bootstrap starting.
I20260809 19:09:25.164206 12186 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f56be6ea707f404793439a6c018887ad: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:25.165433 12186 log.cc:824] T 00000000000000000000000000000000 P f56be6ea707f404793439a6c018887ad: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:25.168645 12186 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f56be6ea707f404793439a6c018887ad: No bootstrap required, opened a new log
Aug 09 19:09:25 dist-test-slave-4tdj krb5kdc[12065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302564, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:25.176184 12186 raft_consensus.cc:348] T 00000000000000000000000000000000 P f56be6ea707f404793439a6c018887ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f56be6ea707f404793439a6c018887ad" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 37989 } }
I20260809 19:09:25.176587 12186 raft_consensus.cc:374] T 00000000000000000000000000000000 P f56be6ea707f404793439a6c018887ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:25.176688 12186 raft_consensus.cc:729] T 00000000000000000000000000000000 P f56be6ea707f404793439a6c018887ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f56be6ea707f404793439a6c018887ad, State: Initialized, Role: FOLLOWER
I20260809 19:09:25.177260 12186 consensus_queue.cc:260] T 00000000000000000000000000000000 P f56be6ea707f404793439a6c018887ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f56be6ea707f404793439a6c018887ad" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 37989 } }
I20260809 19:09:25.177462 12186 raft_consensus.cc:388] T 00000000000000000000000000000000 P f56be6ea707f404793439a6c018887ad [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:09:25.177594 12186 raft_consensus.cc:482] T 00000000000000000000000000000000 P f56be6ea707f404793439a6c018887ad [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:09:25.177748 12190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:25.157349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40860 (local address 127.7.39.62:37989)
0809 19:09:25.158120 (+ 771us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:25.158134 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:25.158177 (+ 43us) server_negotiation.cc:407] Connection header received
0809 19:09:25.159978 (+ 1801us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:25.160001 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:25.160355 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:25.160643 (+ 288us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:25.162488 (+ 1845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:25.163787 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:25.165460 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:25.166373 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:25.166558 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:25.170846 (+ 4288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:25.170854 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:25.170867 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:25.170906 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:25.173789 (+ 2883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:25.174435 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:25.174442 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:25.174448 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:25.174626 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:25.174983 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:25.174986 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:25.174988 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:25.175505 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:25.175782 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:25.176223 (+ 441us) server_negotiation.cc:299] Negotiation successful
0809 19:09:25.176621 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":543,"thread_start_us":350,"threads_started":1}
I20260809 19:09:25.177753 12186 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f56be6ea707f404793439a6c018887ad [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:25.180116 12186 raft_consensus.cc:504] T 00000000000000000000000000000000 P f56be6ea707f404793439a6c018887ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f56be6ea707f404793439a6c018887ad" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 37989 } }
I20260809 19:09:25.180625 12186 leader_election.cc:302] T 00000000000000000000000000000000 P f56be6ea707f404793439a6c018887ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f56be6ea707f404793439a6c018887ad; no voters:
I20260809 19:09:25.181156 7324 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:09:25.181176 12186 leader_election.cc:288] T 00000000000000000000000000000000 P f56be6ea707f404793439a6c018887ad [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:09:25.181280 12192 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f56be6ea707f404793439a6c018887ad [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:09:25.183341 12186 sys_catalog.cc:564] T 00000000000000000000000000000000 P f56be6ea707f404793439a6c018887ad [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:09:25.186563 12192 raft_consensus.cc:686] T 00000000000000000000000000000000 P f56be6ea707f404793439a6c018887ad [term 1 LEADER]: Becoming Leader. State: Replica: f56be6ea707f404793439a6c018887ad, State: Running, Role: LEADER
I20260809 19:09:25.187179 12192 consensus_queue.cc:237] T 00000000000000000000000000000000 P f56be6ea707f404793439a6c018887ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f56be6ea707f404793439a6c018887ad" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 37989 } }
I20260809 19:09:25.190117 12197 sys_catalog.cc:455] T 00000000000000000000000000000000 P f56be6ea707f404793439a6c018887ad [sys.catalog]: SysCatalogTable state changed. Reason: New leader f56be6ea707f404793439a6c018887ad. Latest consensus state: current_term: 1 leader_uuid: "f56be6ea707f404793439a6c018887ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f56be6ea707f404793439a6c018887ad" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 37989 } } }
I20260809 19:09:25.190085 12194 sys_catalog.cc:455] T 00000000000000000000000000000000 P f56be6ea707f404793439a6c018887ad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f56be6ea707f404793439a6c018887ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f56be6ea707f404793439a6c018887ad" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 37989 } } }
I20260809 19:09:25.190493 12197 sys_catalog.cc:458] T 00000000000000000000000000000000 P f56be6ea707f404793439a6c018887ad [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:25.190538 12194 sys_catalog.cc:458] T 00000000000000000000000000000000 P f56be6ea707f404793439a6c018887ad [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:25.191452 12207 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:09:25.201785 12207 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:09:25.218086 12207 catalog_manager.cc:1347] Generated new cluster ID: 4b4c275e6a57472c9aae9fb8c1633529
I20260809 19:09:25.218204 12207 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:09:25.235224 12207 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:09:25.237027 12207 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:09:25.244500 12207 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f56be6ea707f404793439a6c018887ad: Generated new TSK 0
I20260809 19:09:25.245528 12207 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:09:25.256956 12190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:25.249096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40872 (local address 127.7.39.62:37989)
0809 19:09:25.249239 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:25.249244 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:25.249792 (+ 548us) server_negotiation.cc:407] Connection header received
0809 19:09:25.249920 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:25.249926 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:25.250014 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:25.250141 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:25.251145 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:25.252229 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:25.253585 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:25.254239 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:25.254414 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:25.255368 (+ 954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:25.255375 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:25.255380 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:09:25.256199 (+ 819us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:25.256272 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:09:25.256307 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:25.256417 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:25.256512 (+ 95us) server_negotiation.cc:299] Negotiation successful
0809 19:09:25.256605 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 19:09:25.263818 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 12081
I20260809 19:09:25.265086 12174 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:25.352330 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 12081
2026-08-09T19:09:25Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1966 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:09:25 dist-test-slave-4tdj krb5kdc[12239](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:09:25 dist-test-slave-4tdj krb5kdc[12239](info): set up 2 sockets
Aug 09 19:09:25 dist-test-slave-4tdj krb5kdc[12239](info): commencing operation
krb5kdc: starting...
W20260809 19:09:26.533071 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.144s user 0.001s sys 0.017s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:09:26 dist-test-slave-4tdj krb5kdc[12239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302566, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:09:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:09:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.39.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
I20260809 19:09:26.706593 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:34249
--webserver_interface=127.7.39.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:34069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:34249
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:27.010800 12259 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:27.011073 12259 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:27.011202 12259 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:27.018175 12259 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:09:27.018268 12259 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:27.018369 12259 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:27.018446 12259 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:09:27.018513 12259 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:09:27.031585 12259 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:34069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:34249
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:34249
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:27.032881 12259 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:27.034138 12259 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:27.045162 12276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:27.045194 12277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:27.045094 12284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:27.046252 12259 server_base.cc:1034] running on GCE node
I20260809 19:09:27.046984 12259 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:27.048246 12259 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:27.049437 12259 hybrid_clock.cc:648] HybridClock initialized: now 1786302567049378 us; error 51 us; skew 500 ppm
I20260809 19:09:27.049753 12259 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:27 dist-test-slave-4tdj krb5kdc[12239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302567, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:27.052625 12259 init.cc:377] Logged in from keytab as kudu/127.7.39.62@KRBTEST.COM (short username kudu)
I20260809 19:09:27.053900 12259 webserver.cc:460] Webserver started at http://127.7.39.62:45233/ using document root <none> and password file <none>
I20260809 19:09:27.054554 12259 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:27.054656 12259 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:27.054899 12259 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:27.057641 12259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "7aa929463ad74946b95f25869d46d4a8"
format_stamp: "Formatted at 2026-08-09 19:09:27 on dist-test-slave-4tdj"
server_key: "3c46397475dd64af1898df3229bd9711"
server_key_iv: "5f6a27794bb992a534b5897106c097bb"
server_key_version: "encryptionkey@0"
I20260809 19:09:27.058352 12259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "7aa929463ad74946b95f25869d46d4a8"
format_stamp: "Formatted at 2026-08-09 19:09:27 on dist-test-slave-4tdj"
server_key: "3c46397475dd64af1898df3229bd9711"
server_key_iv: "5f6a27794bb992a534b5897106c097bb"
server_key_version: "encryptionkey@0"
I20260809 19:09:27.063139 12259 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260809 19:09:27.066224 12293 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:27.067431 12259 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 19:09:27.067612 12259 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "7aa929463ad74946b95f25869d46d4a8"
format_stamp: "Formatted at 2026-08-09 19:09:27 on dist-test-slave-4tdj"
server_key: "3c46397475dd64af1898df3229bd9711"
server_key_iv: "5f6a27794bb992a534b5897106c097bb"
server_key_version: "encryptionkey@0"
I20260809 19:09:27.067787 12259 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:27.093905 12259 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:27.097364 12259 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:27.097613 12259 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:27.113950 12259 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:34249
I20260809 19:09:27.113981 12371 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:34249 every 8 connection(s)
I20260809 19:09:27.115248 12259 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:09:27.118588 12372 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:27.120808 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 12259
I20260809 19:09:27.120997 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:09:27.121598 7324 external_mini_cluster.cc:1428] Setting key 166c135e5ff74e8532b2f5180397bd3b
I20260809 19:09:27.129558 12372 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7aa929463ad74946b95f25869d46d4a8: Bootstrap starting.
I20260809 19:09:27.133005 12372 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7aa929463ad74946b95f25869d46d4a8: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:27.134249 12372 log.cc:824] T 00000000000000000000000000000000 P 7aa929463ad74946b95f25869d46d4a8: Log is configured to *not* fsync() on all Append() calls
Aug 09 19:09:27 dist-test-slave-4tdj krb5kdc[12239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302566, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:27.137110 12372 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7aa929463ad74946b95f25869d46d4a8: No bootstrap required, opened a new log
I20260809 19:09:27.144255 12377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:27.123479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51180 (local address 127.7.39.62:34249)
0809 19:09:27.124238 (+ 759us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:27.124248 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:27.124287 (+ 39us) server_negotiation.cc:407] Connection header received
0809 19:09:27.125854 (+ 1567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:27.125874 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:27.126234 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:27.126612 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:27.128226 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:27.129463 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:27.131191 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:27.131838 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:27.131958 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:27.136316 (+ 4358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:27.136327 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:27.136345 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:27.136386 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:27.140143 (+ 3757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:27.140747 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:27.140755 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:27.140763 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:27.140971 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:27.141287 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:27.141296 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:27.141299 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:27.141950 (+ 651us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:27.142257 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:27.142570 (+ 313us) server_negotiation.cc:299] Negotiation successful
0809 19:09:27.142996 (+ 426us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":564,"thread_start_us":330,"threads_started":1}
I20260809 19:09:27.147229 12372 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7aa929463ad74946b95f25869d46d4a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aa929463ad74946b95f25869d46d4a8" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34249 } }
I20260809 19:09:27.147531 12372 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7aa929463ad74946b95f25869d46d4a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:27.147607 12372 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7aa929463ad74946b95f25869d46d4a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7aa929463ad74946b95f25869d46d4a8, State: Initialized, Role: FOLLOWER
I20260809 19:09:27.148074 12372 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7aa929463ad74946b95f25869d46d4a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aa929463ad74946b95f25869d46d4a8" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34249 } }
I20260809 19:09:27.148268 12372 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7aa929463ad74946b95f25869d46d4a8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:09:27.148393 12372 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7aa929463ad74946b95f25869d46d4a8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:09:27.148545 12372 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7aa929463ad74946b95f25869d46d4a8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:27.150558 12372 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7aa929463ad74946b95f25869d46d4a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aa929463ad74946b95f25869d46d4a8" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34249 } }
I20260809 19:09:27.150992 12372 leader_election.cc:302] T 00000000000000000000000000000000 P 7aa929463ad74946b95f25869d46d4a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7aa929463ad74946b95f25869d46d4a8; no voters:
I20260809 19:09:27.151603 12372 leader_election.cc:288] T 00000000000000000000000000000000 P 7aa929463ad74946b95f25869d46d4a8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:09:27.151690 12380 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7aa929463ad74946b95f25869d46d4a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:09:27.153417 12372 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7aa929463ad74946b95f25869d46d4a8 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:09:27.153798 12380 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7aa929463ad74946b95f25869d46d4a8 [term 1 LEADER]: Becoming Leader. State: Replica: 7aa929463ad74946b95f25869d46d4a8, State: Running, Role: LEADER
I20260809 19:09:27.154282 12380 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7aa929463ad74946b95f25869d46d4a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aa929463ad74946b95f25869d46d4a8" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34249 } }
I20260809 19:09:27.157239 12383 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7aa929463ad74946b95f25869d46d4a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7aa929463ad74946b95f25869d46d4a8. Latest consensus state: current_term: 1 leader_uuid: "7aa929463ad74946b95f25869d46d4a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aa929463ad74946b95f25869d46d4a8" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34249 } } }
I20260809 19:09:27.157212 12382 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7aa929463ad74946b95f25869d46d4a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7aa929463ad74946b95f25869d46d4a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aa929463ad74946b95f25869d46d4a8" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34249 } } }
I20260809 19:09:27.157642 12382 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7aa929463ad74946b95f25869d46d4a8 [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:27.157639 12383 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7aa929463ad74946b95f25869d46d4a8 [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:27.160458 12394 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:09:27.164268 12394 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:09:27.171768 12394 catalog_manager.cc:1347] Generated new cluster ID: 533a1f050c154e8db16d1c0298d69427
I20260809 19:09:27.171901 12394 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:09:27.199474 12394 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:09:27.200917 12394 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:09:27.209084 12394 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7aa929463ad74946b95f25869d46d4a8: Generated new TSK 0
I20260809 19:09:27.209796 12394 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.39.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
I20260809 19:09:27.259773 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.1:0
--local_ip_for_outbound_sockets=127.7.39.1
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:34249
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:34069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:27.576854 12412 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:27.577185 12412 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:27.577340 12412 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:27.584369 12412 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:27.584466 12412 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:27.584620 12412 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.1
I20260809 19:09:27.593815 12412 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:34069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:34249
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.1
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:27.595014 12412 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:27.596279 12412 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:27.609647 12417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:27.609622 12418 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:27.609854 12423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:27.610333 12412 server_base.cc:1034] running on GCE node
I20260809 19:09:27.610888 12412 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:27.611824 12412 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:27.613019 12412 hybrid_clock.cc:648] HybridClock initialized: now 1786302567612961 us; error 56 us; skew 500 ppm
I20260809 19:09:27.613304 12412 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:27 dist-test-slave-4tdj krb5kdc[12239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302567, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:27.616200 12412 init.cc:377] Logged in from keytab as kudu/127.7.39.1@KRBTEST.COM (short username kudu)
I20260809 19:09:27.617491 12412 webserver.cc:460] Webserver started at http://127.7.39.1:36781/ using document root <none> and password file <none>
I20260809 19:09:27.618117 12412 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:27.618228 12412 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:27.618528 12412 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:27.621419 12412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-0/data/instance:
uuid: "94e043ae15204a1b8ccc7a9d91d57968"
format_stamp: "Formatted at 2026-08-09 19:09:27 on dist-test-slave-4tdj"
server_key: "555498486f8e377e1ef0c3977f24ed40"
server_key_iv: "7e97953e4ef27bd524342de2c27c6dbc"
server_key_version: "encryptionkey@0"
I20260809 19:09:27.622187 12412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance:
uuid: "94e043ae15204a1b8ccc7a9d91d57968"
format_stamp: "Formatted at 2026-08-09 19:09:27 on dist-test-slave-4tdj"
server_key: "555498486f8e377e1ef0c3977f24ed40"
server_key_iv: "7e97953e4ef27bd524342de2c27c6dbc"
server_key_version: "encryptionkey@0"
I20260809 19:09:27.627228 12412 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.000s
I20260809 19:09:27.630627 12433 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:27.631861 12412 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 19:09:27.632012 12412 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-0/wal
uuid: "94e043ae15204a1b8ccc7a9d91d57968"
format_stamp: "Formatted at 2026-08-09 19:09:27 on dist-test-slave-4tdj"
server_key: "555498486f8e377e1ef0c3977f24ed40"
server_key_iv: "7e97953e4ef27bd524342de2c27c6dbc"
server_key_version: "encryptionkey@0"
I20260809 19:09:27.632200 12412 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:27.653117 12412 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:27.656761 12412 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:27.657006 12412 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:27.657852 12412 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:09:27.659205 12412 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:27.659281 12412 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:27.659390 12412 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:27.659443 12412 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:27.688705 12412 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.1:40829
I20260809 19:09:27.688824 12611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.1:40829 every 8 connection(s)
I20260809 19:09:27.689849 12412 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
I20260809 19:09:27.699033 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 12412
I20260809 19:09:27.699263 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance
I20260809 19:09:27.700075 7324 external_mini_cluster.cc:1428] Setting key 7f7eb26245a41d5434dae9bd550ec76a
Aug 09 19:09:27 dist-test-slave-4tdj krb5kdc[12239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302567, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:27.711023 12616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:27.692263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:54597 (local address 127.7.39.62:34249)
0809 19:09:27.692727 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:27.692733 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:27.693627 (+ 894us) server_negotiation.cc:407] Connection header received
0809 19:09:27.695470 (+ 1843us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:27.695475 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:27.695544 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:27.695636 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:27.697519 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:27.698641 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:27.701110 (+ 2469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:27.701526 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:27.701629 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:27.705118 (+ 3489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:27.705125 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:27.705130 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:27.705165 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:27.707971 (+ 2806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:27.708732 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:27.708741 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:27.708745 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:27.708881 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:27.709307 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:27.709310 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:27.709312 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:27.709582 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:27.709691 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:27.710417 (+ 726us) server_negotiation.cc:299] Negotiation successful
0809 19:09:27.710637 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":218,"threads_started":1}
I20260809 19:09:27.711807 12620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:27.692755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34249 (local address 127.7.39.1:54597)
0809 19:09:27.693476 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:27.693516 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:27.695223 (+ 1707us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:27.695836 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:27.695844 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:27.696507 (+ 663us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:27.697298 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:27.697327 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:27.699178 (+ 1851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:27.699184 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:27.700983 (+ 1799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:27.700996 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:27.701759 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:27.701767 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:27.702050 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:27.702695 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:27.702722 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:27.704899 (+ 2177us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:27.708115 (+ 3216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:27.708123 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:27.708139 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:27.708606 (+ 467us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:27.708977 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:27.708982 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:27.708986 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:27.709217 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:27.709697 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:27.709705 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:27.710055 (+ 350us) client_negotiation.cc:769] Sending connection context
0809 19:09:27.710275 (+ 220us) client_negotiation.cc:240] Negotiation successful
0809 19:09:27.710678 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":262,"threads_started":1}
I20260809 19:09:27.713131 12612 heartbeater.cc:347] Connected to a master server at 127.7.39.62:34249
I20260809 19:09:27.713392 12612 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:27.714071 12612 heartbeater.cc:511] Master 127.7.39.62:34249 requested a full tablet report, sending...
I20260809 19:09:27.716058 12321 ts_manager.cc:194] Registered new tserver with Master: 94e043ae15204a1b8ccc7a9d91d57968 (127.7.39.1:40829)
I20260809 19:09:27.717396 12321 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.1@KRBTEST.COM'} at 127.7.39.1:54597
WARNING: no policy specified for kudu/127.7.39.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
I20260809 19:09:27.742316 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.2:0
--local_ip_for_outbound_sockets=127.7.39.2
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:34249
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:34069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:28.047719 12624 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:28.047961 12624 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:28.048097 12624 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:28.054939 12624 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:28.055032 12624 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:28.055182 12624 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.2
I20260809 19:09:28.064239 12624 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:34069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:34249
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.2
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:28.065382 12624 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:28.066605 12624 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:28.078751 12633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:28.078790 12632 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:28.078812 12636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:28.079818 12624 server_base.cc:1034] running on GCE node
I20260809 19:09:28.080338 12624 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:28.081154 12624 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:28.082355 12624 hybrid_clock.cc:648] HybridClock initialized: now 1786302568082303 us; error 38 us; skew 500 ppm
I20260809 19:09:28.082633 12624 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:28 dist-test-slave-4tdj krb5kdc[12239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302568, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:28.085523 12624 init.cc:377] Logged in from keytab as kudu/127.7.39.2@KRBTEST.COM (short username kudu)
I20260809 19:09:28.086899 12624 webserver.cc:460] Webserver started at http://127.7.39.2:45157/ using document root <none> and password file <none>
I20260809 19:09:28.087504 12624 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:28.087607 12624 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:28.087885 12624 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:28.090667 12624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-1/data/instance:
uuid: "56cb26d4de5b41b189eab92f266c9d87"
format_stamp: "Formatted at 2026-08-09 19:09:28 on dist-test-slave-4tdj"
server_key: "14e74158eb065b5e13d38288d5220e6d"
server_key_iv: "c54452a2f6e9f95d9aec584d1f8e7497"
server_key_version: "encryptionkey@0"
I20260809 19:09:28.091399 12624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance:
uuid: "56cb26d4de5b41b189eab92f266c9d87"
format_stamp: "Formatted at 2026-08-09 19:09:28 on dist-test-slave-4tdj"
server_key: "14e74158eb065b5e13d38288d5220e6d"
server_key_iv: "c54452a2f6e9f95d9aec584d1f8e7497"
server_key_version: "encryptionkey@0"
I20260809 19:09:28.096122 12624 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 19:09:28.099409 12647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:28.100626 12624 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 19:09:28.100775 12624 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-1/wal
uuid: "56cb26d4de5b41b189eab92f266c9d87"
format_stamp: "Formatted at 2026-08-09 19:09:28 on dist-test-slave-4tdj"
server_key: "14e74158eb065b5e13d38288d5220e6d"
server_key_iv: "c54452a2f6e9f95d9aec584d1f8e7497"
server_key_version: "encryptionkey@0"
I20260809 19:09:28.100952 12624 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:28.117878 12624 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:28.122556 12624 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:28.122843 12624 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:28.124651 12624 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:09:28.126328 12624 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:28.126416 12624 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260809 19:09:28.126528 12624 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:28.126592 12624 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:28.156314 12624 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.2:44997
I20260809 19:09:28.156405 12843 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.2:44997 every 8 connection(s)
I20260809 19:09:28.157526 12624 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
I20260809 19:09:28.166555 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 12624
I20260809 19:09:28.166733 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance
I20260809 19:09:28.167259 7324 external_mini_cluster.cc:1428] Setting key 3ecd6b72c12c717439f9a8a2ff082447
Aug 09 19:09:28 dist-test-slave-4tdj krb5kdc[12239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302568, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:28.177268 12616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:28.159845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:58055 (local address 127.7.39.62:34249)
0809 19:09:28.160016 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:28.160021 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:28.161221 (+ 1200us) server_negotiation.cc:407] Connection header received
0809 19:09:28.163041 (+ 1820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:28.163046 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:28.163125 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:28.163210 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:28.164663 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:28.165433 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:28.167357 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:28.167801 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:28.167935 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:28.171739 (+ 3804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:28.171744 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:28.171748 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:28.171779 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:28.174361 (+ 2582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:28.175127 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:28.175130 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:28.175133 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:28.175251 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:28.175669 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:28.175673 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:28.175677 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:28.175985 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:28.176127 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:28.176727 (+ 600us) server_negotiation.cc:299] Negotiation successful
0809 19:09:28.176952 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 19:09:28.177979 12848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:28.160305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34249 (local address 127.7.39.2:58055)
0809 19:09:28.161061 (+ 756us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:28.161114 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:28.162787 (+ 1673us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:28.163447 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:28.163455 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:28.163920 (+ 465us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:28.164503 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:28.164521 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:28.165587 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:28.165590 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:28.167208 (+ 1618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:28.167223 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:28.168014 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:28.168021 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:28.168296 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:28.168897 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:28.168918 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:28.171543 (+ 2625us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:28.174495 (+ 2952us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:28.174503 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:28.174518 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:28.175021 (+ 503us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:28.175336 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:28.175340 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:28.175343 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:28.175568 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:28.176094 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:28.176100 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:28.176379 (+ 279us) client_negotiation.cc:769] Sending connection context
0809 19:09:28.176594 (+ 215us) client_negotiation.cc:240] Negotiation successful
0809 19:09:28.176939 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":280,"threads_started":1}
I20260809 19:09:28.179307 12844 heartbeater.cc:347] Connected to a master server at 127.7.39.62:34249
I20260809 19:09:28.179582 12844 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:28.180254 12844 heartbeater.cc:511] Master 127.7.39.62:34249 requested a full tablet report, sending...
I20260809 19:09:28.181644 12321 ts_manager.cc:194] Registered new tserver with Master: 56cb26d4de5b41b189eab92f266c9d87 (127.7.39.2:44997)
I20260809 19:09:28.182456 12321 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.2@KRBTEST.COM'} at 127.7.39.2:58055
WARNING: no policy specified for kudu/127.7.39.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
I20260809 19:09:28.208837 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.3:0
--local_ip_for_outbound_sockets=127.7.39.3
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:34249
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:34069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:28.517848 12852 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:28.518086 12852 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:28.518213 12852 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:28.525024 12852 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:28.525122 12852 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:28.525286 12852 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.3
I20260809 19:09:28.534307 12852 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:34069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:34249
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.3
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:28.535439 12852 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:28.536696 12852 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:28.548592 12869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:28.548679 12858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:28.548648 12859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:28.549316 12852 server_base.cc:1034] running on GCE node
I20260809 19:09:28.549846 12852 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:28.550719 12852 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:28.551908 12852 hybrid_clock.cc:648] HybridClock initialized: now 1786302568551859 us; error 41 us; skew 500 ppm
I20260809 19:09:28.552194 12852 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:28 dist-test-slave-4tdj krb5kdc[12239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302568, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:28.555200 12852 init.cc:377] Logged in from keytab as kudu/127.7.39.3@KRBTEST.COM (short username kudu)
I20260809 19:09:28.556586 12852 webserver.cc:460] Webserver started at http://127.7.39.3:42317/ using document root <none> and password file <none>
I20260809 19:09:28.557265 12852 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:28.557377 12852 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:28.557649 12852 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:28.560346 12852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-2/data/instance:
uuid: "406429d8c7fd4e708ada0a5ada0c34bf"
format_stamp: "Formatted at 2026-08-09 19:09:28 on dist-test-slave-4tdj"
server_key: "a5b21248fc82d6798ada3544db3ec136"
server_key_iv: "85dd1b5afcdefc766e6d225214d05513"
server_key_version: "encryptionkey@0"
I20260809 19:09:28.561085 12852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance:
uuid: "406429d8c7fd4e708ada0a5ada0c34bf"
format_stamp: "Formatted at 2026-08-09 19:09:28 on dist-test-slave-4tdj"
server_key: "a5b21248fc82d6798ada3544db3ec136"
server_key_iv: "85dd1b5afcdefc766e6d225214d05513"
server_key_version: "encryptionkey@0"
I20260809 19:09:28.565814 12852 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.001s
I20260809 19:09:28.568908 12877 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:28.570101 12852 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 19:09:28.570248 12852 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-2/wal
uuid: "406429d8c7fd4e708ada0a5ada0c34bf"
format_stamp: "Formatted at 2026-08-09 19:09:28 on dist-test-slave-4tdj"
server_key: "a5b21248fc82d6798ada3544db3ec136"
server_key_iv: "85dd1b5afcdefc766e6d225214d05513"
server_key_version: "encryptionkey@0"
I20260809 19:09:28.570447 12852 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:28.594273 12852 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:28.597622 12852 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:28.597879 12852 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:28.598806 12852 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:09:28.600019 12852 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:28.600098 12852 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:28.600183 12852 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:28.600225 12852 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:28.628958 12852 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.3:36829
I20260809 19:09:28.629015 13055 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.3:36829 every 8 connection(s)
I20260809 19:09:28.630125 12852 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
I20260809 19:09:28.634047 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 12852
I20260809 19:09:28.634227 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance
I20260809 19:09:28.634799 7324 external_mini_cluster.cc:1428] Setting key 8f983862d6a8fc53a0f01f6ef114eb1c
Aug 09 19:09:28 dist-test-slave-4tdj krb5kdc[12239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302568, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:28.648049 12616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:28.632445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:51189 (local address 127.7.39.62:34249)
0809 19:09:28.632645 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:28.632651 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:28.633776 (+ 1125us) server_negotiation.cc:407] Connection header received
0809 19:09:28.636029 (+ 2253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:28.636035 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:28.636120 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:28.636213 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:28.637850 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:28.638627 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:28.640018 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:28.640412 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:28.640497 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:28.643506 (+ 3009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:28.643510 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:28.643514 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:28.643558 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:28.645717 (+ 2159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:28.646341 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:28.646346 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:28.646348 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:28.646457 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:28.646788 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:28.646791 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:28.646793 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:28.647044 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:28.647148 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:28.647665 (+ 517us) server_negotiation.cc:299] Negotiation successful
0809 19:09:28.647816 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 19:09:28.649152 13061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:28.632934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34249 (local address 127.7.39.3:51189)
0809 19:09:28.633604 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:28.633654 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:28.635801 (+ 2147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:28.636470 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:28.636480 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:28.637082 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:28.637689 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:28.637715 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:28.638745 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:28.638749 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:28.639912 (+ 1163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:28.639923 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:28.640565 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:28.640570 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:28.640746 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:28.641310 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:28.641331 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:28.643324 (+ 1993us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:28.645832 (+ 2508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:28.645838 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:28.645848 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:28.646228 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:28.646536 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:28.646540 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:28.646544 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:28.646707 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:28.647139 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:28.647143 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:28.647389 (+ 246us) client_negotiation.cc:769] Sending connection context
0809 19:09:28.647596 (+ 207us) client_negotiation.cc:240] Negotiation successful
0809 19:09:28.647924 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":261,"threads_started":1}
I20260809 19:09:28.650358 13058 heartbeater.cc:347] Connected to a master server at 127.7.39.62:34249
I20260809 19:09:28.650636 13058 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:28.651276 13058 heartbeater.cc:511] Master 127.7.39.62:34249 requested a full tablet report, sending...
I20260809 19:09:28.652527 12321 ts_manager.cc:194] Registered new tserver with Master: 406429d8c7fd4e708ada0a5ada0c34bf (127.7.39.3:36829)
I20260809 19:09:28.653283 12321 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.3@KRBTEST.COM'} at 127.7.39.3:51189
I20260809 19:09:28.661533 7324 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 19:09:28 dist-test-slave-4tdj krb5kdc[12239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302568, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 09 19:09:28 dist-test-slave-4tdj krb5kdc[12239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302568, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:28.709403 12616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:28.696136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49454 (local address 127.7.39.62:34249)
0809 19:09:28.696285 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:28.696289 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:28.696728 (+ 439us) server_negotiation.cc:407] Connection header received
0809 19:09:28.696864 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:28.696867 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:28.696927 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:28.697010 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:28.698204 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:28.698961 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:28.700542 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:28.701147 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:28.701275 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:28.704931 (+ 3656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:28.704936 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:28.704940 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:28.704970 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:28.707458 (+ 2488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:28.707964 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:28.707967 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:28.707969 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:28.708081 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:28.708360 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:28.708363 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:28.708364 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:28.708646 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:28.708815 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:28.709024 (+ 209us) server_negotiation.cc:299] Negotiation successful
0809 19:09:28.709184 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
W20260809 19:09:28.709884 12321 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:49454
I20260809 19:09:28.711102 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 12412
Aug 09 19:09:28 dist-test-slave-4tdj krb5kdc[12239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302568, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.7.39.1@KRBTEST.COM
I20260809 19:09:28.719905 12612 heartbeater.cc:503] Master 127.7.39.62:34249 was elected leader, sending a full tablet report...
I20260809 19:09:28.725517 13075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:28.712315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48666 (local address 127.7.39.1:40829)
0809 19:09:28.712821 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:28.712827 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:28.712850 (+ 23us) server_negotiation.cc:407] Connection header received
0809 19:09:28.712900 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:28.712905 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:28.713098 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:28.713216 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:28.714161 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:28.715142 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:28.716238 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:28.716739 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:28.716827 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:28.720296 (+ 3469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:28.720311 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:28.720328 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:28.720373 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:28.723046 (+ 2673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:28.723616 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:28.723622 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:28.723625 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:28.723741 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:28.724082 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:28.724087 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:28.724090 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:28.724402 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:28.724691 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:28.724936 (+ 245us) server_negotiation.cc:299] Negotiation successful
0809 19:09:28.725188 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":236,"threads_started":1}
W20260809 19:09:28.726665 12601 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:48666
W20260809 19:09:28.727653 7324 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 12412: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 19:09:28.727833 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 12412
I20260809 19:09:28.748112 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 12624
Aug 09 19:09:28 dist-test-slave-4tdj krb5kdc[12239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302568, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.7.39.2@KRBTEST.COM
I20260809 19:09:28.762665 13076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:28.748943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43598 (local address 127.7.39.2:44997)
0809 19:09:28.749431 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:28.749437 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:28.749461 (+ 24us) server_negotiation.cc:407] Connection header received
0809 19:09:28.749517 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:28.749523 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:28.749727 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:28.749870 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:28.751127 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:28.752113 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:28.753328 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:28.753915 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:28.754023 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:28.757854 (+ 3831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:28.757863 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:28.757876 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:28.757906 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:28.760431 (+ 2525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:28.760958 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:28.760965 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:28.760967 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:28.761086 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:28.761354 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:28.761357 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:28.761359 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:28.761670 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:28.761891 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:28.762085 (+ 194us) server_negotiation.cc:299] Negotiation successful
0809 19:09:28.762269 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":236,"threads_started":1}
W20260809 19:09:28.763849 12837 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:43598
W20260809 19:09:28.764827 7324 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 12624: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 19:09:28.764961 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 12624
I20260809 19:09:28.783988 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 12852
Aug 09 19:09:28 dist-test-slave-4tdj krb5kdc[12239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302568, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.7.39.3@KRBTEST.COM
I20260809 19:09:28.799264 13077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:28.784927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37480 (local address 127.7.39.3:36829)
0809 19:09:28.785516 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:28.785523 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:28.785554 (+ 31us) server_negotiation.cc:407] Connection header received
0809 19:09:28.785612 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:28.785619 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:28.785817 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:28.785954 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:28.787304 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:28.788348 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:28.789558 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:28.790095 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:28.790211 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:28.794173 (+ 3962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:28.794183 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:28.794196 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:28.794227 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:28.796658 (+ 2431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:28.797249 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:28.797256 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:28.797258 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:28.797374 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:28.797703 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:28.797707 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:28.797708 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:28.798025 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:28.798519 (+ 494us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:28.798673 (+ 154us) server_negotiation.cc:299] Negotiation successful
0809 19:09:28.798928 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":300,"threads_started":1}
W20260809 19:09:28.800457 13048 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:37480
W20260809 19:09:28.801467 7324 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 12852: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 19:09:28.801611 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 12852
I20260809 19:09:28.825963 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 12259
I20260809 19:09:28.827180 12366 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:28.926131 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 12259
2026-08-09T19:09:28Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (3586 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:09:29 dist-test-slave-4tdj krb5kdc[13081](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:09:29 dist-test-slave-4tdj krb5kdc[13081](info): set up 2 sockets
Aug 09 19:09:29 dist-test-slave-4tdj krb5kdc[13081](info): commencing operation
krb5kdc: starting...
W20260809 19:09:30.129541 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.154s user 0.000s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:09:30 dist-test-slave-4tdj krb5kdc[13081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302570, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:09:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:09:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.39.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
I20260809 19:09:30.309649 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:33365
--webserver_interface=127.7.39.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:39985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:33365
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:30.619164 13097 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:30.619529 13097 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:30.619678 13097 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:30.629864 13097 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:09:30.629989 13097 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:30.630066 13097 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:30.630146 13097 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:09:30.630208 13097 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:09:30.644187 13097 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:39985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:33365
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:33365
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:30.645484 13097 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:30.646853 13097 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:30.658699 13108 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:30.658775 13106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:30.658771 13103 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:30.659571 13097 server_base.cc:1034] running on GCE node
I20260809 19:09:30.660257 13097 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:30.661554 13097 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:30.662750 13097 hybrid_clock.cc:648] HybridClock initialized: now 1786302570662708 us; error 31 us; skew 500 ppm
I20260809 19:09:30.663069 13097 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:30 dist-test-slave-4tdj krb5kdc[13081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302570, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:30.666023 13097 init.cc:377] Logged in from keytab as kudu/127.7.39.62@KRBTEST.COM (short username kudu)
I20260809 19:09:30.667409 13097 webserver.cc:460] Webserver started at http://127.7.39.62:33899/ using document root <none> and password file <none>
I20260809 19:09:30.668043 13097 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:30.668156 13097 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:30.668457 13097 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:30.671362 13097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "ab9a874a2dcd4f41819f8f07d92aabbe"
format_stamp: "Formatted at 2026-08-09 19:09:30 on dist-test-slave-4tdj"
server_key: "6611f8086aa2b7bc7849ae086f6d5e52"
server_key_iv: "2a0aa051cecfcf861c6f4353aa9ada8d"
server_key_version: "encryptionkey@0"
I20260809 19:09:30.672112 13097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "ab9a874a2dcd4f41819f8f07d92aabbe"
format_stamp: "Formatted at 2026-08-09 19:09:30 on dist-test-slave-4tdj"
server_key: "6611f8086aa2b7bc7849ae086f6d5e52"
server_key_iv: "2a0aa051cecfcf861c6f4353aa9ada8d"
server_key_version: "encryptionkey@0"
I20260809 19:09:30.676971 13097 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260809 19:09:30.680190 13122 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:30.681388 13097 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 19:09:30.681516 13097 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "ab9a874a2dcd4f41819f8f07d92aabbe"
format_stamp: "Formatted at 2026-08-09 19:09:30 on dist-test-slave-4tdj"
server_key: "6611f8086aa2b7bc7849ae086f6d5e52"
server_key_iv: "2a0aa051cecfcf861c6f4353aa9ada8d"
server_key_version: "encryptionkey@0"
I20260809 19:09:30.681679 13097 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:30.696873 13097 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:30.700634 13097 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:30.700862 13097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:30.718195 13097 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:33365
I20260809 19:09:30.718194 13205 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:33365 every 8 connection(s)
I20260809 19:09:30.719559 13097 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:09:30.723100 13206 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:30.723395 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 13097
I20260809 19:09:30.723621 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:09:30.724395 7324 external_mini_cluster.cc:1428] Setting key 4c3bd22240889d965263842245477478
I20260809 19:09:30.736397 13206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab9a874a2dcd4f41819f8f07d92aabbe: Bootstrap starting.
Aug 09 19:09:30 dist-test-slave-4tdj krb5kdc[13081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302570, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:30.739915 13206 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ab9a874a2dcd4f41819f8f07d92aabbe: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:30.741220 13206 log.cc:824] T 00000000000000000000000000000000 P ab9a874a2dcd4f41819f8f07d92aabbe: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:30.744304 13206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab9a874a2dcd4f41819f8f07d92aabbe: No bootstrap required, opened a new log
I20260809 19:09:30.748579 13210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:30.726406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56022 (local address 127.7.39.62:33365)
0809 19:09:30.727114 (+ 708us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:30.727125 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:30.727168 (+ 43us) server_negotiation.cc:407] Connection header received
0809 19:09:30.729135 (+ 1967us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:30.729156 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:30.729524 (+ 368us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:30.729830 (+ 306us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:30.731598 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:30.732824 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:30.734567 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:30.735206 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:30.735343 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:30.739763 (+ 4420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:30.739774 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:30.739791 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:30.739838 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:30.744294 (+ 4456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:30.744983 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:30.744995 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:30.745003 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:30.745219 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:30.745536 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:30.745541 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:30.745545 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:30.746237 (+ 692us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:30.746594 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:30.746881 (+ 287us) server_negotiation.cc:299] Negotiation successful
0809 19:09:30.747299 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":503,"thread_start_us":316,"threads_started":1}
I20260809 19:09:30.753378 13206 raft_consensus.cc:348] T 00000000000000000000000000000000 P ab9a874a2dcd4f41819f8f07d92aabbe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab9a874a2dcd4f41819f8f07d92aabbe" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33365 } }
I20260809 19:09:30.753680 13206 raft_consensus.cc:374] T 00000000000000000000000000000000 P ab9a874a2dcd4f41819f8f07d92aabbe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:30.753750 13206 raft_consensus.cc:729] T 00000000000000000000000000000000 P ab9a874a2dcd4f41819f8f07d92aabbe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab9a874a2dcd4f41819f8f07d92aabbe, State: Initialized, Role: FOLLOWER
I20260809 19:09:30.754194 13206 consensus_queue.cc:260] T 00000000000000000000000000000000 P ab9a874a2dcd4f41819f8f07d92aabbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab9a874a2dcd4f41819f8f07d92aabbe" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33365 } }
I20260809 19:09:30.754423 13206 raft_consensus.cc:388] T 00000000000000000000000000000000 P ab9a874a2dcd4f41819f8f07d92aabbe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:09:30.754519 13206 raft_consensus.cc:482] T 00000000000000000000000000000000 P ab9a874a2dcd4f41819f8f07d92aabbe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:09:30.754643 13206 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ab9a874a2dcd4f41819f8f07d92aabbe [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:30.756551 13206 raft_consensus.cc:504] T 00000000000000000000000000000000 P ab9a874a2dcd4f41819f8f07d92aabbe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab9a874a2dcd4f41819f8f07d92aabbe" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33365 } }
I20260809 19:09:30.757043 13206 leader_election.cc:302] T 00000000000000000000000000000000 P ab9a874a2dcd4f41819f8f07d92aabbe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ab9a874a2dcd4f41819f8f07d92aabbe; no voters:
I20260809 19:09:30.757578 13206 leader_election.cc:288] T 00000000000000000000000000000000 P ab9a874a2dcd4f41819f8f07d92aabbe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:09:30.757680 13214 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ab9a874a2dcd4f41819f8f07d92aabbe [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:09:30.758322 13214 raft_consensus.cc:686] T 00000000000000000000000000000000 P ab9a874a2dcd4f41819f8f07d92aabbe [term 1 LEADER]: Becoming Leader. State: Replica: ab9a874a2dcd4f41819f8f07d92aabbe, State: Running, Role: LEADER
I20260809 19:09:30.758833 13214 consensus_queue.cc:237] T 00000000000000000000000000000000 P ab9a874a2dcd4f41819f8f07d92aabbe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab9a874a2dcd4f41819f8f07d92aabbe" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33365 } }
I20260809 19:09:30.759397 13206 sys_catalog.cc:564] T 00000000000000000000000000000000 P ab9a874a2dcd4f41819f8f07d92aabbe [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:09:30.761270 13217 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab9a874a2dcd4f41819f8f07d92aabbe [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab9a874a2dcd4f41819f8f07d92aabbe. Latest consensus state: current_term: 1 leader_uuid: "ab9a874a2dcd4f41819f8f07d92aabbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab9a874a2dcd4f41819f8f07d92aabbe" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33365 } } }
I20260809 19:09:30.762157 13217 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab9a874a2dcd4f41819f8f07d92aabbe [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:30.761868 13216 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab9a874a2dcd4f41819f8f07d92aabbe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ab9a874a2dcd4f41819f8f07d92aabbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab9a874a2dcd4f41819f8f07d92aabbe" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33365 } } }
I20260809 19:09:30.762696 13216 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab9a874a2dcd4f41819f8f07d92aabbe [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:30.763548 13227 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:09:30.768318 13227 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:09:30.776352 13227 catalog_manager.cc:1347] Generated new cluster ID: a098f7d9848243bdb36606f3753eda57
I20260809 19:09:30.776440 13227 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:09:30.785637 13227 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:09:30.787348 13227 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:09:30.800158 13227 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ab9a874a2dcd4f41819f8f07d92aabbe: Generated new TSK 0
I20260809 19:09:30.801017 13227 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.39.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
I20260809 19:09:30.845866 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.1:0
--local_ip_for_outbound_sockets=127.7.39.1
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:33365
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:39985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:31.160336 13249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:31.160615 13249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:31.160753 13249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:31.167891 13249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:31.167984 13249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:31.168128 13249 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.1
I20260809 19:09:31.177470 13249 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:39985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:33365
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.1
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:31.178681 13249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:31.179924 13249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:31.192258 13257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:31.192384 13259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:31.192302 13256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:31.193324 13249 server_base.cc:1034] running on GCE node
I20260809 19:09:31.193890 13249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:31.194818 13249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:31.196018 13249 hybrid_clock.cc:648] HybridClock initialized: now 1786302571195963 us; error 47 us; skew 500 ppm
I20260809 19:09:31.196297 13249 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:31 dist-test-slave-4tdj krb5kdc[13081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302571, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:31.199380 13249 init.cc:377] Logged in from keytab as kudu/127.7.39.1@KRBTEST.COM (short username kudu)
I20260809 19:09:31.200709 13249 webserver.cc:460] Webserver started at http://127.7.39.1:45715/ using document root <none> and password file <none>
I20260809 19:09:31.201318 13249 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:31.201431 13249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:31.201764 13249 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:31.204704 13249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-0/data/instance:
uuid: "872eb087d8d3456ba9bd3f4e486c86f3"
format_stamp: "Formatted at 2026-08-09 19:09:31 on dist-test-slave-4tdj"
server_key: "92a70b9ecb42d0340af0873beb95c498"
server_key_iv: "d91d4c9c6f57ee3b30eb961d4ef66df4"
server_key_version: "encryptionkey@0"
I20260809 19:09:31.205487 13249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance:
uuid: "872eb087d8d3456ba9bd3f4e486c86f3"
format_stamp: "Formatted at 2026-08-09 19:09:31 on dist-test-slave-4tdj"
server_key: "92a70b9ecb42d0340af0873beb95c498"
server_key_iv: "d91d4c9c6f57ee3b30eb961d4ef66df4"
server_key_version: "encryptionkey@0"
I20260809 19:09:31.210628 13249 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260809 19:09:31.214038 13268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:31.215327 13249 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:09:31.215485 13249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-0/wal
uuid: "872eb087d8d3456ba9bd3f4e486c86f3"
format_stamp: "Formatted at 2026-08-09 19:09:31 on dist-test-slave-4tdj"
server_key: "92a70b9ecb42d0340af0873beb95c498"
server_key_iv: "d91d4c9c6f57ee3b30eb961d4ef66df4"
server_key_version: "encryptionkey@0"
I20260809 19:09:31.215672 13249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:31.227314 13249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:31.230897 13249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:31.231153 13249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:31.232030 13249 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:09:31.233314 13249 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:31.233393 13249 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:31.233500 13249 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:31.233551 13249 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:31.264930 13249 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.1:46291
I20260809 19:09:31.264962 13457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.1:46291 every 8 connection(s)
I20260809 19:09:31.266281 13249 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
I20260809 19:09:31.272817 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 13249
I20260809 19:09:31.273018 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance
I20260809 19:09:31.273654 7324 external_mini_cluster.cc:1428] Setting key b88d21b4e168fa1e20daad11c1bfeeb2
Aug 09 19:09:31 dist-test-slave-4tdj krb5kdc[13081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302571, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:31.286406 13462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:31.268778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:32943 (local address 127.7.39.62:33365)
0809 19:09:31.269223 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:31.269229 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:31.270213 (+ 984us) server_negotiation.cc:407] Connection header received
0809 19:09:31.272069 (+ 1856us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:31.272074 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:31.272141 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:31.272236 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:31.273875 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:31.274787 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:31.276483 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:31.276924 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:31.277057 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:31.280657 (+ 3600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:31.280662 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:31.280665 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:31.280699 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:31.283194 (+ 2495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:31.283954 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:31.283960 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:31.283964 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:31.284095 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:31.284552 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:31.284559 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:31.284563 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:31.284880 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:31.285021 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:31.285734 (+ 713us) server_negotiation.cc:299] Negotiation successful
0809 19:09:31.285951 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311,"thread_start_us":205,"threads_started":1}
I20260809 19:09:31.287286 13464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:31.269325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33365 (local address 127.7.39.1:32943)
0809 19:09:31.270064 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:31.270103 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:31.271828 (+ 1725us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:31.272426 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:31.272434 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:31.273008 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:31.273692 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:31.273718 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:31.274954 (+ 1236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:31.274957 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:31.276334 (+ 1377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:31.276348 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:31.277157 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:31.277165 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:31.277388 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:31.278034 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:31.278058 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:31.280434 (+ 2376us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:31.283333 (+ 2899us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:31.283342 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:31.283357 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:31.283830 (+ 473us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:31.284207 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:31.284213 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:31.284217 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:31.284427 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:31.285020 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:31.285028 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:31.285351 (+ 323us) client_negotiation.cc:769] Sending connection context
0809 19:09:31.285611 (+ 260us) client_negotiation.cc:240] Negotiation successful
0809 19:09:31.286101 (+ 490us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":297,"threads_started":1}
I20260809 19:09:31.288740 13459 heartbeater.cc:347] Connected to a master server at 127.7.39.62:33365
I20260809 19:09:31.289029 13459 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:31.289733 13459 heartbeater.cc:511] Master 127.7.39.62:33365 requested a full tablet report, sending...
I20260809 19:09:31.292070 13150 ts_manager.cc:194] Registered new tserver with Master: 872eb087d8d3456ba9bd3f4e486c86f3 (127.7.39.1:46291)
WARNING: no policy specified for kudu/127.7.39.2@KRBTEST.COM; defaulting to no policy
I20260809 19:09:31.293672 13150 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.1@KRBTEST.COM'} at 127.7.39.1:32943
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
I20260809 19:09:31.315297 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.2:0
--local_ip_for_outbound_sockets=127.7.39.2
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:33365
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:39985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:31.618235 13468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:31.618499 13468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:31.618640 13468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:31.625412 13468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:31.625497 13468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:31.625613 13468 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.2
I20260809 19:09:31.634513 13468 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:39985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:33365
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.2
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:31.635558 13468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:31.636696 13468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:31.648423 13475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:31.648480 13479 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:31.648594 13481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:31.649497 13468 server_base.cc:1034] running on GCE node
I20260809 19:09:31.650018 13468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:31.650876 13468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:31.652066 13468 hybrid_clock.cc:648] HybridClock initialized: now 1786302571652017 us; error 44 us; skew 500 ppm
I20260809 19:09:31.652333 13468 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:31 dist-test-slave-4tdj krb5kdc[13081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302571, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:31.655362 13468 init.cc:377] Logged in from keytab as kudu/127.7.39.2@KRBTEST.COM (short username kudu)
I20260809 19:09:31.656656 13468 webserver.cc:460] Webserver started at http://127.7.39.2:41439/ using document root <none> and password file <none>
I20260809 19:09:31.657258 13468 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:31.657364 13468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:31.657648 13468 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:31.660432 13468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-1/data/instance:
uuid: "bbea4a3b578f457aa3e27e54b5f7655e"
format_stamp: "Formatted at 2026-08-09 19:09:31 on dist-test-slave-4tdj"
server_key: "26eeec78b0e20d903ba20357ed99297c"
server_key_iv: "f6b0e349df554ee90066ef9a95e239c8"
server_key_version: "encryptionkey@0"
I20260809 19:09:31.661188 13468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance:
uuid: "bbea4a3b578f457aa3e27e54b5f7655e"
format_stamp: "Formatted at 2026-08-09 19:09:31 on dist-test-slave-4tdj"
server_key: "26eeec78b0e20d903ba20357ed99297c"
server_key_iv: "f6b0e349df554ee90066ef9a95e239c8"
server_key_version: "encryptionkey@0"
I20260809 19:09:31.665822 13468 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260809 19:09:31.668974 13491 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:31.670132 13468 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 19:09:31.670276 13468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-1/wal
uuid: "bbea4a3b578f457aa3e27e54b5f7655e"
format_stamp: "Formatted at 2026-08-09 19:09:31 on dist-test-slave-4tdj"
server_key: "26eeec78b0e20d903ba20357ed99297c"
server_key_iv: "f6b0e349df554ee90066ef9a95e239c8"
server_key_version: "encryptionkey@0"
I20260809 19:09:31.670516 13468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:31.706763 13468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:31.710573 13468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:31.710824 13468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:31.711771 13468 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:09:31.713462 13468 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:31.713601 13468 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260809 19:09:31.713729 13468 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:31.713790 13468 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:31.744818 13468 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.2:36899
I20260809 19:09:31.744871 13676 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.2:36899 every 8 connection(s)
I20260809 19:09:31.745987 13468 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
I20260809 19:09:31.750051 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 13468
I20260809 19:09:31.750236 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance
I20260809 19:09:31.750803 7324 external_mini_cluster.cc:1428] Setting key 0cc4c6529ac827ba1188297dc7b30356
Aug 09 19:09:31 dist-test-slave-4tdj krb5kdc[13081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302571, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:31.766000 13462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:31.748256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:42381 (local address 127.7.39.62:33365)
0809 19:09:31.748429 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:31.748433 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:31.749531 (+ 1098us) server_negotiation.cc:407] Connection header received
0809 19:09:31.751851 (+ 2320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:31.751856 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:31.751945 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:31.752042 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:31.753732 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:31.754484 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:31.756491 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:31.756891 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:31.756987 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:31.760629 (+ 3642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:31.760634 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:31.760637 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:31.760670 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:31.763101 (+ 2431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:31.763902 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:31.763905 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:31.763907 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:31.764021 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:31.764443 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:31.764446 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:31.764448 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:31.764700 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:31.764804 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:31.765601 (+ 797us) server_negotiation.cc:299] Negotiation successful
0809 19:09:31.765762 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 19:09:31.767396 13679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:31.748721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33365 (local address 127.7.39.2:42381)
0809 19:09:31.749380 (+ 659us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:31.749421 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:31.751571 (+ 2150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:31.752230 (+ 659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:31.752237 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:31.752808 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:31.753544 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:31.753571 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:31.754659 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:31.754663 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:31.756342 (+ 1679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:31.756356 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:31.757107 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:31.757114 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:31.757366 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:31.758008 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:31.758035 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:31.760434 (+ 2399us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:31.763234 (+ 2800us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:31.763243 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:31.763258 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:31.763806 (+ 548us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:31.764127 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:31.764131 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:31.764135 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:31.764356 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:31.764816 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:31.764823 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:31.765190 (+ 367us) client_negotiation.cc:769] Sending connection context
0809 19:09:31.765545 (+ 355us) client_negotiation.cc:240] Negotiation successful
0809 19:09:31.766090 (+ 545us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":264,"threads_started":1}
I20260809 19:09:31.768662 13677 heartbeater.cc:347] Connected to a master server at 127.7.39.62:33365
I20260809 19:09:31.768934 13677 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:31.769596 13677 heartbeater.cc:511] Master 127.7.39.62:33365 requested a full tablet report, sending...
I20260809 19:09:31.770903 13150 ts_manager.cc:194] Registered new tserver with Master: bbea4a3b578f457aa3e27e54b5f7655e (127.7.39.2:36899)
WARNING: no policy specified for kudu/127.7.39.3@KRBTEST.COM; defaulting to no policy
I20260809 19:09:31.771690 13150 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.2@KRBTEST.COM'} at 127.7.39.2:42381
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
I20260809 19:09:31.795154 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.3:0
--local_ip_for_outbound_sockets=127.7.39.3
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:33365
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:39985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:32.100884 13683 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:32.101178 13683 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:32.101336 13683 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:32.108853 13683 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:32.108980 13683 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:32.109133 13683 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.3
I20260809 19:09:32.118680 13683 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:39985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:33365
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.3
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:32.119992 13683 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:32.121279 13683 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:32.133529 13692 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:32.133572 13697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:32.133529 13688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:32.134604 13683 server_base.cc:1034] running on GCE node
I20260809 19:09:32.135185 13683 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:32.136111 13683 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:32.137311 13683 hybrid_clock.cc:648] HybridClock initialized: now 1786302572137274 us; error 31 us; skew 500 ppm
I20260809 19:09:32.137591 13683 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:32 dist-test-slave-4tdj krb5kdc[13081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302572, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:32.140555 13683 init.cc:377] Logged in from keytab as kudu/127.7.39.3@KRBTEST.COM (short username kudu)
I20260809 19:09:32.141875 13683 webserver.cc:460] Webserver started at http://127.7.39.3:33267/ using document root <none> and password file <none>
I20260809 19:09:32.142566 13683 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:32.142678 13683 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:32.142967 13683 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:32.145751 13683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-2/data/instance:
uuid: "d01ac1ea116c49b1907e4d8c16568ede"
format_stamp: "Formatted at 2026-08-09 19:09:32 on dist-test-slave-4tdj"
server_key: "bb7c2f5d9e2ef99bec68031249a12e15"
server_key_iv: "a982d6a5155dec9d28e074848f687e59"
server_key_version: "encryptionkey@0"
I20260809 19:09:32.146559 13683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance:
uuid: "d01ac1ea116c49b1907e4d8c16568ede"
format_stamp: "Formatted at 2026-08-09 19:09:32 on dist-test-slave-4tdj"
server_key: "bb7c2f5d9e2ef99bec68031249a12e15"
server_key_iv: "a982d6a5155dec9d28e074848f687e59"
server_key_version: "encryptionkey@0"
I20260809 19:09:32.151454 13683 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 19:09:32.154757 13706 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:32.155951 13683 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260809 19:09:32.156104 13683 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-2/wal
uuid: "d01ac1ea116c49b1907e4d8c16568ede"
format_stamp: "Formatted at 2026-08-09 19:09:32 on dist-test-slave-4tdj"
server_key: "bb7c2f5d9e2ef99bec68031249a12e15"
server_key_iv: "a982d6a5155dec9d28e074848f687e59"
server_key_version: "encryptionkey@0"
I20260809 19:09:32.156289 13683 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:32.175886 13683 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:32.179479 13683 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:32.179723 13683 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:32.180608 13683 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:09:32.181838 13683 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:32.181908 13683 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:32.182017 13683 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:32.182075 13683 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:32.210958 13683 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.3:42183
I20260809 19:09:32.210995 13889 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.3:42183 every 8 connection(s)
I20260809 19:09:32.212205 13683 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
I20260809 19:09:32.219405 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 13683
I20260809 19:09:32.219599 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance
I20260809 19:09:32.220049 7324 external_mini_cluster.cc:1428] Setting key 91560577b404d3b1c6422938638b043f
Aug 09 19:09:32 dist-test-slave-4tdj krb5kdc[13081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302572, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:32.230952 13462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:32.214642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:51309 (local address 127.7.39.62:33365)
0809 19:09:32.214826 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:32.214830 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:32.216007 (+ 1177us) server_negotiation.cc:407] Connection header received
0809 19:09:32.217797 (+ 1790us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:32.217803 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:32.217881 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:32.217970 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:32.219507 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:32.220333 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:32.222095 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:32.222551 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:32.222670 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:32.225917 (+ 3247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:32.225922 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:32.225925 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:32.225957 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:32.228213 (+ 2256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:32.228868 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:32.228873 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:32.228877 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:32.228987 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:32.229367 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:32.229372 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:32.229375 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:32.229622 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:32.229748 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:32.230408 (+ 660us) server_negotiation.cc:299] Negotiation successful
0809 19:09:32.230617 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 19:09:32.231815 13894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:32.215150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33365 (local address 127.7.39.3:51309)
0809 19:09:32.215859 (+ 709us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:32.215896 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:32.217542 (+ 1646us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:32.218209 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:32.218217 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:32.218809 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:32.219347 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:32.219363 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:32.220481 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:32.220486 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:32.221969 (+ 1483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:32.221982 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:32.222783 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:32.222791 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:32.223027 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:32.223626 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:32.223652 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:32.225721 (+ 2069us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:32.228343 (+ 2622us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:32.228351 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:32.228367 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:32.228759 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:32.229086 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:32.229091 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:32.229095 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:32.229265 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:32.229740 (+ 475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:32.229747 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:32.230033 (+ 286us) client_negotiation.cc:769] Sending connection context
0809 19:09:32.230265 (+ 232us) client_negotiation.cc:240] Negotiation successful
0809 19:09:32.230784 (+ 519us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":269,"threads_started":1}
I20260809 19:09:32.233038 13891 heartbeater.cc:347] Connected to a master server at 127.7.39.62:33365
I20260809 19:09:32.233408 13891 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:32.234207 13891 heartbeater.cc:511] Master 127.7.39.62:33365 requested a full tablet report, sending...
I20260809 19:09:32.235595 13150 ts_manager.cc:194] Registered new tserver with Master: d01ac1ea116c49b1907e4d8c16568ede (127.7.39.3:42183)
I20260809 19:09:32.236346 13150 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.3@KRBTEST.COM'} at 127.7.39.3:51309
I20260809 19:09:32.247002 7324 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 19:09:32 dist-test-slave-4tdj krb5kdc[13081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302572, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 19:09:32 dist-test-slave-4tdj krb5kdc[13081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302572, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.1@KRBTEST.COM
I20260809 19:09:32.295286 13908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:32.281796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53794 (local address 127.7.39.1:46291)
0809 19:09:32.282373 (+ 577us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:32.282382 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:32.282411 (+ 29us) server_negotiation.cc:407] Connection header received
0809 19:09:32.282506 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:32.282512 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:32.282720 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:32.282841 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:32.284078 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:32.285127 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:32.286379 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:32.286917 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:32.287010 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:32.290448 (+ 3438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:32.290459 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:32.290472 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:32.290507 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:32.292970 (+ 2463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:32.293546 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:32.293552 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:32.293554 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:32.293688 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:32.293975 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:32.293978 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:32.293980 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:32.294311 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:32.294547 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:32.294740 (+ 193us) server_negotiation.cc:299] Negotiation successful
0809 19:09:32.294932 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":256,"threads_started":1}
I20260809 19:09:32.296294 13459 heartbeater.cc:503] Master 127.7.39.62:33365 was elected leader, sending a full tablet report...
Aug 09 19:09:32 dist-test-slave-4tdj krb5kdc[13081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302572, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:32.311244 13462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:32.299486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56028 (local address 127.7.39.62:33365)
0809 19:09:32.299708 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:32.299714 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:32.299893 (+ 179us) server_negotiation.cc:407] Connection header received
0809 19:09:32.300009 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:32.300013 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:32.300074 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:32.300150 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:32.301210 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:32.301876 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:32.303111 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:32.303515 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:32.303614 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:32.307041 (+ 3427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:32.307046 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:32.307050 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:32.307090 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:32.309239 (+ 2149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:32.309757 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:32.309760 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:32.309762 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:32.309872 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:32.310127 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:32.310130 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:32.310132 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:32.310442 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:32.310622 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:32.310855 (+ 233us) server_negotiation.cc:299] Negotiation successful
0809 19:09:32.311018 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
W20260809 19:09:32.311800 13150 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56028
I20260809 19:09:32.312783 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 13249
I20260809 19:09:32.323946 13908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:32.313653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53798 (local address 127.7.39.1:46291)
0809 19:09:32.313856 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:32.313863 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:32.313960 (+ 97us) server_negotiation.cc:407] Connection header received
0809 19:09:32.314091 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:32.314094 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:32.314151 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:32.314219 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:32.315252 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:32.315898 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:32.316995 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:32.317392 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:32.317482 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:32.319512 (+ 2030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:32.319516 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:32.319520 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:32.319550 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:32.321939 (+ 2389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:32.322515 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:32.322519 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:32.322521 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:32.322647 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:32.322910 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:32.322913 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:32.322914 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:32.323132 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:32.323298 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:32.323491 (+ 193us) server_negotiation.cc:299] Negotiation successful
0809 19:09:32.323659 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 19:09:32.324498 13449 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:32.404562 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 13249
I20260809 19:09:32.427160 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 13468
Aug 09 19:09:32 dist-test-slave-4tdj krb5kdc[13081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302572, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.2@KRBTEST.COM
I20260809 19:09:32.441525 13914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:32.428002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41146 (local address 127.7.39.2:36899)
0809 19:09:32.428548 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:32.428555 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:32.428585 (+ 30us) server_negotiation.cc:407] Connection header received
0809 19:09:32.428646 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:32.428652 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:32.428859 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:32.428979 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:32.430109 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:32.431159 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:32.432325 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:32.432841 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:32.432932 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:32.436695 (+ 3763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:32.436706 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:32.436720 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:32.436759 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:32.439269 (+ 2510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:32.439855 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:32.439862 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:32.439864 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:32.439981 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:32.440247 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:32.440249 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:32.440251 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:32.440559 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:32.440774 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:32.440972 (+ 198us) server_negotiation.cc:299] Negotiation successful
0809 19:09:32.441179 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":254,"threads_started":1}
I20260809 19:09:32.442831 13670 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:32.522265 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 13468
I20260809 19:09:32.542711 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 13683
Aug 09 19:09:32 dist-test-slave-4tdj krb5kdc[13081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302572, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.3@KRBTEST.COM
I20260809 19:09:32.557571 13916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:32.543597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47380 (local address 127.7.39.3:42183)
0809 19:09:32.544199 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:32.544206 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:32.544234 (+ 28us) server_negotiation.cc:407] Connection header received
0809 19:09:32.544296 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:32.544302 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:32.544497 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:32.544641 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:32.545839 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:32.546888 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:32.548053 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:32.548587 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:32.548676 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:32.552670 (+ 3994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:32.552681 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:32.552693 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:32.552729 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:32.555347 (+ 2618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:32.555905 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:32.555911 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:32.555914 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:32.556027 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:32.556293 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:32.556296 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:32.556298 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:32.556611 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:32.556819 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:32.557024 (+ 205us) server_negotiation.cc:299] Negotiation successful
0809 19:09:32.557210 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":459,"thread_start_us":305,"threads_started":1}
I20260809 19:09:32.558843 13883 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:32.638211 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 13683
I20260809 19:09:32.656889 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 13097
I20260809 19:09:32.657972 13200 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:32.759302 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 13097
2026-08-09T19:09:32Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (3830 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:09:32 dist-test-slave-4tdj krb5kdc[13927](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:09:32 dist-test-slave-4tdj krb5kdc[13927](info): set up 2 sockets
Aug 09 19:09:32 dist-test-slave-4tdj krb5kdc[13927](info): commencing operation
krb5kdc: starting...
W20260809 19:09:33.954198 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.148s user 0.002s sys 0.017s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:09:34 dist-test-slave-4tdj krb5kdc[13927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302574, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:09:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:09:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.39.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
I20260809 19:09:34.131170 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:34755
--webserver_interface=127.7.39.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:32905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:34755
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:34.439713 13953 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:34.439960 13953 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:34.440068 13953 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:34.446879 13953 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:09:34.446970 13953 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:34.447014 13953 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:34.447077 13953 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:09:34.447124 13953 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:09:34.456295 13953 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:32905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:34755
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:34755
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:34.457398 13953 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:34.458626 13953 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:34.469031 13958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:34.469089 13959 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:34.469121 13961 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:34.469837 13953 server_base.cc:1034] running on GCE node
I20260809 19:09:34.470620 13953 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:34.471834 13953 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:34.473032 13953 hybrid_clock.cc:648] HybridClock initialized: now 1786302574472981 us; error 44 us; skew 500 ppm
I20260809 19:09:34.473349 13953 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:34 dist-test-slave-4tdj krb5kdc[13927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302574, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:34.476368 13953 init.cc:377] Logged in from keytab as kudu/127.7.39.62@KRBTEST.COM (short username kudu)
I20260809 19:09:34.477522 13953 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:34.477612 13953 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:34.477871 13953 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:34.480846 13953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "5401e2c3b3164f0c9f5c98f0748b4c2b"
format_stamp: "Formatted at 2026-08-09 19:09:34 on dist-test-slave-4tdj"
server_key: "11240c9aa8a20d358cd00b62796f7cc7"
server_key_iv: "200abe4bf0184cd08a6f0c0071c46e6f"
server_key_version: "encryptionkey@0"
I20260809 19:09:34.481606 13953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "5401e2c3b3164f0c9f5c98f0748b4c2b"
format_stamp: "Formatted at 2026-08-09 19:09:34 on dist-test-slave-4tdj"
server_key: "11240c9aa8a20d358cd00b62796f7cc7"
server_key_iv: "200abe4bf0184cd08a6f0c0071c46e6f"
server_key_version: "encryptionkey@0"
I20260809 19:09:34.486414 13953 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 19:09:34.489749 13970 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:34.490962 13953 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:09:34.491099 13953 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "5401e2c3b3164f0c9f5c98f0748b4c2b"
format_stamp: "Formatted at 2026-08-09 19:09:34 on dist-test-slave-4tdj"
server_key: "11240c9aa8a20d358cd00b62796f7cc7"
server_key_iv: "200abe4bf0184cd08a6f0c0071c46e6f"
server_key_version: "encryptionkey@0"
I20260809 19:09:34.491269 13953 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:34.522169 13953 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:34.525755 13953 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:34.525964 13953 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:34.542569 13953 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:34755
I20260809 19:09:34.542572 14058 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:34755 every 8 connection(s)
I20260809 19:09:34.543416 13953 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:09:34.546864 14061 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:34.547732 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 13953
I20260809 19:09:34.547924 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:09:34.548524 7324 external_mini_cluster.cc:1428] Setting key 3b0e26b08288271fa6fa2148534556ed
I20260809 19:09:34.560075 14061 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5401e2c3b3164f0c9f5c98f0748b4c2b: Bootstrap starting.
Aug 09 19:09:34 dist-test-slave-4tdj krb5kdc[13927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302574, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:34.563561 14061 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5401e2c3b3164f0c9f5c98f0748b4c2b: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:34.564678 14061 log.cc:824] T 00000000000000000000000000000000 P 5401e2c3b3164f0c9f5c98f0748b4c2b: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:34.567373 14061 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5401e2c3b3164f0c9f5c98f0748b4c2b: No bootstrap required, opened a new log
I20260809 19:09:34.569919 14067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:34.550340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42990 (local address 127.7.39.62:34755)
0809 19:09:34.551089 (+ 749us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:34.551100 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:34.551140 (+ 40us) server_negotiation.cc:407] Connection header received
0809 19:09:34.552675 (+ 1535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:34.552698 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:34.553049 (+ 351us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:34.553357 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:34.555253 (+ 1896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:34.556504 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:34.558247 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:34.558913 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:34.559032 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:34.563314 (+ 4282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:34.563321 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:34.563334 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:34.563370 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:34.566166 (+ 2796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:34.566832 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:34.566839 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:34.566844 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:34.567001 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:34.567342 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:34.567346 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:34.567348 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:34.567915 (+ 567us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:34.568189 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:34.568607 (+ 418us) server_negotiation.cc:299] Negotiation successful
0809 19:09:34.568979 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":552,"thread_start_us":347,"threads_started":1}
I20260809 19:09:34.575059 14061 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5401e2c3b3164f0c9f5c98f0748b4c2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5401e2c3b3164f0c9f5c98f0748b4c2b" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34755 } }
I20260809 19:09:34.575394 14061 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5401e2c3b3164f0c9f5c98f0748b4c2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:34.575487 14061 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5401e2c3b3164f0c9f5c98f0748b4c2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5401e2c3b3164f0c9f5c98f0748b4c2b, State: Initialized, Role: FOLLOWER
I20260809 19:09:34.575980 14061 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5401e2c3b3164f0c9f5c98f0748b4c2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5401e2c3b3164f0c9f5c98f0748b4c2b" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34755 } }
I20260809 19:09:34.576196 14061 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5401e2c3b3164f0c9f5c98f0748b4c2b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:09:34.576319 14061 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5401e2c3b3164f0c9f5c98f0748b4c2b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:09:34.576457 14061 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5401e2c3b3164f0c9f5c98f0748b4c2b [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:34.578734 14061 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5401e2c3b3164f0c9f5c98f0748b4c2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5401e2c3b3164f0c9f5c98f0748b4c2b" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34755 } }
I20260809 19:09:34.579232 14061 leader_election.cc:302] T 00000000000000000000000000000000 P 5401e2c3b3164f0c9f5c98f0748b4c2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5401e2c3b3164f0c9f5c98f0748b4c2b; no voters:
I20260809 19:09:34.579773 14061 leader_election.cc:288] T 00000000000000000000000000000000 P 5401e2c3b3164f0c9f5c98f0748b4c2b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:09:34.579882 14069 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5401e2c3b3164f0c9f5c98f0748b4c2b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:09:34.580487 14069 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5401e2c3b3164f0c9f5c98f0748b4c2b [term 1 LEADER]: Becoming Leader. State: Replica: 5401e2c3b3164f0c9f5c98f0748b4c2b, State: Running, Role: LEADER
I20260809 19:09:34.580991 14069 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5401e2c3b3164f0c9f5c98f0748b4c2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5401e2c3b3164f0c9f5c98f0748b4c2b" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34755 } }
I20260809 19:09:34.581717 14061 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5401e2c3b3164f0c9f5c98f0748b4c2b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:09:34.583613 14070 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5401e2c3b3164f0c9f5c98f0748b4c2b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5401e2c3b3164f0c9f5c98f0748b4c2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5401e2c3b3164f0c9f5c98f0748b4c2b" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34755 } } }
I20260809 19:09:34.583647 14072 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5401e2c3b3164f0c9f5c98f0748b4c2b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5401e2c3b3164f0c9f5c98f0748b4c2b. Latest consensus state: current_term: 1 leader_uuid: "5401e2c3b3164f0c9f5c98f0748b4c2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5401e2c3b3164f0c9f5c98f0748b4c2b" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34755 } } }
I20260809 19:09:34.584092 14072 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5401e2c3b3164f0c9f5c98f0748b4c2b [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:34.584088 14070 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5401e2c3b3164f0c9f5c98f0748b4c2b [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:34.585256 14076 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:09:34.590365 14076 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:09:34.599161 14076 catalog_manager.cc:1347] Generated new cluster ID: 2b9abfc7693f44d6b53de19f45f1f300
I20260809 19:09:34.599253 14076 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:09:34.609303 14076 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:09:34.611049 14076 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:09:34.618553 14076 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5401e2c3b3164f0c9f5c98f0748b4c2b: Generated new TSK 0
I20260809 19:09:34.619426 14076 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.39.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
I20260809 19:09:34.669328 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.1:0
--local_ip_for_outbound_sockets=127.7.39.1
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:34755
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:32905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:34.982793 14103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:34.983058 14103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:34.983213 14103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:34.990414 14103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:34.990520 14103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:34.990665 14103 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.1
I20260809 19:09:35.000108 14103 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:32905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:34755
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.1
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:35.001291 14103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:35.002578 14103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:35.014516 14117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:35.014588 14112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:35.014561 14113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:35.015326 14103 server_base.cc:1034] running on GCE node
I20260809 19:09:35.015838 14103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:35.016683 14103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:35.017894 14103 hybrid_clock.cc:648] HybridClock initialized: now 1786302575017835 us; error 50 us; skew 500 ppm
I20260809 19:09:35.018191 14103 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:35 dist-test-slave-4tdj krb5kdc[13927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302575, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:35.021278 14103 init.cc:377] Logged in from keytab as kudu/127.7.39.1@KRBTEST.COM (short username kudu)
I20260809 19:09:35.023844 14103 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:35.023970 14103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:35.024348 14103 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:35.027992 14103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-0/data/instance:
uuid: "c72aca2ab0854a1ebbf486b755080919"
format_stamp: "Formatted at 2026-08-09 19:09:35 on dist-test-slave-4tdj"
server_key: "4afdfde61d67f1129f6efb11dd133ce3"
server_key_iv: "41579c6cc79e20d848438cd409a23b61"
server_key_version: "encryptionkey@0"
I20260809 19:09:35.028764 14103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance:
uuid: "c72aca2ab0854a1ebbf486b755080919"
format_stamp: "Formatted at 2026-08-09 19:09:35 on dist-test-slave-4tdj"
server_key: "4afdfde61d67f1129f6efb11dd133ce3"
server_key_iv: "41579c6cc79e20d848438cd409a23b61"
server_key_version: "encryptionkey@0"
I20260809 19:09:35.033602 14103 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 19:09:35.036791 14124 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:35.037945 14103 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 19:09:35.038100 14103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-0/wal
uuid: "c72aca2ab0854a1ebbf486b755080919"
format_stamp: "Formatted at 2026-08-09 19:09:35 on dist-test-slave-4tdj"
server_key: "4afdfde61d67f1129f6efb11dd133ce3"
server_key_iv: "41579c6cc79e20d848438cd409a23b61"
server_key_version: "encryptionkey@0"
I20260809 19:09:35.038283 14103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:35.061197 14103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:35.064723 14103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:35.064949 14103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:35.065829 14103 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:09:35.067063 14103 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:35.067160 14103 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:35.067256 14103 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:35.067325 14103 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:35.096917 14103 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.1:39623
I20260809 19:09:35.096956 14320 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.1:39623 every 8 connection(s)
I20260809 19:09:35.097675 14103 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
I20260809 19:09:35.107379 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 14103
I20260809 19:09:35.107604 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance
I20260809 19:09:35.108397 7324 external_mini_cluster.cc:1428] Setting key 60d7d7cc374ddb38b544d13bf73916c9
Aug 09 19:09:35 dist-test-slave-4tdj krb5kdc[13927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302575, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:35.115952 14323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:35.099874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:55757 (local address 127.7.39.62:34755)
0809 19:09:35.100244 (+ 370us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:35.100248 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:35.101200 (+ 952us) server_negotiation.cc:407] Connection header received
0809 19:09:35.102946 (+ 1746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:35.102950 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:35.103018 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:35.103117 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:35.104440 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:35.105178 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:35.106645 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:35.107014 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:35.107113 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:35.110750 (+ 3637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:35.110755 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:35.110758 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:35.110788 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:35.113122 (+ 2334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:35.113799 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:35.113803 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:35.113806 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:35.113923 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:35.114338 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:35.114341 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:35.114343 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:35.114603 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:35.114734 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:35.115378 (+ 644us) server_negotiation.cc:299] Negotiation successful
0809 19:09:35.115600 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":195,"threads_started":1}
I20260809 19:09:35.116806 14324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:35.100367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34755 (local address 127.7.39.1:55757)
0809 19:09:35.101040 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:35.101086 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:35.102715 (+ 1629us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:35.103285 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:35.103293 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:35.103759 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:35.104294 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:35.104310 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:35.105303 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:35.105307 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:35.106538 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:35.106549 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:35.107235 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:35.107243 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:35.107516 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:35.108137 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:35.108166 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:35.110538 (+ 2372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:35.113255 (+ 2717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:35.113264 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:35.113279 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:35.113681 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:35.114024 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:35.114029 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:35.114033 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:35.114204 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:35.114726 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:35.114733 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:35.115020 (+ 287us) client_negotiation.cc:769] Sending connection context
0809 19:09:35.115244 (+ 224us) client_negotiation.cc:240] Negotiation successful
0809 19:09:35.115735 (+ 491us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":269,"threads_started":1}
I20260809 19:09:35.118247 14321 heartbeater.cc:347] Connected to a master server at 127.7.39.62:34755
I20260809 19:09:35.118556 14321 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:35.119164 14321 heartbeater.cc:511] Master 127.7.39.62:34755 requested a full tablet report, sending...
I20260809 19:09:35.121371 13998 ts_manager.cc:194] Registered new tserver with Master: c72aca2ab0854a1ebbf486b755080919 (127.7.39.1:39623)
I20260809 19:09:35.123261 13998 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.1@KRBTEST.COM'} at 127.7.39.1:55757
WARNING: no policy specified for kudu/127.7.39.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
I20260809 19:09:35.154767 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.2:0
--local_ip_for_outbound_sockets=127.7.39.2
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:34755
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:32905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:35.461354 14331 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:35.461596 14331 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:35.461686 14331 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:35.468443 14331 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:35.468544 14331 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:35.468662 14331 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.2
I20260809 19:09:35.477722 14331 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:32905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:34755
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.2
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:35.478861 14331 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:35.480113 14331 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:35.492090 14340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:35.492213 14341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:35.492385 14344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:35.492982 14331 server_base.cc:1034] running on GCE node
I20260809 19:09:35.493505 14331 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:35.494423 14331 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:35.495626 14331 hybrid_clock.cc:648] HybridClock initialized: now 1786302575495578 us; error 56 us; skew 500 ppm
I20260809 19:09:35.495903 14331 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:35 dist-test-slave-4tdj krb5kdc[13927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302575, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:35.498725 14331 init.cc:377] Logged in from keytab as kudu/127.7.39.2@KRBTEST.COM (short username kudu)
I20260809 19:09:35.499765 14331 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:35.499864 14331 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:35.500156 14331 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:35.502857 14331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-1/data/instance:
uuid: "5b155c33b8d24bdab9eb4533f98f445b"
format_stamp: "Formatted at 2026-08-09 19:09:35 on dist-test-slave-4tdj"
server_key: "1872dddaf329367a1133ac7ec5f2749a"
server_key_iv: "b187caad02233a896077694d23897884"
server_key_version: "encryptionkey@0"
I20260809 19:09:35.503613 14331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance:
uuid: "5b155c33b8d24bdab9eb4533f98f445b"
format_stamp: "Formatted at 2026-08-09 19:09:35 on dist-test-slave-4tdj"
server_key: "1872dddaf329367a1133ac7ec5f2749a"
server_key_iv: "b187caad02233a896077694d23897884"
server_key_version: "encryptionkey@0"
I20260809 19:09:35.508118 14331 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 19:09:35.511253 14352 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:35.512355 14331 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 19:09:35.512502 14331 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-1/wal
uuid: "5b155c33b8d24bdab9eb4533f98f445b"
format_stamp: "Formatted at 2026-08-09 19:09:35 on dist-test-slave-4tdj"
server_key: "1872dddaf329367a1133ac7ec5f2749a"
server_key_iv: "b187caad02233a896077694d23897884"
server_key_version: "encryptionkey@0"
I20260809 19:09:35.512692 14331 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:35.528816 14331 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:35.532225 14331 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:35.532451 14331 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:35.533268 14331 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:09:35.534480 14331 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:35.534585 14331 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:35.534687 14331 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:35.534760 14331 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:35.563679 14331 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.2:38899
I20260809 19:09:35.563715 14548 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.2:38899 every 8 connection(s)
I20260809 19:09:35.564494 14331 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
I20260809 19:09:35.570468 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 14331
I20260809 19:09:35.570675 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance
I20260809 19:09:35.571216 7324 external_mini_cluster.cc:1428] Setting key 3258f7f0d9031c503b198654efd85eb0
Aug 09 19:09:35 dist-test-slave-4tdj krb5kdc[13927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302575, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:35.584846 14323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:35.566732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:39081 (local address 127.7.39.62:34755)
0809 19:09:35.566892 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:35.566896 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:35.567985 (+ 1089us) server_negotiation.cc:407] Connection header received
0809 19:09:35.569653 (+ 1668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:35.569657 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:35.569722 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:35.569805 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:35.571601 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:35.572440 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:35.574557 (+ 2117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:35.574953 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:35.575049 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:35.579050 (+ 4001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:35.579055 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:35.579064 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:35.579098 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:35.581788 (+ 2690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:35.582594 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:35.582600 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:35.582604 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:35.582762 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:35.583240 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:35.583245 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:35.583248 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:35.583570 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:35.583721 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:35.584316 (+ 595us) server_negotiation.cc:299] Negotiation successful
0809 19:09:35.584547 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 19:09:35.585471 14552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:35.567172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34755 (local address 127.7.39.2:39081)
0809 19:09:35.567835 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:35.567870 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:35.569430 (+ 1560us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:35.569978 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:35.569985 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:35.570683 (+ 698us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:35.571433 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:35.571458 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:35.572610 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:35.572614 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:35.574410 (+ 1796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:35.574425 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:35.575186 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:35.575195 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:35.575468 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:35.576144 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:35.576185 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:35.578820 (+ 2635us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:35.581910 (+ 3090us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:35.581918 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:35.581947 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:35.582462 (+ 515us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:35.582907 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:35.582911 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:35.582913 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:35.583127 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:35.583670 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:35.583674 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:35.583939 (+ 265us) client_negotiation.cc:769] Sending connection context
0809 19:09:35.584165 (+ 226us) client_negotiation.cc:240] Negotiation successful
0809 19:09:35.584493 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":264,"threads_started":1}
I20260809 19:09:35.586728 14549 heartbeater.cc:347] Connected to a master server at 127.7.39.62:34755
I20260809 19:09:35.587015 14549 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:35.587752 14549 heartbeater.cc:511] Master 127.7.39.62:34755 requested a full tablet report, sending...
I20260809 19:09:35.589203 13998 ts_manager.cc:194] Registered new tserver with Master: 5b155c33b8d24bdab9eb4533f98f445b (127.7.39.2:38899)
I20260809 19:09:35.589962 13998 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.2@KRBTEST.COM'} at 127.7.39.2:39081
WARNING: no policy specified for kudu/127.7.39.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
I20260809 19:09:35.615252 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.3:0
--local_ip_for_outbound_sockets=127.7.39.3
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:34755
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:32905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:35.921343 14557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:35.921623 14557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:35.921764 14557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:35.928685 14557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:35.928795 14557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:35.928946 14557 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.3
I20260809 19:09:35.938104 14557 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:32905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:34755
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.3
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:35.939276 14557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:35.940526 14557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:35.952370 14565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:35.952406 14570 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:35.952433 14564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:35.953029 14557 server_base.cc:1034] running on GCE node
I20260809 19:09:35.953563 14557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:35.954427 14557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:35.955626 14557 hybrid_clock.cc:648] HybridClock initialized: now 1786302575955575 us; error 41 us; skew 500 ppm
I20260809 19:09:35.955904 14557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:35 dist-test-slave-4tdj krb5kdc[13927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302575, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:35.962039 14557 init.cc:377] Logged in from keytab as kudu/127.7.39.3@KRBTEST.COM (short username kudu)
I20260809 19:09:35.963101 14557 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:35.963187 14557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:35.963433 14557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:35.966071 14557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-2/data/instance:
uuid: "39066cf7c9784586a43250f91312992f"
format_stamp: "Formatted at 2026-08-09 19:09:35 on dist-test-slave-4tdj"
server_key: "9b5e01864af592a1f59c40ff85ca1147"
server_key_iv: "69e250aca3011aca2767adfa80800a50"
server_key_version: "encryptionkey@0"
I20260809 19:09:35.966848 14557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance:
uuid: "39066cf7c9784586a43250f91312992f"
format_stamp: "Formatted at 2026-08-09 19:09:35 on dist-test-slave-4tdj"
server_key: "9b5e01864af592a1f59c40ff85ca1147"
server_key_iv: "69e250aca3011aca2767adfa80800a50"
server_key_version: "encryptionkey@0"
I20260809 19:09:35.971362 14557 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 19:09:35.974576 14580 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:35.975788 14557 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 19:09:35.975922 14557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-2/wal
uuid: "39066cf7c9784586a43250f91312992f"
format_stamp: "Formatted at 2026-08-09 19:09:35 on dist-test-slave-4tdj"
server_key: "9b5e01864af592a1f59c40ff85ca1147"
server_key_iv: "69e250aca3011aca2767adfa80800a50"
server_key_version: "encryptionkey@0"
I20260809 19:09:35.976089 14557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:35.999392 14557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:36.002883 14557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:36.003095 14557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:36.003895 14557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:09:36.005086 14557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:36.005172 14557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:36.005260 14557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:36.005318 14557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:36.035076 14557 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.3:44775
I20260809 19:09:36.035142 14786 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.3:44775 every 8 connection(s)
I20260809 19:09:36.035878 14557 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
I20260809 19:09:36.040241 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 14557
I20260809 19:09:36.040431 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance
I20260809 19:09:36.040980 7324 external_mini_cluster.cc:1428] Setting key b1742bac60dfb88bdfb66ad5afe03b6d
Aug 09 19:09:36 dist-test-slave-4tdj krb5kdc[13927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302575, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:36.054963 14323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:36.038053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:42339 (local address 127.7.39.62:34755)
0809 19:09:36.038265 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:36.038271 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:36.039427 (+ 1156us) server_negotiation.cc:407] Connection header received
0809 19:09:36.041749 (+ 2322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:36.041756 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:36.041837 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:36.041928 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:36.043592 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:36.044410 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:36.045878 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:36.046274 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:36.046412 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:36.049645 (+ 3233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:36.049650 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:36.049653 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:36.049685 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:36.052091 (+ 2406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:36.052748 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:36.052752 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:36.052754 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:36.052871 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:36.053263 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:36.053268 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:36.053271 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:36.053531 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:36.053662 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:36.054439 (+ 777us) server_negotiation.cc:299] Negotiation successful
0809 19:09:36.054636 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 19:09:36.055869 14795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:36.038579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34755 (local address 127.7.39.3:42339)
0809 19:09:36.039269 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:36.039316 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:36.041458 (+ 2142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:36.042183 (+ 725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:36.042190 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:36.042880 (+ 690us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:36.043430 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:36.043446 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:36.044547 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:36.044553 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:36.045747 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:36.045758 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:36.046499 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:36.046508 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:36.046719 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:36.047311 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:36.047333 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:36.049416 (+ 2083us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:36.052224 (+ 2808us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:36.052233 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:36.052247 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:36.052635 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:36.052972 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:36.052977 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:36.052981 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:36.053160 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:36.053653 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:36.053660 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:36.053942 (+ 282us) client_negotiation.cc:769] Sending connection context
0809 19:09:36.054212 (+ 270us) client_negotiation.cc:240] Negotiation successful
0809 19:09:36.054707 (+ 495us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":264,"threads_started":1}
I20260809 19:09:36.057008 14787 heartbeater.cc:347] Connected to a master server at 127.7.39.62:34755
I20260809 19:09:36.057257 14787 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:36.057808 14787 heartbeater.cc:511] Master 127.7.39.62:34755 requested a full tablet report, sending...
I20260809 19:09:36.059083 13998 ts_manager.cc:194] Registered new tserver with Master: 39066cf7c9784586a43250f91312992f (127.7.39.3:44775)
I20260809 19:09:36.059847 13998 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.3@KRBTEST.COM'} at 127.7.39.3:42339
I20260809 19:09:36.067984 7324 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 19:09:36.083443 14323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:36.072155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43002 (local address 127.7.39.62:34755)
0809 19:09:36.072289 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:36.072293 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:36.072801 (+ 508us) server_negotiation.cc:407] Connection header received
0809 19:09:36.072918 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:36.072921 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:36.072972 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:36.073051 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:36.074425 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:36.075082 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:36.076196 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:36.076596 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:36.076683 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:36.078783 (+ 2100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:36.078791 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:36.078796 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:36.078825 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:36.081216 (+ 2391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:36.081859 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:36.081862 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:36.081864 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:36.082005 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:36.082346 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:36.082349 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:36.082351 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:36.082621 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:36.082796 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:36.083048 (+ 252us) server_negotiation.cc:299] Negotiation successful
0809 19:09:36.083224 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 19:09:36.087226 13998 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43002:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:09:36.093942 13998 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:09:36.116065 14810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:36.106079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:38899 (local address 127.0.0.1:38036)
0809 19:09:36.106803 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:36.106854 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:36.107039 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:36.108060 (+ 1021us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:36.108068 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:36.108100 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:36.108466 (+ 366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:36.108478 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:36.110485 (+ 2007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:36.110491 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:36.112840 (+ 2349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:36.112857 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:36.114995 (+ 2138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:36.115002 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:36.115227 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:36.115278 (+ 51us) client_negotiation.cc:769] Sending connection context
0809 19:09:36.115406 (+ 128us) client_negotiation.cc:240] Negotiation successful
0809 19:09:36.115675 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":359,"threads_started":1}
I20260809 19:09:36.117273 14814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:36.106381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38036 (local address 127.7.39.2:38899)
0809 19:09:36.106858 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:36.106866 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:36.106936 (+ 70us) server_negotiation.cc:407] Connection header received
0809 19:09:36.107309 (+ 373us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:36.107318 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:36.107575 (+ 257us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:36.107765 (+ 190us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:36.108671 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:36.110314 (+ 1643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:36.113057 (+ 2743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:36.114518 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:36.114642 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:36.114845 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:36.116762 (+ 1917us) server_negotiation.cc:299] Negotiation successful
0809 19:09:36.116957 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":722,"threads_started":1}
I20260809 19:09:36.126143 14321 heartbeater.cc:503] Master 127.7.39.62:34755 was elected leader, sending a full tablet report...
I20260809 19:09:36.125756 14427 tablet_service.cc:1467] Processing CreateTablet for tablet 117665eacda142c2818243e51cf57491 (DEFAULT_TABLE table=test-table [id=980551ae140a47f7b1e9045f6d594a07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:09:36.127231 14810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:36.106758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:39623 (local address 127.0.0.1:43754)
0809 19:09:36.116424 (+ 9666us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:36.116445 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:36.116542 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:36.121082 (+ 4540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:36.121087 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:36.121120 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:36.121287 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:36.121296 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:36.123200 (+ 1904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:36.123205 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:36.124420 (+ 1215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:36.124434 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:36.126484 (+ 2050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:36.126490 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:36.126668 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:36.126702 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 19:09:36.126791 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 19:09:36.126923 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9540,"thread_start_us":13197,"threads_started":1}
I20260809 19:09:36.127738 14427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 117665eacda142c2818243e51cf57491. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:36.127998 14818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:36.107245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43754 (local address 127.7.39.1:39623)
0809 19:09:36.120578 (+ 13333us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:36.120585 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:36.120609 (+ 24us) server_negotiation.cc:407] Connection header received
0809 19:09:36.120696 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:36.120702 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:36.120885 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:36.121052 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:36.121460 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:36.122984 (+ 1524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:36.124601 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:36.125985 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:36.126115 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:36.126385 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:36.127513 (+ 1128us) server_negotiation.cc:299] Negotiation successful
0809 19:09:36.127690 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13176,"thread_start_us":13034,"threads_started":1}
I20260809 19:09:36.128273 14815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:36.107204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:44775 (local address 127.0.0.1:45286)
0809 19:09:36.119738 (+ 12534us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:36.119757 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:36.119870 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:36.122244 (+ 2374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:36.122248 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:36.122274 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:36.122656 (+ 382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:36.122669 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:36.124520 (+ 1851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:36.124525 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:36.125783 (+ 1258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:36.125795 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:36.127549 (+ 1754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:36.127556 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:36.127716 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:36.127749 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 19:09:36.127817 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 19:09:36.127939 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12413,"thread_start_us":14349,"threads_started":1}
I20260809 19:09:36.128901 14821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:36.107797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45286 (local address 127.7.39.3:44775)
0809 19:09:36.121673 (+ 13876us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:36.121682 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:36.121716 (+ 34us) server_negotiation.cc:407] Connection header received
0809 19:09:36.121810 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:36.121818 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:36.122054 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:36.122237 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:36.122896 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:36.124383 (+ 1487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:36.125939 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:36.127312 (+ 1373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:36.128113 (+ 801us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:36.128360 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:36.128430 (+ 70us) server_negotiation.cc:299] Negotiation successful
0809 19:09:36.128593 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13700,"thread_start_us":13526,"threads_started":1}
I20260809 19:09:36.131789 14214 tablet_service.cc:1467] Processing CreateTablet for tablet 117665eacda142c2818243e51cf57491 (DEFAULT_TABLE table=test-table [id=980551ae140a47f7b1e9045f6d594a07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:09:36.132884 14214 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 117665eacda142c2818243e51cf57491. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:36.132501 14664 tablet_service.cc:1467] Processing CreateTablet for tablet 117665eacda142c2818243e51cf57491 (DEFAULT_TABLE table=test-table [id=980551ae140a47f7b1e9045f6d594a07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:09:36.133850 14664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 117665eacda142c2818243e51cf57491. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:36.143208 14822 tablet_bootstrap.cc:492] T 117665eacda142c2818243e51cf57491 P 5b155c33b8d24bdab9eb4533f98f445b: Bootstrap starting.
I20260809 19:09:36.144176 14823 tablet_bootstrap.cc:492] T 117665eacda142c2818243e51cf57491 P c72aca2ab0854a1ebbf486b755080919: Bootstrap starting.
I20260809 19:09:36.147434 14822 tablet_bootstrap.cc:654] T 117665eacda142c2818243e51cf57491 P 5b155c33b8d24bdab9eb4533f98f445b: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:36.147820 14823 tablet_bootstrap.cc:654] T 117665eacda142c2818243e51cf57491 P c72aca2ab0854a1ebbf486b755080919: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:36.148111 14828 tablet_bootstrap.cc:492] T 117665eacda142c2818243e51cf57491 P 39066cf7c9784586a43250f91312992f: Bootstrap starting.
I20260809 19:09:36.148772 14822 log.cc:824] T 117665eacda142c2818243e51cf57491 P 5b155c33b8d24bdab9eb4533f98f445b: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:36.149070 14823 log.cc:824] T 117665eacda142c2818243e51cf57491 P c72aca2ab0854a1ebbf486b755080919: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:36.151171 14828 tablet_bootstrap.cc:654] T 117665eacda142c2818243e51cf57491 P 39066cf7c9784586a43250f91312992f: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:36.151810 14822 tablet_bootstrap.cc:492] T 117665eacda142c2818243e51cf57491 P 5b155c33b8d24bdab9eb4533f98f445b: No bootstrap required, opened a new log
I20260809 19:09:36.151988 14823 tablet_bootstrap.cc:492] T 117665eacda142c2818243e51cf57491 P c72aca2ab0854a1ebbf486b755080919: No bootstrap required, opened a new log
I20260809 19:09:36.152099 14822 ts_tablet_manager.cc:1397] T 117665eacda142c2818243e51cf57491 P 5b155c33b8d24bdab9eb4533f98f445b: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.004s
I20260809 19:09:36.152122 14828 log.cc:824] T 117665eacda142c2818243e51cf57491 P 39066cf7c9784586a43250f91312992f: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:36.152241 14823 ts_tablet_manager.cc:1397] T 117665eacda142c2818243e51cf57491 P c72aca2ab0854a1ebbf486b755080919: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260809 19:09:36.154484 14828 tablet_bootstrap.cc:492] T 117665eacda142c2818243e51cf57491 P 39066cf7c9784586a43250f91312992f: No bootstrap required, opened a new log
I20260809 19:09:36.154791 14828 ts_tablet_manager.cc:1397] T 117665eacda142c2818243e51cf57491 P 39066cf7c9784586a43250f91312992f: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260809 19:09:36.161520 14828 raft_consensus.cc:348] T 117665eacda142c2818243e51cf57491 P 39066cf7c9784586a43250f91312992f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b155c33b8d24bdab9eb4533f98f445b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 38899 } } peers { permanent_uuid: "39066cf7c9784586a43250f91312992f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 44775 } } peers { permanent_uuid: "c72aca2ab0854a1ebbf486b755080919" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 39623 } }
I20260809 19:09:36.161839 14828 raft_consensus.cc:374] T 117665eacda142c2818243e51cf57491 P 39066cf7c9784586a43250f91312992f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:36.161963 14828 raft_consensus.cc:729] T 117665eacda142c2818243e51cf57491 P 39066cf7c9784586a43250f91312992f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39066cf7c9784586a43250f91312992f, State: Initialized, Role: FOLLOWER
I20260809 19:09:36.162307 14823 raft_consensus.cc:348] T 117665eacda142c2818243e51cf57491 P c72aca2ab0854a1ebbf486b755080919 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b155c33b8d24bdab9eb4533f98f445b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 38899 } } peers { permanent_uuid: "39066cf7c9784586a43250f91312992f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 44775 } } peers { permanent_uuid: "c72aca2ab0854a1ebbf486b755080919" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 39623 } }
I20260809 19:09:36.162307 14822 raft_consensus.cc:348] T 117665eacda142c2818243e51cf57491 P 5b155c33b8d24bdab9eb4533f98f445b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b155c33b8d24bdab9eb4533f98f445b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 38899 } } peers { permanent_uuid: "39066cf7c9784586a43250f91312992f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 44775 } } peers { permanent_uuid: "c72aca2ab0854a1ebbf486b755080919" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 39623 } }
I20260809 19:09:36.162541 14828 consensus_queue.cc:260] T 117665eacda142c2818243e51cf57491 P 39066cf7c9784586a43250f91312992f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b155c33b8d24bdab9eb4533f98f445b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 38899 } } peers { permanent_uuid: "39066cf7c9784586a43250f91312992f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 44775 } } peers { permanent_uuid: "c72aca2ab0854a1ebbf486b755080919" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 39623 } }
I20260809 19:09:36.162719 14822 raft_consensus.cc:374] T 117665eacda142c2818243e51cf57491 P 5b155c33b8d24bdab9eb4533f98f445b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:36.162722 14823 raft_consensus.cc:374] T 117665eacda142c2818243e51cf57491 P c72aca2ab0854a1ebbf486b755080919 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:36.162818 14823 raft_consensus.cc:729] T 117665eacda142c2818243e51cf57491 P c72aca2ab0854a1ebbf486b755080919 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c72aca2ab0854a1ebbf486b755080919, State: Initialized, Role: FOLLOWER
I20260809 19:09:36.162860 14822 raft_consensus.cc:729] T 117665eacda142c2818243e51cf57491 P 5b155c33b8d24bdab9eb4533f98f445b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b155c33b8d24bdab9eb4533f98f445b, State: Initialized, Role: FOLLOWER
I20260809 19:09:36.163403 14823 consensus_queue.cc:260] T 117665eacda142c2818243e51cf57491 P c72aca2ab0854a1ebbf486b755080919 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b155c33b8d24bdab9eb4533f98f445b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 38899 } } peers { permanent_uuid: "39066cf7c9784586a43250f91312992f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 44775 } } peers { permanent_uuid: "c72aca2ab0854a1ebbf486b755080919" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 39623 } }
I20260809 19:09:36.163604 14787 heartbeater.cc:503] Master 127.7.39.62:34755 was elected leader, sending a full tablet report...
I20260809 19:09:36.164225 14828 ts_tablet_manager.cc:1428] T 117665eacda142c2818243e51cf57491 P 39066cf7c9784586a43250f91312992f: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260809 19:09:36.164661 14822 consensus_queue.cc:260] T 117665eacda142c2818243e51cf57491 P 5b155c33b8d24bdab9eb4533f98f445b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b155c33b8d24bdab9eb4533f98f445b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 38899 } } peers { permanent_uuid: "39066cf7c9784586a43250f91312992f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 44775 } } peers { permanent_uuid: "c72aca2ab0854a1ebbf486b755080919" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 39623 } }
I20260809 19:09:36.165112 14823 ts_tablet_manager.cc:1428] T 117665eacda142c2818243e51cf57491 P c72aca2ab0854a1ebbf486b755080919: Time spent starting tablet: real 0.013s user 0.006s sys 0.008s
I20260809 19:09:36.166235 14549 heartbeater.cc:503] Master 127.7.39.62:34755 was elected leader, sending a full tablet report...
I20260809 19:09:36.166800 14822 ts_tablet_manager.cc:1428] T 117665eacda142c2818243e51cf57491 P 5b155c33b8d24bdab9eb4533f98f445b: Time spent starting tablet: real 0.015s user 0.014s sys 0.001s
W20260809 19:09:36.287235 14789 tablet.cc:2369] T 117665eacda142c2818243e51cf57491 P 39066cf7c9784586a43250f91312992f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 19:09:36.316217 14551 tablet.cc:2369] T 117665eacda142c2818243e51cf57491 P 5b155c33b8d24bdab9eb4533f98f445b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:09:36.329793 14843 raft_consensus.cc:482] T 117665eacda142c2818243e51cf57491 P 5b155c33b8d24bdab9eb4533f98f445b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:09:36.330065 14843 raft_consensus.cc:504] T 117665eacda142c2818243e51cf57491 P 5b155c33b8d24bdab9eb4533f98f445b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b155c33b8d24bdab9eb4533f98f445b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 38899 } } peers { permanent_uuid: "39066cf7c9784586a43250f91312992f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 44775 } } peers { permanent_uuid: "c72aca2ab0854a1ebbf486b755080919" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 39623 } }
I20260809 19:09:36.332023 14843 leader_election.cc:288] T 117665eacda142c2818243e51cf57491 P 5b155c33b8d24bdab9eb4533f98f445b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39066cf7c9784586a43250f91312992f (127.7.39.3:44775), c72aca2ab0854a1ebbf486b755080919 (127.7.39.1:39623)
I20260809 19:09:36.338517 14818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:36.332631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:55535 (local address 127.7.39.1:39623)
0809 19:09:36.332842 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:36.332848 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:36.333445 (+ 597us) server_negotiation.cc:407] Connection header received
0809 19:09:36.333602 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:36.333607 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:36.333666 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:36.333740 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:36.334369 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:36.335058 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:36.336809 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:36.337549 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:36.337668 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:36.337769 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:36.338135 (+ 366us) server_negotiation.cc:299] Negotiation successful
0809 19:09:36.338259 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 19:09:36.338521 14821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:36.332430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:44809 (local address 127.7.39.3:44775)
0809 19:09:36.332658 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:36.332664 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:36.333393 (+ 729us) server_negotiation.cc:407] Connection header received
0809 19:09:36.333578 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:36.333584 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:36.333650 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:36.333724 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:36.334341 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:36.335042 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:36.336815 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:36.337595 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:36.337707 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:36.337805 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:36.338143 (+ 338us) server_negotiation.cc:299] Negotiation successful
0809 19:09:36.338265 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 19:09:36.338970 14845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:36.332441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:39623 (local address 127.7.39.2:55535)
0809 19:09:36.333333 (+ 892us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:36.333347 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:36.333469 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:36.333761 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:36.333765 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:36.333794 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:36.334217 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:36.334225 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:36.335183 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:36.335188 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:36.336661 (+ 1473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:36.336674 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:36.337774 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:36.337781 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:36.337971 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:36.338005 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 19:09:36.338089 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 19:09:36.338201 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":797,"mutex_wait_us":119,"thread_start_us":532,"threads_started":1}
I20260809 19:09:36.338977 14844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:36.332435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:44775 (local address 127.7.39.2:44809)
0809 19:09:36.333286 (+ 851us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:36.333305 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:36.333447 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:36.333749 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:36.333752 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:36.333775 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:36.334177 (+ 402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:36.334190 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:36.335167 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:36.335172 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:36.336672 (+ 1500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:36.336683 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:36.337814 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:36.337821 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:36.337981 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:36.338022 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 19:09:36.338101 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 19:09:36.338216 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":706,"mutex_wait_us":31,"thread_start_us":416,"threads_started":1}
I20260809 19:09:36.340090 14248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "117665eacda142c2818243e51cf57491" candidate_uuid: "5b155c33b8d24bdab9eb4533f98f445b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72aca2ab0854a1ebbf486b755080919" is_pre_election: true
I20260809 19:09:36.340435 14698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "117665eacda142c2818243e51cf57491" candidate_uuid: "5b155c33b8d24bdab9eb4533f98f445b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39066cf7c9784586a43250f91312992f" is_pre_election: true
I20260809 19:09:36.340571 14248 raft_consensus.cc:2454] T 117665eacda142c2818243e51cf57491 P c72aca2ab0854a1ebbf486b755080919 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b155c33b8d24bdab9eb4533f98f445b in term 0.
I20260809 19:09:36.340864 14698 raft_consensus.cc:2454] T 117665eacda142c2818243e51cf57491 P 39066cf7c9784586a43250f91312992f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b155c33b8d24bdab9eb4533f98f445b in term 0.
I20260809 19:09:36.341210 14354 leader_election.cc:302] T 117665eacda142c2818243e51cf57491 P 5b155c33b8d24bdab9eb4533f98f445b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b155c33b8d24bdab9eb4533f98f445b, c72aca2ab0854a1ebbf486b755080919; no voters:
I20260809 19:09:36.341602 14843 raft_consensus.cc:2781] T 117665eacda142c2818243e51cf57491 P 5b155c33b8d24bdab9eb4533f98f445b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:09:36.341735 14843 raft_consensus.cc:482] T 117665eacda142c2818243e51cf57491 P 5b155c33b8d24bdab9eb4533f98f445b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:09:36.341840 14843 raft_consensus.cc:3037] T 117665eacda142c2818243e51cf57491 P 5b155c33b8d24bdab9eb4533f98f445b [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:36.344018 14843 raft_consensus.cc:504] T 117665eacda142c2818243e51cf57491 P 5b155c33b8d24bdab9eb4533f98f445b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b155c33b8d24bdab9eb4533f98f445b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 38899 } } peers { permanent_uuid: "39066cf7c9784586a43250f91312992f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 44775 } } peers { permanent_uuid: "c72aca2ab0854a1ebbf486b755080919" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 39623 } }
I20260809 19:09:36.344527 14843 leader_election.cc:288] T 117665eacda142c2818243e51cf57491 P 5b155c33b8d24bdab9eb4533f98f445b [CANDIDATE]: Term 1 election: Requested vote from peers 39066cf7c9784586a43250f91312992f (127.7.39.3:44775), c72aca2ab0854a1ebbf486b755080919 (127.7.39.1:39623)
I20260809 19:09:36.344973 14698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "117665eacda142c2818243e51cf57491" candidate_uuid: "5b155c33b8d24bdab9eb4533f98f445b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39066cf7c9784586a43250f91312992f"
I20260809 19:09:36.345005 14248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "117665eacda142c2818243e51cf57491" candidate_uuid: "5b155c33b8d24bdab9eb4533f98f445b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72aca2ab0854a1ebbf486b755080919"
I20260809 19:09:36.345135 14698 raft_consensus.cc:3037] T 117665eacda142c2818243e51cf57491 P 39066cf7c9784586a43250f91312992f [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:36.345170 14248 raft_consensus.cc:3037] T 117665eacda142c2818243e51cf57491 P c72aca2ab0854a1ebbf486b755080919 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:36.347265 14698 raft_consensus.cc:2454] T 117665eacda142c2818243e51cf57491 P 39066cf7c9784586a43250f91312992f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b155c33b8d24bdab9eb4533f98f445b in term 1.
I20260809 19:09:36.347366 14248 raft_consensus.cc:2454] T 117665eacda142c2818243e51cf57491 P c72aca2ab0854a1ebbf486b755080919 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b155c33b8d24bdab9eb4533f98f445b in term 1.
I20260809 19:09:36.347707 14355 leader_election.cc:302] T 117665eacda142c2818243e51cf57491 P 5b155c33b8d24bdab9eb4533f98f445b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39066cf7c9784586a43250f91312992f, 5b155c33b8d24bdab9eb4533f98f445b; no voters:
I20260809 19:09:36.347970 14843 raft_consensus.cc:2781] T 117665eacda142c2818243e51cf57491 P 5b155c33b8d24bdab9eb4533f98f445b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:09:36.348362 14843 raft_consensus.cc:686] T 117665eacda142c2818243e51cf57491 P 5b155c33b8d24bdab9eb4533f98f445b [term 1 LEADER]: Becoming Leader. State: Replica: 5b155c33b8d24bdab9eb4533f98f445b, State: Running, Role: LEADER
I20260809 19:09:36.348856 14843 consensus_queue.cc:237] T 117665eacda142c2818243e51cf57491 P 5b155c33b8d24bdab9eb4533f98f445b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b155c33b8d24bdab9eb4533f98f445b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 38899 } } peers { permanent_uuid: "39066cf7c9784586a43250f91312992f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 44775 } } peers { permanent_uuid: "c72aca2ab0854a1ebbf486b755080919" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 39623 } }
W20260809 19:09:36.349730 14322 tablet.cc:2369] T 117665eacda142c2818243e51cf57491 P c72aca2ab0854a1ebbf486b755080919: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:09:36.353031 13995 catalog_manager.cc:5495] T 117665eacda142c2818243e51cf57491 P 5b155c33b8d24bdab9eb4533f98f445b reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b155c33b8d24bdab9eb4533f98f445b (127.7.39.2). New cstate: current_term: 1 leader_uuid: "5b155c33b8d24bdab9eb4533f98f445b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b155c33b8d24bdab9eb4533f98f445b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 38899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39066cf7c9784586a43250f91312992f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 44775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c72aca2ab0854a1ebbf486b755080919" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 39623 } health_report { overall_health: UNKNOWN } } }
I20260809 19:09:36.407895 14814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:36.403065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38052 (local address 127.7.39.2:38899)
0809 19:09:36.403228 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:36.403233 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:36.403366 (+ 133us) server_negotiation.cc:407] Connection header received
0809 19:09:36.403542 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:36.403547 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:36.403620 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:36.403731 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:09:36.404046 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:36.404693 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:36.406111 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:36.406548 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:36.406649 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:36.407031 (+ 382us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:09:36.407478 (+ 447us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:09:36.407587 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:36.407628 (+ 41us) server_negotiation.cc:299] Negotiation successful
0809 19:09:36.407690 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 19:09:36.415323 14248 raft_consensus.cc:1261] T 117665eacda142c2818243e51cf57491 P c72aca2ab0854a1ebbf486b755080919 [term 1 FOLLOWER]: Refusing update from remote peer 5b155c33b8d24bdab9eb4533f98f445b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:09:36.415340 14698 raft_consensus.cc:1261] T 117665eacda142c2818243e51cf57491 P 39066cf7c9784586a43250f91312992f [term 1 FOLLOWER]: Refusing update from remote peer 5b155c33b8d24bdab9eb4533f98f445b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:09:36.416261 14846 consensus_queue.cc:1035] T 117665eacda142c2818243e51cf57491 P 5b155c33b8d24bdab9eb4533f98f445b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c72aca2ab0854a1ebbf486b755080919" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 39623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:09:36.416575 14843 consensus_queue.cc:1035] T 117665eacda142c2818243e51cf57491 P 5b155c33b8d24bdab9eb4533f98f445b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39066cf7c9784586a43250f91312992f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 44775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:09:36.426795 14850 mvcc.cc:205] Tried to move back new op lower bound from 7316695352988549120 to 7316695352728498176. Current Snapshot: MvccSnapshot[applied={T|T < 7316695352988549120}]
I20260809 19:09:36.427932 14851 mvcc.cc:205] Tried to move back new op lower bound from 7316695352988549120 to 7316695352728498176. Current Snapshot: MvccSnapshot[applied={T|T < 7316695352988549120}]
I20260809 19:09:36.439364 13998 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43002:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:09:36.439600 13998 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43002:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:09:36.442816 13998 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5401e2c3b3164f0c9f5c98f0748b4c2b: Sending DeleteTablet for 3 replicas of tablet 117665eacda142c2818243e51cf57491
I20260809 19:09:36.443811 14664 tablet_service.cc:1514] Processing DeleteTablet for tablet 117665eacda142c2818243e51cf57491 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:09:36 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:45286
I20260809 19:09:36.443815 14427 tablet_service.cc:1514] Processing DeleteTablet for tablet 117665eacda142c2818243e51cf57491 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:09:36 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:38036
I20260809 19:09:36.444088 14214 tablet_service.cc:1514] Processing DeleteTablet for tablet 117665eacda142c2818243e51cf57491 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:09:36 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:43754
I20260809 19:09:36.449455 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 14103
I20260809 19:09:36.456146 14864 tablet_replica.cc:330] T 117665eacda142c2818243e51cf57491 P 5b155c33b8d24bdab9eb4533f98f445b: stopping tablet replica
I20260809 19:09:36.456591 14864 raft_consensus.cc:2229] T 117665eacda142c2818243e51cf57491 P 5b155c33b8d24bdab9eb4533f98f445b [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:09:36.457208 14864 raft_consensus.cc:2258] T 117665eacda142c2818243e51cf57491 P 5b155c33b8d24bdab9eb4533f98f445b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:09:36.457989 14865 tablet_replica.cc:330] T 117665eacda142c2818243e51cf57491 P 39066cf7c9784586a43250f91312992f: stopping tablet replica
I20260809 19:09:36.459802 14864 ts_tablet_manager.cc:1905] T 117665eacda142c2818243e51cf57491 P 5b155c33b8d24bdab9eb4533f98f445b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:09:36.460275 14865 raft_consensus.cc:2229] T 117665eacda142c2818243e51cf57491 P 39066cf7c9784586a43250f91312992f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:09:36.460829 14865 raft_consensus.cc:2258] T 117665eacda142c2818243e51cf57491 P 39066cf7c9784586a43250f91312992f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:09:36.461328 14866 tablet_replica.cc:330] T 117665eacda142c2818243e51cf57491 P c72aca2ab0854a1ebbf486b755080919: stopping tablet replica
I20260809 19:09:36.462891 14865 ts_tablet_manager.cc:1905] T 117665eacda142c2818243e51cf57491 P 39066cf7c9784586a43250f91312992f: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 09 19:09:36 dist-test-slave-4tdj krb5kdc[13927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302574, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.1@KRBTEST.COM
I20260809 19:09:36.466187 14866 raft_consensus.cc:2229] T 117665eacda142c2818243e51cf57491 P c72aca2ab0854a1ebbf486b755080919 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:09:36.468457 14864 ts_tablet_manager.cc:1918] T 117665eacda142c2818243e51cf57491 P 5b155c33b8d24bdab9eb4533f98f445b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:09:36.468709 14864 log.cc:1196] T 117665eacda142c2818243e51cf57491 P 5b155c33b8d24bdab9eb4533f98f445b: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-1/wal/wals/117665eacda142c2818243e51cf57491
I20260809 19:09:36.469345 14864 ts_tablet_manager.cc:1939] T 117665eacda142c2818243e51cf57491 P 5b155c33b8d24bdab9eb4533f98f445b: Deleting consensus metadata
I20260809 19:09:36.469686 14865 ts_tablet_manager.cc:1918] T 117665eacda142c2818243e51cf57491 P 39066cf7c9784586a43250f91312992f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:09:36.469916 14865 log.cc:1196] T 117665eacda142c2818243e51cf57491 P 39066cf7c9784586a43250f91312992f: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786302538618573-7324-0/minicluster-data/ts-2/wal/wals/117665eacda142c2818243e51cf57491
I20260809 19:09:36.470498 14865 ts_tablet_manager.cc:1939] T 117665eacda142c2818243e51cf57491 P 39066cf7c9784586a43250f91312992f: Deleting consensus metadata
I20260809 19:09:36.470705 14866 raft_consensus.cc:2258] T 117665eacda142c2818243e51cf57491 P c72aca2ab0854a1ebbf486b755080919 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:09:36.471860 13972 catalog_manager.cc:4841] TS 5b155c33b8d24bdab9eb4533f98f445b (127.7.39.2:38899): tablet 117665eacda142c2818243e51cf57491 (table test-table [id=980551ae140a47f7b1e9045f6d594a07]) successfully deleted
I20260809 19:09:36.472417 13972 catalog_manager.cc:4841] TS 39066cf7c9784586a43250f91312992f (127.7.39.3:44775): tablet 117665eacda142c2818243e51cf57491 (table test-table [id=980551ae140a47f7b1e9045f6d594a07]) successfully deleted
I20260809 19:09:36.473806 14866 ts_tablet_manager.cc:1905] T 117665eacda142c2818243e51cf57491 P c72aca2ab0854a1ebbf486b755080919: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:09:36.474363 14818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:36.450811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43768 (local address 127.7.39.1:39623)
0809 19:09:36.450994 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:36.451001 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:36.452446 (+ 1445us) server_negotiation.cc:407] Connection header received
0809 19:09:36.452631 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:36.452638 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:36.452723 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:36.452807 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:36.456364 (+ 3557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:36.457487 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:36.459459 (+ 1972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:36.460080 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:36.460180 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:36.466503 (+ 6323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:36.466520 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:36.466536 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:36.466577 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:36.470640 (+ 4063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:36.471556 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:36.471566 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:36.471569 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:36.471728 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:36.472259 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:36.472264 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:36.472267 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:36.472723 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:36.473019 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:36.473611 (+ 592us) server_negotiation.cc:299] Negotiation successful
0809 19:09:36.473835 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 19:09:36.475059 14314 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:36.599862 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 14103
I20260809 19:09:36.621057 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 14331
W20260809 19:09:36.621083 13971 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.39.1:39623 (error 108)
I20260809 19:09:36.624785 14815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:36.624294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:39623 (local address 127.0.0.1:43784)
0809 19:09:36.624479 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:36.624625 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:39623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260809 19:09:36.625154 13971 catalog_manager.cc:4584] TS c72aca2ab0854a1ebbf486b755080919 (127.7.39.1:39623): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 117665eacda142c2818243e51cf57491: Network error: Client connection negotiation failed: client connection to 127.7.39.1:39623: connect: Connection refused (error 111)
Aug 09 19:09:36 dist-test-slave-4tdj krb5kdc[13927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302574, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.2@KRBTEST.COM
I20260809 19:09:36.636659 14814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:36.621867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38062 (local address 127.7.39.2:38899)
0809 19:09:36.622057 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:36.622062 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:36.622085 (+ 23us) server_negotiation.cc:407] Connection header received
0809 19:09:36.622234 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:36.622239 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:36.622344 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:36.622453 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:36.624078 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:36.625114 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:36.626502 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:36.626932 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:36.627054 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:36.630945 (+ 3891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:36.630956 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:36.630970 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:36.631007 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:36.633751 (+ 2744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:36.634575 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:36.634582 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:36.634585 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:36.634723 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:36.635120 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:36.635126 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:36.635129 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:36.635565 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:36.635911 (+ 346us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:36.636076 (+ 165us) server_negotiation.cc:299] Negotiation successful
0809 19:09:36.636298 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 19:09:36.637358 14543 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:36.678825 14815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:36.678273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:39623 (local address 127.0.0.1:43798)
0809 19:09:36.678515 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:36.678629 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:39623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260809 19:09:36.679873 14815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:36.679514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:39623 (local address 127.0.0.1:43808)
0809 19:09:36.679651 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:36.679740 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:39623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260809 19:09:36.740602 14815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:36.740000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:39623 (local address 127.0.0.1:43824)
0809 19:09:36.740262 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:36.740380 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:39623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260809 19:09:36.741592 14815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:36.741249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:39623 (local address 127.0.0.1:43836)
0809 19:09:36.741378 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:36.741456 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:39623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260809 19:09:36.750674 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 14331
I20260809 19:09:36.775413 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 14557
Aug 09 19:09:36 dist-test-slave-4tdj krb5kdc[13927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302574, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.3@KRBTEST.COM
I20260809 19:09:36.789367 14821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:36.776142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45302 (local address 127.7.39.3:44775)
0809 19:09:36.776302 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:36.776306 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:36.776347 (+ 41us) server_negotiation.cc:407] Connection header received
0809 19:09:36.776496 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:36.776501 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:36.776572 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:36.776652 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:36.777822 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:36.778595 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:36.779835 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:36.780216 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:36.780349 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:36.784612 (+ 4263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:36.784625 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:36.784641 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:36.784681 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:36.787138 (+ 2457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:36.787703 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:36.787710 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:36.787712 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:36.787857 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:36.788151 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:36.788154 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:36.788156 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:36.788481 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:36.788705 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:36.788939 (+ 234us) server_negotiation.cc:299] Negotiation successful
0809 19:09:36.789121 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 19:09:36.789968 14778 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:36.822363 14815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:36.821806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:39623 (local address 127.0.0.1:43838)
0809 19:09:36.822041 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:36.822147 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:39623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260809 19:09:36.823405 14815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:36.822987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:39623 (local address 127.0.0.1:43840)
0809 19:09:36.823172 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:36.823279 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:39623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260809 19:09:36.875569 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 14557
I20260809 19:09:36.896471 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 13953
I20260809 19:09:36.897604 14050 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:37.001945 14815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:37.001305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:39623 (local address 127.0.0.1:43850)
0809 19:09:37.001664 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:37.001761 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:39623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207}
I20260809 19:09:37.002087 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 13953
2026-08-09T19:09:37Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4245 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-09T19:09:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:09:37Z Disabled control of system clock
I20260809 19:09:37.075799 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:41083
--webserver_interface=127.7.39.62
--webserver_port=0
--builtin_ntp_servers=127.7.39.20:38625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:41083
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 19:09:37.384142 14888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:37.384392 14888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:37.384481 14888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:37.391342 14888 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:09:37.391434 14888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:37.391479 14888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:37.391532 14888 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:09:37.391583 14888 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:09:37.400081 14888 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:38625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:41083
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:41083
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:37.401152 14888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:37.402791 14888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:37.413501 14903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:37.413471 14908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:37.413429 14905 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:37.414199 14888 server_base.cc:1034] running on GCE node
I20260809 19:09:37.414964 14888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:37.416235 14888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:37.417433 14888 hybrid_clock.cc:648] HybridClock initialized: now 1786302577417393 us; error 31 us; skew 500 ppm
I20260809 19:09:37.417752 14888 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:09:37.419783 14888 webserver.cc:460] Webserver started at http://127.7.39.62:40767/ using document root <none> and password file <none>
I20260809 19:09:37.420389 14888 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:37.420486 14888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:37.420787 14888 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:37.423496 14888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "e51ff2746bbc40feaf748b744bd397b3"
format_stamp: "Formatted at 2026-08-09 19:09:37 on dist-test-slave-4tdj"
server_key: "1fb385390f5eda039d44831915c2e793"
server_key_iv: "84b41d2f945d6396fd8bd43fe88d3e7f"
server_key_version: "encryptionkey@0"
I20260809 19:09:37.424221 14888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "e51ff2746bbc40feaf748b744bd397b3"
format_stamp: "Formatted at 2026-08-09 19:09:37 on dist-test-slave-4tdj"
server_key: "1fb385390f5eda039d44831915c2e793"
server_key_iv: "84b41d2f945d6396fd8bd43fe88d3e7f"
server_key_version: "encryptionkey@0"
I20260809 19:09:37.428921 14888 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 19:09:37.432008 14920 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:37.433154 14888 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 19:09:37.433307 14888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "e51ff2746bbc40feaf748b744bd397b3"
format_stamp: "Formatted at 2026-08-09 19:09:37 on dist-test-slave-4tdj"
server_key: "1fb385390f5eda039d44831915c2e793"
server_key_iv: "84b41d2f945d6396fd8bd43fe88d3e7f"
server_key_version: "encryptionkey@0"
I20260809 19:09:37.433490 14888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:37.438917 14888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:37.439589 14888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:37.439839 14888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:37.456037 14888 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:41083
I20260809 19:09:37.456072 15011 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:41083 every 8 connection(s)
I20260809 19:09:37.457185 14888 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:09:37.460445 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 14888
I20260809 19:09:37.460639 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:09:37.460780 15012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:37.461452 7324 external_mini_cluster.cc:1428] Setting key 3599af132574f029b76ea9333fe8cdb9
I20260809 19:09:37.469655 15016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:37.463422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60054 (local address 127.7.39.62:41083)
0809 19:09:37.464387 (+ 965us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:37.464397 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:37.464441 (+ 44us) server_negotiation.cc:407] Connection header received
0809 19:09:37.466550 (+ 2109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:37.466571 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:37.466936 (+ 365us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:37.467257 (+ 321us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:37.468267 (+ 1010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:37.468273 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:37.468285 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:09:37.468298 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:37.468356 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:09:37.468370 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:37.468527 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:37.468624 (+ 97us) server_negotiation.cc:299] Negotiation successful
0809 19:09:37.468822 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":567,"thread_start_us":363,"threads_started":1}
I20260809 19:09:37.473030 15012 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e51ff2746bbc40feaf748b744bd397b3: Bootstrap starting.
I20260809 19:09:37.475817 15012 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e51ff2746bbc40feaf748b744bd397b3: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:37.476820 15012 log.cc:824] T 00000000000000000000000000000000 P e51ff2746bbc40feaf748b744bd397b3: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:37.479562 15012 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e51ff2746bbc40feaf748b744bd397b3: No bootstrap required, opened a new log
I20260809 19:09:37.486284 15012 raft_consensus.cc:348] T 00000000000000000000000000000000 P e51ff2746bbc40feaf748b744bd397b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e51ff2746bbc40feaf748b744bd397b3" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 41083 } }
I20260809 19:09:37.486651 15012 raft_consensus.cc:374] T 00000000000000000000000000000000 P e51ff2746bbc40feaf748b744bd397b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:37.486742 15012 raft_consensus.cc:729] T 00000000000000000000000000000000 P e51ff2746bbc40feaf748b744bd397b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51ff2746bbc40feaf748b744bd397b3, State: Initialized, Role: FOLLOWER
I20260809 19:09:37.487352 15012 consensus_queue.cc:260] T 00000000000000000000000000000000 P e51ff2746bbc40feaf748b744bd397b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e51ff2746bbc40feaf748b744bd397b3" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 41083 } }
I20260809 19:09:37.487608 15012 raft_consensus.cc:388] T 00000000000000000000000000000000 P e51ff2746bbc40feaf748b744bd397b3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:09:37.487730 15012 raft_consensus.cc:482] T 00000000000000000000000000000000 P e51ff2746bbc40feaf748b744bd397b3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:09:37.487876 15012 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e51ff2746bbc40feaf748b744bd397b3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:37.489845 15012 raft_consensus.cc:504] T 00000000000000000000000000000000 P e51ff2746bbc40feaf748b744bd397b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e51ff2746bbc40feaf748b744bd397b3" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 41083 } }
I20260809 19:09:37.490345 15012 leader_election.cc:302] T 00000000000000000000000000000000 P e51ff2746bbc40feaf748b744bd397b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e51ff2746bbc40feaf748b744bd397b3; no voters:
I20260809 19:09:37.490890 15012 leader_election.cc:288] T 00000000000000000000000000000000 P e51ff2746bbc40feaf748b744bd397b3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:09:37.490998 15018 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e51ff2746bbc40feaf748b744bd397b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:09:37.491644 15018 raft_consensus.cc:686] T 00000000000000000000000000000000 P e51ff2746bbc40feaf748b744bd397b3 [term 1 LEADER]: Becoming Leader. State: Replica: e51ff2746bbc40feaf748b744bd397b3, State: Running, Role: LEADER
I20260809 19:09:37.492197 15018 consensus_queue.cc:237] T 00000000000000000000000000000000 P e51ff2746bbc40feaf748b744bd397b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e51ff2746bbc40feaf748b744bd397b3" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 41083 } }
I20260809 19:09:37.492753 15012 sys_catalog.cc:564] T 00000000000000000000000000000000 P e51ff2746bbc40feaf748b744bd397b3 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:09:37.494628 15022 sys_catalog.cc:455] T 00000000000000000000000000000000 P e51ff2746bbc40feaf748b744bd397b3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e51ff2746bbc40feaf748b744bd397b3. Latest consensus state: current_term: 1 leader_uuid: "e51ff2746bbc40feaf748b744bd397b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e51ff2746bbc40feaf748b744bd397b3" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 41083 } } }
I20260809 19:09:37.494972 15022 sys_catalog.cc:458] T 00000000000000000000000000000000 P e51ff2746bbc40feaf748b744bd397b3 [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:37.495898 15030 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:09:37.495687 15020 sys_catalog.cc:455] T 00000000000000000000000000000000 P e51ff2746bbc40feaf748b744bd397b3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e51ff2746bbc40feaf748b744bd397b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e51ff2746bbc40feaf748b744bd397b3" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 41083 } } }
I20260809 19:09:37.496080 15020 sys_catalog.cc:458] T 00000000000000000000000000000000 P e51ff2746bbc40feaf748b744bd397b3 [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:37.501497 15030 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:09:37.509995 15030 catalog_manager.cc:1347] Generated new cluster ID: 722b5bbd81e04a078bdeb72400a0c9ae
I20260809 19:09:37.510099 15030 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:09:37.524195 15030 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:09:37.524581 15030 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:09:37.532620 15030 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e51ff2746bbc40feaf748b744bd397b3: Generated new TSK 0
I20260809 19:09:37.533525 15030 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:09:37.540901 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.1:0
--local_ip_for_outbound_sockets=127.7.39.1
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:41083
--builtin_ntp_servers=127.7.39.20:38625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 19:09:37.857523 15046 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:37.857762 15046 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:37.857857 15046 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:37.864743 15046 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:37.864830 15046 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:37.864939 15046 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.1
I20260809 19:09:37.873664 15046 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:38625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:41083
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.1
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:37.874840 15046 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:37.876544 15046 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:37.888863 15057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:37.888882 15061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:37.888882 15056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:37.889864 15046 server_base.cc:1034] running on GCE node
I20260809 19:09:37.890468 15046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:37.891315 15046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:37.892511 15046 hybrid_clock.cc:648] HybridClock initialized: now 1786302577892464 us; error 39 us; skew 500 ppm
I20260809 19:09:37.892795 15046 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:09:37.894922 15046 webserver.cc:460] Webserver started at http://127.7.39.1:46627/ using document root <none> and password file <none>
I20260809 19:09:37.895552 15046 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:37.895644 15046 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:37.895937 15046 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:37.898802 15046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-0/data/instance:
uuid: "c738779827da4a8bbcd0b8c017e67dbc"
format_stamp: "Formatted at 2026-08-09 19:09:37 on dist-test-slave-4tdj"
server_key: "fb620e7563149bb2dba118c98a40d86a"
server_key_iv: "179ed9f7dd80b5a808e4d17e429b3044"
server_key_version: "encryptionkey@0"
I20260809 19:09:37.899557 15046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance:
uuid: "c738779827da4a8bbcd0b8c017e67dbc"
format_stamp: "Formatted at 2026-08-09 19:09:37 on dist-test-slave-4tdj"
server_key: "fb620e7563149bb2dba118c98a40d86a"
server_key_iv: "179ed9f7dd80b5a808e4d17e429b3044"
server_key_version: "encryptionkey@0"
I20260809 19:09:37.904313 15046 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260809 19:09:37.907552 15070 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:37.908751 15046 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:09:37.908911 15046 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-0/wal
uuid: "c738779827da4a8bbcd0b8c017e67dbc"
format_stamp: "Formatted at 2026-08-09 19:09:37 on dist-test-slave-4tdj"
server_key: "fb620e7563149bb2dba118c98a40d86a"
server_key_iv: "179ed9f7dd80b5a808e4d17e429b3044"
server_key_version: "encryptionkey@0"
I20260809 19:09:37.909134 15046 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:37.914381 15046 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:37.915097 15046 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:37.915337 15046 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:37.916164 15046 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:09:37.917431 15046 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:37.917527 15046 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:37.917634 15046 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:37.917706 15046 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:37.947046 15046 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.1:37861
I20260809 19:09:37.947093 15272 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.1:37861 every 8 connection(s)
I20260809 19:09:37.948274 15046 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
I20260809 19:09:37.949784 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 15046
I20260809 19:09:37.949926 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance
I20260809 19:09:37.950546 7324 external_mini_cluster.cc:1428] Setting key d148245f493eb198f18b32e3a06af240
I20260809 19:09:37.953545 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.2:0
--local_ip_for_outbound_sockets=127.7.39.2
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:41083
--builtin_ntp_servers=127.7.39.20:38625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260809 19:09:37.957048 15016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:37.951645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:57437 (local address 127.7.39.62:41083)
0809 19:09:37.951803 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:37.951808 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:37.953307 (+ 1499us) server_negotiation.cc:407] Connection header received
0809 19:09:37.954995 (+ 1688us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:37.955000 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:37.955062 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:37.955146 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:37.956363 (+ 1217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:37.956369 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:37.956374 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:09:37.956391 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:37.956421 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:09:37.956432 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:37.956537 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:37.956722 (+ 185us) server_negotiation.cc:299] Negotiation successful
0809 19:09:37.956788 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 19:09:37.957932 15277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:37.952275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:41083 (local address 127.7.39.1:57437)
0809 19:09:37.953157 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:37.953200 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:37.954738 (+ 1538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:37.955373 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:37.955381 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:37.955464 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:37.956075 (+ 611us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:09:37.956078 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:37.956114 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:09:37.956196 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:37.956515 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:37.956525 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:37.956532 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 19:09:37.956787 (+ 255us) client_negotiation.cc:240] Negotiation successful
0809 19:09:37.957042 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":279,"threads_started":1}
I20260809 19:09:37.959360 15275 heartbeater.cc:347] Connected to a master server at 127.7.39.62:41083
I20260809 19:09:37.959620 15275 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:37.960191 15275 heartbeater.cc:511] Master 127.7.39.62:41083 requested a full tablet report, sending...
I20260809 19:09:37.962061 14952 ts_manager.cc:194] Registered new tserver with Master: c738779827da4a8bbcd0b8c017e67dbc (127.7.39.1:37861)
W20260809 19:09:38.263103 15278 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:38.263350 15278 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:38.263463 15278 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:38.270265 15278 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:38.270381 15278 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:38.270529 15278 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.2
I20260809 19:09:38.279058 15278 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:38625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:41083
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.2
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:38.280197 15278 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:38.281826 15278 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:38.293944 15287 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:38.294013 15289 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:38.293979 15292 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:38.294643 15278 server_base.cc:1034] running on GCE node
I20260809 19:09:38.295177 15278 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:38.295977 15278 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:38.297166 15278 hybrid_clock.cc:648] HybridClock initialized: now 1786302578297122 us; error 40 us; skew 500 ppm
I20260809 19:09:38.297438 15278 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:09:38.299458 15278 webserver.cc:460] Webserver started at http://127.7.39.2:38295/ using document root <none> and password file <none>
I20260809 19:09:38.300058 15278 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:38.300149 15278 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:38.300429 15278 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:38.303087 15278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-1/data/instance:
uuid: "a418bfcb5fb04df4a2d7c2d0a13d0cf9"
format_stamp: "Formatted at 2026-08-09 19:09:38 on dist-test-slave-4tdj"
server_key: "74a52a0cdc1f1f2c53718646a0d6adf6"
server_key_iv: "2347f34e9957a3dd2c46b518ea0396af"
server_key_version: "encryptionkey@0"
I20260809 19:09:38.303805 15278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance:
uuid: "a418bfcb5fb04df4a2d7c2d0a13d0cf9"
format_stamp: "Formatted at 2026-08-09 19:09:38 on dist-test-slave-4tdj"
server_key: "74a52a0cdc1f1f2c53718646a0d6adf6"
server_key_iv: "2347f34e9957a3dd2c46b518ea0396af"
server_key_version: "encryptionkey@0"
I20260809 19:09:38.308442 15278 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 19:09:38.311573 15300 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:38.312794 15278 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:09:38.312934 15278 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-1/wal
uuid: "a418bfcb5fb04df4a2d7c2d0a13d0cf9"
format_stamp: "Formatted at 2026-08-09 19:09:38 on dist-test-slave-4tdj"
server_key: "74a52a0cdc1f1f2c53718646a0d6adf6"
server_key_iv: "2347f34e9957a3dd2c46b518ea0396af"
server_key_version: "encryptionkey@0"
I20260809 19:09:38.313133 15278 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:38.318204 15278 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:38.318919 15278 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:38.319155 15278 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:38.319980 15278 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:09:38.321259 15278 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:38.321343 15278 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:38.321442 15278 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:38.321509 15278 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:38.353318 15278 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.2:34303
I20260809 19:09:38.353353 15486 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.2:34303 every 8 connection(s)
I20260809 19:09:38.354693 15278 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
I20260809 19:09:38.361788 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 15278
I20260809 19:09:38.361943 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance
I20260809 19:09:38.362427 15016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:38.357128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:38009 (local address 127.7.39.62:41083)
0809 19:09:38.357322 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:38.357327 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:38.358770 (+ 1443us) server_negotiation.cc:407] Connection header received
0809 19:09:38.360314 (+ 1544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:38.360319 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:38.360377 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:38.360481 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:38.361675 (+ 1194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:38.361682 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:38.361685 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:09:38.361701 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:38.361733 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:09:38.361744 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:38.361844 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:38.362039 (+ 195us) server_negotiation.cc:299] Negotiation successful
0809 19:09:38.362110 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 19:09:38.362442 7324 external_mini_cluster.cc:1428] Setting key 5e8f0026f6353506795bac6c8afc87dc
I20260809 19:09:38.363374 15491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:38.357657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:41083 (local address 127.7.39.2:38009)
0809 19:09:38.358612 (+ 955us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:38.358648 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:38.360071 (+ 1423us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:38.360666 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:38.360673 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:38.360755 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:38.361356 (+ 601us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:09:38.361359 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:38.361394 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:09:38.361495 (+ 101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:38.361828 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:38.361838 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:38.361846 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 19:09:38.362110 (+ 264us) client_negotiation.cc:240] Negotiation successful
0809 19:09:38.362372 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":278,"threads_started":1}
I20260809 19:09:38.364754 15489 heartbeater.cc:347] Connected to a master server at 127.7.39.62:41083
I20260809 19:09:38.365011 15489 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:38.365401 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.3:0
--local_ip_for_outbound_sockets=127.7.39.3
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:41083
--builtin_ntp_servers=127.7.39.20:38625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260809 19:09:38.365567 15489 heartbeater.cc:511] Master 127.7.39.62:41083 requested a full tablet report, sending...
I20260809 19:09:38.366912 14950 ts_manager.cc:194] Registered new tserver with Master: a418bfcb5fb04df4a2d7c2d0a13d0cf9 (127.7.39.2:34303)
W20260809 19:09:38.692140 15492 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:38.692409 15492 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:38.692556 15492 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:38.699632 15492 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:38.699724 15492 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:38.699842 15492 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.3
I20260809 19:09:38.708601 15492 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:38625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:41083
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.3
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:38.709777 15492 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:38.711608 15492 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:38.724242 15501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:38.724282 15500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:38.724210 15505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:38.725152 15492 server_base.cc:1034] running on GCE node
I20260809 19:09:38.725670 15492 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:38.726549 15492 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:38.727738 15492 hybrid_clock.cc:648] HybridClock initialized: now 1786302578727699 us; error 33 us; skew 500 ppm
I20260809 19:09:38.728024 15492 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:09:38.730046 15492 webserver.cc:460] Webserver started at http://127.7.39.3:41131/ using document root <none> and password file <none>
I20260809 19:09:38.730724 15492 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:38.730815 15492 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:38.731127 15492 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:38.733824 15492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-2/data/instance:
uuid: "9ea8007316dd4a4fa71e405ee4ff738e"
format_stamp: "Formatted at 2026-08-09 19:09:38 on dist-test-slave-4tdj"
server_key: "71b5afbbc45b041ebeb278734f01dfd1"
server_key_iv: "783b33fd00cc682bb2661fe50d9875ba"
server_key_version: "encryptionkey@0"
I20260809 19:09:38.734608 15492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance:
uuid: "9ea8007316dd4a4fa71e405ee4ff738e"
format_stamp: "Formatted at 2026-08-09 19:09:38 on dist-test-slave-4tdj"
server_key: "71b5afbbc45b041ebeb278734f01dfd1"
server_key_iv: "783b33fd00cc682bb2661fe50d9875ba"
server_key_version: "encryptionkey@0"
I20260809 19:09:38.740338 15492 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 19:09:38.743623 15520 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:38.744856 15492 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 19:09:38.744979 15492 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-2/wal
uuid: "9ea8007316dd4a4fa71e405ee4ff738e"
format_stamp: "Formatted at 2026-08-09 19:09:38 on dist-test-slave-4tdj"
server_key: "71b5afbbc45b041ebeb278734f01dfd1"
server_key_iv: "783b33fd00cc682bb2661fe50d9875ba"
server_key_version: "encryptionkey@0"
I20260809 19:09:38.745167 15492 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:38.750525 15492 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:38.751230 15492 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:38.751451 15492 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:38.752269 15492 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:09:38.753538 15492 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:38.753624 15492 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:38.753701 15492 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:38.753753 15492 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:38.783267 15492 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.3:44771
I20260809 19:09:38.783318 15697 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.3:44771 every 8 connection(s)
I20260809 19:09:38.784507 15492 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
I20260809 19:09:38.791853 15016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:38.786990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:59425 (local address 127.7.39.62:41083)
0809 19:09:38.787177 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:38.787182 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:38.788481 (+ 1299us) server_negotiation.cc:407] Connection header received
0809 19:09:38.790054 (+ 1573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:38.790058 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:38.790110 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:38.790192 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:38.791316 (+ 1124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:38.791321 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:38.791324 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:09:38.791339 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:38.791369 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:09:38.791380 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:38.791469 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:38.791591 (+ 122us) server_negotiation.cc:299] Negotiation successful
0809 19:09:38.791639 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 19:09:38.792726 15705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:38.787489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:41083 (local address 127.7.39.3:59425)
0809 19:09:38.788359 (+ 870us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:38.788394 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:38.789827 (+ 1433us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:38.790394 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:38.790402 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:38.790486 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:38.791041 (+ 555us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:09:38.791044 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:38.791081 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:09:38.791161 (+ 80us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:38.791445 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:38.791450 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:38.791455 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 19:09:38.791643 (+ 188us) client_negotiation.cc:240] Negotiation successful
0809 19:09:38.791819 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":249,"threads_started":1}
I20260809 19:09:38.794010 15703 heartbeater.cc:347] Connected to a master server at 127.7.39.62:41083
I20260809 19:09:38.794178 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 15492
I20260809 19:09:38.794335 15703 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:38.794364 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance
I20260809 19:09:38.794909 7324 external_mini_cluster.cc:1428] Setting key 5b9f8591ee712e3494985259652bf5fb
I20260809 19:09:38.795025 15703 heartbeater.cc:511] Master 127.7.39.62:41083 requested a full tablet report, sending...
I20260809 19:09:38.796465 14950 ts_manager.cc:194] Registered new tserver with Master: 9ea8007316dd4a4fa71e405ee4ff738e (127.7.39.3:44771)
I20260809 19:09:38.797955 7324 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 19:09:38.804136 15016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:38.802015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53730 (local address 127.7.39.62:41083)
0809 19:09:38.802170 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:38.802174 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:38.802708 (+ 534us) server_negotiation.cc:407] Connection header received
0809 19:09:38.802818 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:38.802821 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:38.802867 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:38.802936 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:38.803657 (+ 721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:38.803661 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:38.803664 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:09:38.803677 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:38.803704 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:09:38.803714 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:38.803798 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:38.803844 (+ 46us) server_negotiation.cc:299] Negotiation successful
0809 19:09:38.803883 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 19:09:38.807452 14952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53730:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:09:38.814021 14952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:09:38.834717 15720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:38.824835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:37861 (local address 127.0.0.1:48948)
0809 19:09:38.826079 (+ 1244us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:38.826116 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:38.826233 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:38.832778 (+ 6545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:38.832783 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:38.832805 (+ 22us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:38.833448 (+ 643us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:09:38.833452 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:38.833481 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:09:38.833558 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:38.833967 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:38.833978 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:38.833988 (+ 10us) client_negotiation.cc:769] Sending connection context
0809 19:09:38.834149 (+ 161us) client_negotiation.cc:240] Negotiation successful
0809 19:09:38.834231 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":998,"thread_start_us":1120,"threads_started":1}
I20260809 19:09:38.835469 15721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:38.825007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48948 (local address 127.7.39.1:37861)
0809 19:09:38.832345 (+ 7338us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:38.832353 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:38.832383 (+ 30us) server_negotiation.cc:407] Connection header received
0809 19:09:38.832450 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:38.832457 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:38.832625 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:38.832761 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:38.833719 (+ 958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:38.833728 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:38.833743 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:09:38.833761 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:38.833822 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:09:38.833842 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:38.834992 (+ 1150us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:38.835072 (+ 80us) server_negotiation.cc:299] Negotiation successful
0809 19:09:38.835180 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7184,"thread_start_us":7054,"threads_started":1}
I20260809 19:09:38.835644 15725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:38.825091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:44771 (local address 127.0.0.1:57188)
0809 19:09:38.827174 (+ 2083us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:38.827192 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:38.828347 (+ 1155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:38.832332 (+ 3985us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:38.832340 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:38.832430 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:38.833602 (+ 1172us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:09:38.833606 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:38.833624 (+ 18us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:09:38.833669 (+ 45us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:38.834992 (+ 1323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:38.834998 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:38.835003 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 19:09:38.835128 (+ 125us) client_negotiation.cc:240] Negotiation successful
0809 19:09:38.835193 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1944,"thread_start_us":6706,"threads_started":1}
I20260809 19:09:38.835815 15722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:38.826664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:34303 (local address 127.0.0.1:44406)
0809 19:09:38.832017 (+ 5353us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:38.832033 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:38.832116 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:38.833080 (+ 964us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:38.833085 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:38.833108 (+ 23us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:38.833642 (+ 534us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:09:38.833645 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:38.833656 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:09:38.833684 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:38.835213 (+ 1529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:38.835218 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:38.835227 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 19:09:38.835352 (+ 125us) client_negotiation.cc:240] Negotiation successful
0809 19:09:38.835392 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5250,"thread_start_us":222,"threads_started":1}
I20260809 19:09:38.836143 15726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:38.827002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44406 (local address 127.7.39.2:34303)
0809 19:09:38.832584 (+ 5582us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:38.832592 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:38.832621 (+ 29us) server_negotiation.cc:407] Connection header received
0809 19:09:38.832694 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:38.832701 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:38.832891 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:38.833470 (+ 579us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:38.834739 (+ 1269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:38.834747 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:38.834759 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:09:38.835018 (+ 259us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:38.835083 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:09:38.835106 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:38.835270 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:38.835336 (+ 66us) server_negotiation.cc:299] Negotiation successful
0809 19:09:38.835417 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5411,"thread_start_us":5266,"threads_started":1}
I20260809 19:09:38.836587 15724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:38.825695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57188 (local address 127.7.39.3:44771)
0809 19:09:38.831772 (+ 6077us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:38.831780 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:38.831815 (+ 35us) server_negotiation.cc:407] Connection header received
0809 19:09:38.831884 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:38.831892 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:38.832135 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:38.833230 (+ 1095us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:38.834723 (+ 1493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:38.834731 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:38.834742 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:09:38.834758 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:38.834809 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:09:38.834831 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:38.836101 (+ 1270us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:38.836155 (+ 54us) server_negotiation.cc:299] Negotiation successful
0809 19:09:38.836229 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5924,"thread_start_us":5765,"threads_started":1}
I20260809 19:09:38.839536 15376 tablet_service.cc:1467] Processing CreateTablet for tablet 6d139c4b90c44ff89e9b288c242156d0 (DEFAULT_TABLE table=test-table [id=3b10918cacca4034b7dbb1bf92d80664]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:09:38.839548 15157 tablet_service.cc:1467] Processing CreateTablet for tablet 6d139c4b90c44ff89e9b288c242156d0 (DEFAULT_TABLE table=test-table [id=3b10918cacca4034b7dbb1bf92d80664]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:09:38.839707 15599 tablet_service.cc:1467] Processing CreateTablet for tablet 6d139c4b90c44ff89e9b288c242156d0 (DEFAULT_TABLE table=test-table [id=3b10918cacca4034b7dbb1bf92d80664]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:09:38.840894 15599 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d139c4b90c44ff89e9b288c242156d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:38.840941 15376 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d139c4b90c44ff89e9b288c242156d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:38.840937 15157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d139c4b90c44ff89e9b288c242156d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:38.851925 15727 tablet_bootstrap.cc:492] T 6d139c4b90c44ff89e9b288c242156d0 P 9ea8007316dd4a4fa71e405ee4ff738e: Bootstrap starting.
I20260809 19:09:38.854712 15729 tablet_bootstrap.cc:492] T 6d139c4b90c44ff89e9b288c242156d0 P c738779827da4a8bbcd0b8c017e67dbc: Bootstrap starting.
I20260809 19:09:38.855296 15727 tablet_bootstrap.cc:654] T 6d139c4b90c44ff89e9b288c242156d0 P 9ea8007316dd4a4fa71e405ee4ff738e: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:38.856191 15728 tablet_bootstrap.cc:492] T 6d139c4b90c44ff89e9b288c242156d0 P a418bfcb5fb04df4a2d7c2d0a13d0cf9: Bootstrap starting.
I20260809 19:09:38.857429 15727 log.cc:824] T 6d139c4b90c44ff89e9b288c242156d0 P 9ea8007316dd4a4fa71e405ee4ff738e: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:38.858459 15729 tablet_bootstrap.cc:654] T 6d139c4b90c44ff89e9b288c242156d0 P c738779827da4a8bbcd0b8c017e67dbc: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:38.859408 15728 tablet_bootstrap.cc:654] T 6d139c4b90c44ff89e9b288c242156d0 P a418bfcb5fb04df4a2d7c2d0a13d0cf9: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:38.859448 15729 log.cc:824] T 6d139c4b90c44ff89e9b288c242156d0 P c738779827da4a8bbcd0b8c017e67dbc: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:38.860556 15728 log.cc:824] T 6d139c4b90c44ff89e9b288c242156d0 P a418bfcb5fb04df4a2d7c2d0a13d0cf9: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:38.860618 15727 tablet_bootstrap.cc:492] T 6d139c4b90c44ff89e9b288c242156d0 P 9ea8007316dd4a4fa71e405ee4ff738e: No bootstrap required, opened a new log
I20260809 19:09:38.860869 15727 ts_tablet_manager.cc:1397] T 6d139c4b90c44ff89e9b288c242156d0 P 9ea8007316dd4a4fa71e405ee4ff738e: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260809 19:09:38.861981 15729 tablet_bootstrap.cc:492] T 6d139c4b90c44ff89e9b288c242156d0 P c738779827da4a8bbcd0b8c017e67dbc: No bootstrap required, opened a new log
I20260809 19:09:38.862205 15729 ts_tablet_manager.cc:1397] T 6d139c4b90c44ff89e9b288c242156d0 P c738779827da4a8bbcd0b8c017e67dbc: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.005s
I20260809 19:09:38.863355 15728 tablet_bootstrap.cc:492] T 6d139c4b90c44ff89e9b288c242156d0 P a418bfcb5fb04df4a2d7c2d0a13d0cf9: No bootstrap required, opened a new log
I20260809 19:09:38.863608 15728 ts_tablet_manager.cc:1397] T 6d139c4b90c44ff89e9b288c242156d0 P a418bfcb5fb04df4a2d7c2d0a13d0cf9: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260809 19:09:38.869134 15729 raft_consensus.cc:348] T 6d139c4b90c44ff89e9b288c242156d0 P c738779827da4a8bbcd0b8c017e67dbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c738779827da4a8bbcd0b8c017e67dbc" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 37861 } } peers { permanent_uuid: "9ea8007316dd4a4fa71e405ee4ff738e" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 44771 } } peers { permanent_uuid: "a418bfcb5fb04df4a2d7c2d0a13d0cf9" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 34303 } }
I20260809 19:09:38.869457 15729 raft_consensus.cc:374] T 6d139c4b90c44ff89e9b288c242156d0 P c738779827da4a8bbcd0b8c017e67dbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:38.869557 15729 raft_consensus.cc:729] T 6d139c4b90c44ff89e9b288c242156d0 P c738779827da4a8bbcd0b8c017e67dbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c738779827da4a8bbcd0b8c017e67dbc, State: Initialized, Role: FOLLOWER
I20260809 19:09:38.870085 15729 consensus_queue.cc:260] T 6d139c4b90c44ff89e9b288c242156d0 P c738779827da4a8bbcd0b8c017e67dbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c738779827da4a8bbcd0b8c017e67dbc" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 37861 } } peers { permanent_uuid: "9ea8007316dd4a4fa71e405ee4ff738e" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 44771 } } peers { permanent_uuid: "a418bfcb5fb04df4a2d7c2d0a13d0cf9" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 34303 } }
I20260809 19:09:38.870638 15727 raft_consensus.cc:348] T 6d139c4b90c44ff89e9b288c242156d0 P 9ea8007316dd4a4fa71e405ee4ff738e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c738779827da4a8bbcd0b8c017e67dbc" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 37861 } } peers { permanent_uuid: "9ea8007316dd4a4fa71e405ee4ff738e" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 44771 } } peers { permanent_uuid: "a418bfcb5fb04df4a2d7c2d0a13d0cf9" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 34303 } }
I20260809 19:09:38.871037 15727 raft_consensus.cc:374] T 6d139c4b90c44ff89e9b288c242156d0 P 9ea8007316dd4a4fa71e405ee4ff738e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:38.871111 15275 heartbeater.cc:503] Master 127.7.39.62:41083 was elected leader, sending a full tablet report...
I20260809 19:09:38.871125 15727 raft_consensus.cc:729] T 6d139c4b90c44ff89e9b288c242156d0 P 9ea8007316dd4a4fa71e405ee4ff738e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ea8007316dd4a4fa71e405ee4ff738e, State: Initialized, Role: FOLLOWER
I20260809 19:09:38.871731 15729 ts_tablet_manager.cc:1428] T 6d139c4b90c44ff89e9b288c242156d0 P c738779827da4a8bbcd0b8c017e67dbc: Time spent starting tablet: real 0.009s user 0.009s sys 0.001s
I20260809 19:09:38.871763 15727 consensus_queue.cc:260] T 6d139c4b90c44ff89e9b288c242156d0 P 9ea8007316dd4a4fa71e405ee4ff738e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c738779827da4a8bbcd0b8c017e67dbc" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 37861 } } peers { permanent_uuid: "9ea8007316dd4a4fa71e405ee4ff738e" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 44771 } } peers { permanent_uuid: "a418bfcb5fb04df4a2d7c2d0a13d0cf9" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 34303 } }
I20260809 19:09:38.872793 15703 heartbeater.cc:503] Master 127.7.39.62:41083 was elected leader, sending a full tablet report...
I20260809 19:09:38.873375 15727 ts_tablet_manager.cc:1428] T 6d139c4b90c44ff89e9b288c242156d0 P 9ea8007316dd4a4fa71e405ee4ff738e: Time spent starting tablet: real 0.012s user 0.009s sys 0.005s
I20260809 19:09:38.873543 15728 raft_consensus.cc:348] T 6d139c4b90c44ff89e9b288c242156d0 P a418bfcb5fb04df4a2d7c2d0a13d0cf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c738779827da4a8bbcd0b8c017e67dbc" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 37861 } } peers { permanent_uuid: "9ea8007316dd4a4fa71e405ee4ff738e" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 44771 } } peers { permanent_uuid: "a418bfcb5fb04df4a2d7c2d0a13d0cf9" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 34303 } }
I20260809 19:09:38.873874 15728 raft_consensus.cc:374] T 6d139c4b90c44ff89e9b288c242156d0 P a418bfcb5fb04df4a2d7c2d0a13d0cf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:38.873977 15728 raft_consensus.cc:729] T 6d139c4b90c44ff89e9b288c242156d0 P a418bfcb5fb04df4a2d7c2d0a13d0cf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a418bfcb5fb04df4a2d7c2d0a13d0cf9, State: Initialized, Role: FOLLOWER
I20260809 19:09:38.874616 15728 consensus_queue.cc:260] T 6d139c4b90c44ff89e9b288c242156d0 P a418bfcb5fb04df4a2d7c2d0a13d0cf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c738779827da4a8bbcd0b8c017e67dbc" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 37861 } } peers { permanent_uuid: "9ea8007316dd4a4fa71e405ee4ff738e" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 44771 } } peers { permanent_uuid: "a418bfcb5fb04df4a2d7c2d0a13d0cf9" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 34303 } }
I20260809 19:09:38.876235 15489 heartbeater.cc:503] Master 127.7.39.62:41083 was elected leader, sending a full tablet report...
I20260809 19:09:38.876390 15728 ts_tablet_manager.cc:1428] T 6d139c4b90c44ff89e9b288c242156d0 P a418bfcb5fb04df4a2d7c2d0a13d0cf9: Time spent starting tablet: real 0.013s user 0.005s sys 0.008s
I20260809 19:09:38.929956 15742 raft_consensus.cc:482] T 6d139c4b90c44ff89e9b288c242156d0 P a418bfcb5fb04df4a2d7c2d0a13d0cf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:09:38.930233 15742 raft_consensus.cc:504] T 6d139c4b90c44ff89e9b288c242156d0 P a418bfcb5fb04df4a2d7c2d0a13d0cf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c738779827da4a8bbcd0b8c017e67dbc" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 37861 } } peers { permanent_uuid: "9ea8007316dd4a4fa71e405ee4ff738e" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 44771 } } peers { permanent_uuid: "a418bfcb5fb04df4a2d7c2d0a13d0cf9" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 34303 } }
I20260809 19:09:38.931802 15742 leader_election.cc:288] T 6d139c4b90c44ff89e9b288c242156d0 P a418bfcb5fb04df4a2d7c2d0a13d0cf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c738779827da4a8bbcd0b8c017e67dbc (127.7.39.1:37861), 9ea8007316dd4a4fa71e405ee4ff738e (127.7.39.3:44771)
I20260809 19:09:38.935006 15724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:38.932278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:58207 (local address 127.7.39.3:44771)
0809 19:09:38.932629 (+ 351us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:38.932637 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:38.933007 (+ 370us) server_negotiation.cc:407] Connection header received
0809 19:09:38.933179 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:38.933183 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:38.933247 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:38.933358 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:38.934341 (+ 983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:38.934347 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:38.934352 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:09:38.934374 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:38.934415 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:09:38.934432 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:38.934567 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:38.934663 (+ 96us) server_negotiation.cc:299] Negotiation successful
0809 19:09:38.934720 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185}
I20260809 19:09:38.935006 15721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:38.932369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:52165 (local address 127.7.39.1:37861)
0809 19:09:38.932787 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:38.932794 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:38.933238 (+ 444us) server_negotiation.cc:407] Connection header received
0809 19:09:38.933312 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:38.933318 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:38.933378 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:38.933495 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:38.934371 (+ 876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:38.934377 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:38.934381 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:09:38.934399 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:38.934434 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:09:38.934449 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:38.934587 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:38.934647 (+ 60us) server_negotiation.cc:299] Negotiation successful
0809 19:09:38.934709 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292}
I20260809 19:09:38.935199 15745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:38.932037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:44771 (local address 127.7.39.2:58207)
0809 19:09:38.932881 (+ 844us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:38.932901 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:38.933040 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:38.933376 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:38.933379 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:38.933399 (+ 20us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:38.934082 (+ 683us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:09:38.934086 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:38.934105 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:09:38.934160 (+ 55us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:38.934536 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:38.934541 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:38.934546 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 19:09:38.934680 (+ 134us) client_negotiation.cc:240] Negotiation successful
0809 19:09:38.934715 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":684,"thread_start_us":472,"threads_started":1}
I20260809 19:09:38.935214 15746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:38.932068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:37861 (local address 127.7.39.2:52165)
0809 19:09:38.933140 (+ 1072us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:38.933155 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:38.933234 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:38.933521 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:38.933525 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:38.933542 (+ 17us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:38.934189 (+ 647us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:09:38.934191 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:38.934204 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:09:38.934236 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:38.934553 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:38.934557 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:38.934561 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 19:09:38.934647 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 19:09:38.934706 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":953,"thread_start_us":754,"threads_started":1}
I20260809 19:09:38.936326 15195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d139c4b90c44ff89e9b288c242156d0" candidate_uuid: "a418bfcb5fb04df4a2d7c2d0a13d0cf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c738779827da4a8bbcd0b8c017e67dbc" is_pre_election: true
I20260809 19:09:38.936326 15629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d139c4b90c44ff89e9b288c242156d0" candidate_uuid: "a418bfcb5fb04df4a2d7c2d0a13d0cf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ea8007316dd4a4fa71e405ee4ff738e" is_pre_election: true
I20260809 19:09:38.936889 15629 raft_consensus.cc:2454] T 6d139c4b90c44ff89e9b288c242156d0 P 9ea8007316dd4a4fa71e405ee4ff738e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a418bfcb5fb04df4a2d7c2d0a13d0cf9 in term 0.
I20260809 19:09:38.936897 15195 raft_consensus.cc:2454] T 6d139c4b90c44ff89e9b288c242156d0 P c738779827da4a8bbcd0b8c017e67dbc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a418bfcb5fb04df4a2d7c2d0a13d0cf9 in term 0.
I20260809 19:09:38.937590 15301 leader_election.cc:302] T 6d139c4b90c44ff89e9b288c242156d0 P a418bfcb5fb04df4a2d7c2d0a13d0cf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ea8007316dd4a4fa71e405ee4ff738e, a418bfcb5fb04df4a2d7c2d0a13d0cf9; no voters:
I20260809 19:09:38.937956 15742 raft_consensus.cc:2781] T 6d139c4b90c44ff89e9b288c242156d0 P a418bfcb5fb04df4a2d7c2d0a13d0cf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:09:38.938098 15742 raft_consensus.cc:482] T 6d139c4b90c44ff89e9b288c242156d0 P a418bfcb5fb04df4a2d7c2d0a13d0cf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:09:38.938201 15742 raft_consensus.cc:3037] T 6d139c4b90c44ff89e9b288c242156d0 P a418bfcb5fb04df4a2d7c2d0a13d0cf9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:38.940375 15742 raft_consensus.cc:504] T 6d139c4b90c44ff89e9b288c242156d0 P a418bfcb5fb04df4a2d7c2d0a13d0cf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c738779827da4a8bbcd0b8c017e67dbc" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 37861 } } peers { permanent_uuid: "9ea8007316dd4a4fa71e405ee4ff738e" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 44771 } } peers { permanent_uuid: "a418bfcb5fb04df4a2d7c2d0a13d0cf9" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 34303 } }
I20260809 19:09:38.940868 15742 leader_election.cc:288] T 6d139c4b90c44ff89e9b288c242156d0 P a418bfcb5fb04df4a2d7c2d0a13d0cf9 [CANDIDATE]: Term 1 election: Requested vote from peers c738779827da4a8bbcd0b8c017e67dbc (127.7.39.1:37861), 9ea8007316dd4a4fa71e405ee4ff738e (127.7.39.3:44771)
I20260809 19:09:38.941270 15195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d139c4b90c44ff89e9b288c242156d0" candidate_uuid: "a418bfcb5fb04df4a2d7c2d0a13d0cf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c738779827da4a8bbcd0b8c017e67dbc"
I20260809 19:09:38.941315 15629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d139c4b90c44ff89e9b288c242156d0" candidate_uuid: "a418bfcb5fb04df4a2d7c2d0a13d0cf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ea8007316dd4a4fa71e405ee4ff738e"
I20260809 19:09:38.941480 15629 raft_consensus.cc:3037] T 6d139c4b90c44ff89e9b288c242156d0 P 9ea8007316dd4a4fa71e405ee4ff738e [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:38.941476 15195 raft_consensus.cc:3037] T 6d139c4b90c44ff89e9b288c242156d0 P c738779827da4a8bbcd0b8c017e67dbc [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:38.944595 15195 raft_consensus.cc:2454] T 6d139c4b90c44ff89e9b288c242156d0 P c738779827da4a8bbcd0b8c017e67dbc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a418bfcb5fb04df4a2d7c2d0a13d0cf9 in term 1.
I20260809 19:09:38.944587 15629 raft_consensus.cc:2454] T 6d139c4b90c44ff89e9b288c242156d0 P 9ea8007316dd4a4fa71e405ee4ff738e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a418bfcb5fb04df4a2d7c2d0a13d0cf9 in term 1.
I20260809 19:09:38.944970 15301 leader_election.cc:302] T 6d139c4b90c44ff89e9b288c242156d0 P a418bfcb5fb04df4a2d7c2d0a13d0cf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ea8007316dd4a4fa71e405ee4ff738e, a418bfcb5fb04df4a2d7c2d0a13d0cf9; no voters:
I20260809 19:09:38.945241 15742 raft_consensus.cc:2781] T 6d139c4b90c44ff89e9b288c242156d0 P a418bfcb5fb04df4a2d7c2d0a13d0cf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:09:38.945637 15742 raft_consensus.cc:686] T 6d139c4b90c44ff89e9b288c242156d0 P a418bfcb5fb04df4a2d7c2d0a13d0cf9 [term 1 LEADER]: Becoming Leader. State: Replica: a418bfcb5fb04df4a2d7c2d0a13d0cf9, State: Running, Role: LEADER
I20260809 19:09:38.946062 15742 consensus_queue.cc:237] T 6d139c4b90c44ff89e9b288c242156d0 P a418bfcb5fb04df4a2d7c2d0a13d0cf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c738779827da4a8bbcd0b8c017e67dbc" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 37861 } } peers { permanent_uuid: "9ea8007316dd4a4fa71e405ee4ff738e" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 44771 } } peers { permanent_uuid: "a418bfcb5fb04df4a2d7c2d0a13d0cf9" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 34303 } }
W20260809 19:09:38.950212 15276 tablet.cc:2369] T 6d139c4b90c44ff89e9b288c242156d0 P c738779827da4a8bbcd0b8c017e67dbc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:09:38.950920 14950 catalog_manager.cc:5495] T 6d139c4b90c44ff89e9b288c242156d0 P a418bfcb5fb04df4a2d7c2d0a13d0cf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to a418bfcb5fb04df4a2d7c2d0a13d0cf9 (127.7.39.2). New cstate: current_term: 1 leader_uuid: "a418bfcb5fb04df4a2d7c2d0a13d0cf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c738779827da4a8bbcd0b8c017e67dbc" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 37861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ea8007316dd4a4fa71e405ee4ff738e" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 44771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a418bfcb5fb04df4a2d7c2d0a13d0cf9" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 34303 } health_report { overall_health: HEALTHY } } }
I20260809 19:09:38.986018 15726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:38.984142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44408 (local address 127.7.39.2:34303)
0809 19:09:38.984330 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:38.984335 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:38.984355 (+ 20us) server_negotiation.cc:407] Connection header received
0809 19:09:38.984530 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:38.984534 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:38.984615 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:38.984705 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:38.985446 (+ 741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:38.985450 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:38.985453 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:09:38.985487 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:38.985518 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:09:38.985531 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:38.985633 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:38.985702 (+ 69us) server_negotiation.cc:299] Negotiation successful
0809 19:09:38.985749 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 19:09:38.993714 15195 raft_consensus.cc:1261] T 6d139c4b90c44ff89e9b288c242156d0 P c738779827da4a8bbcd0b8c017e67dbc [term 1 FOLLOWER]: Refusing update from remote peer a418bfcb5fb04df4a2d7c2d0a13d0cf9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:09:38.993713 15629 raft_consensus.cc:1261] T 6d139c4b90c44ff89e9b288c242156d0 P 9ea8007316dd4a4fa71e405ee4ff738e [term 1 FOLLOWER]: Refusing update from remote peer a418bfcb5fb04df4a2d7c2d0a13d0cf9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:09:38.994613 15748 consensus_queue.cc:1035] T 6d139c4b90c44ff89e9b288c242156d0 P a418bfcb5fb04df4a2d7c2d0a13d0cf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ea8007316dd4a4fa71e405ee4ff738e" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 44771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:09:38.994936 15742 consensus_queue.cc:1035] T 6d139c4b90c44ff89e9b288c242156d0 P a418bfcb5fb04df4a2d7c2d0a13d0cf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c738779827da4a8bbcd0b8c017e67dbc" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 37861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:09:39.005921 15754 mvcc.cc:205] Tried to move back new op lower bound from 7316695363549650944 to 7316695363367477248. Current Snapshot: MvccSnapshot[applied={T|T < 7316695363549650944}]
I20260809 19:09:39.006404 15757 mvcc.cc:205] Tried to move back new op lower bound from 7316695363549650944 to 7316695363367477248. Current Snapshot: MvccSnapshot[applied={T|T < 7316695363549650944}]
I20260809 19:09:39.021513 14952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53730:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:09:39.021896 14952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53730:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:09:39.026365 14952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e51ff2746bbc40feaf748b744bd397b3: Sending DeleteTablet for 3 replicas of tablet 6d139c4b90c44ff89e9b288c242156d0
I20260809 19:09:39.030208 15599 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d139c4b90c44ff89e9b288c242156d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:09:39 UTC) from {username='slave'} at 127.0.0.1:57188
I20260809 19:09:39.031054 15157 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d139c4b90c44ff89e9b288c242156d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:09:39 UTC) from {username='slave'} at 127.0.0.1:48948
I20260809 19:09:39.031097 15376 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d139c4b90c44ff89e9b288c242156d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:09:39 UTC) from {username='slave'} at 127.0.0.1:44406
I20260809 19:09:39.034442 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 15046
I20260809 19:09:39.045776 15770 tablet_replica.cc:330] T 6d139c4b90c44ff89e9b288c242156d0 P c738779827da4a8bbcd0b8c017e67dbc: stopping tablet replica
I20260809 19:09:39.046051 15769 tablet_replica.cc:330] T 6d139c4b90c44ff89e9b288c242156d0 P 9ea8007316dd4a4fa71e405ee4ff738e: stopping tablet replica
I20260809 19:09:39.046228 15770 raft_consensus.cc:2229] T 6d139c4b90c44ff89e9b288c242156d0 P c738779827da4a8bbcd0b8c017e67dbc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:09:39.046732 15769 raft_consensus.cc:2229] T 6d139c4b90c44ff89e9b288c242156d0 P 9ea8007316dd4a4fa71e405ee4ff738e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:09:39.046845 15772 tablet_replica.cc:330] T 6d139c4b90c44ff89e9b288c242156d0 P a418bfcb5fb04df4a2d7c2d0a13d0cf9: stopping tablet replica
I20260809 19:09:39.047170 15770 raft_consensus.cc:2258] T 6d139c4b90c44ff89e9b288c242156d0 P c738779827da4a8bbcd0b8c017e67dbc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:09:39.047237 15772 raft_consensus.cc:2229] T 6d139c4b90c44ff89e9b288c242156d0 P a418bfcb5fb04df4a2d7c2d0a13d0cf9 [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:09:39.047312 15769 raft_consensus.cc:2258] T 6d139c4b90c44ff89e9b288c242156d0 P 9ea8007316dd4a4fa71e405ee4ff738e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:09:39.048190 15772 raft_consensus.cc:2258] T 6d139c4b90c44ff89e9b288c242156d0 P a418bfcb5fb04df4a2d7c2d0a13d0cf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:09:39.049703 15721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:39.035506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48958 (local address 127.7.39.1:37861)
0809 19:09:39.035669 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:39.035674 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:39.045326 (+ 9652us) server_negotiation.cc:407] Connection header received
0809 19:09:39.045631 (+ 305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:39.045638 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:39.045753 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:39.045835 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:39.048911 (+ 3076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:39.048916 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:39.048921 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:09:39.048942 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:39.048979 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:09:39.048995 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:39.049096 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:39.049354 (+ 258us) server_negotiation.cc:299] Negotiation successful
0809 19:09:39.049418 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 19:09:39.050117 15769 ts_tablet_manager.cc:1905] T 6d139c4b90c44ff89e9b288c242156d0 P 9ea8007316dd4a4fa71e405ee4ff738e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:09:39.050210 15772 ts_tablet_manager.cc:1905] T 6d139c4b90c44ff89e9b288c242156d0 P a418bfcb5fb04df4a2d7c2d0a13d0cf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:09:39.050652 15267 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:39.057339 15769 ts_tablet_manager.cc:1918] T 6d139c4b90c44ff89e9b288c242156d0 P 9ea8007316dd4a4fa71e405ee4ff738e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:09:39.057335 15772 ts_tablet_manager.cc:1918] T 6d139c4b90c44ff89e9b288c242156d0 P a418bfcb5fb04df4a2d7c2d0a13d0cf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:09:39.057493 15772 log.cc:1196] T 6d139c4b90c44ff89e9b288c242156d0 P a418bfcb5fb04df4a2d7c2d0a13d0cf9: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-1/wal/wals/6d139c4b90c44ff89e9b288c242156d0
I20260809 19:09:39.057624 15769 log.cc:1196] T 6d139c4b90c44ff89e9b288c242156d0 P 9ea8007316dd4a4fa71e405ee4ff738e: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786302538618573-7324-0/minicluster-data/ts-2/wal/wals/6d139c4b90c44ff89e9b288c242156d0
I20260809 19:09:39.058084 15772 ts_tablet_manager.cc:1939] T 6d139c4b90c44ff89e9b288c242156d0 P a418bfcb5fb04df4a2d7c2d0a13d0cf9: Deleting consensus metadata
I20260809 19:09:39.058344 15769 ts_tablet_manager.cc:1939] T 6d139c4b90c44ff89e9b288c242156d0 P 9ea8007316dd4a4fa71e405ee4ff738e: Deleting consensus metadata
I20260809 19:09:39.059859 14930 catalog_manager.cc:4841] TS a418bfcb5fb04df4a2d7c2d0a13d0cf9 (127.7.39.2:34303): tablet 6d139c4b90c44ff89e9b288c242156d0 (table test-table [id=3b10918cacca4034b7dbb1bf92d80664]) successfully deleted
I20260809 19:09:39.060102 14921 catalog_manager.cc:4841] TS 9ea8007316dd4a4fa71e405ee4ff738e (127.7.39.3:44771): tablet 6d139c4b90c44ff89e9b288c242156d0 (table test-table [id=3b10918cacca4034b7dbb1bf92d80664]) successfully deleted
I20260809 19:09:39.057533 15770 ts_tablet_manager.cc:1905] T 6d139c4b90c44ff89e9b288c242156d0 P c738779827da4a8bbcd0b8c017e67dbc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:09:39.183329 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 15046
W20260809 19:09:39.201833 14930 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.39.1:37861 (error 108)
I20260809 19:09:39.201980 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 15278
I20260809 19:09:39.203843 15722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:39.203390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:37861 (local address 127.0.0.1:48972)
0809 19:09:39.203580 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:39.203710 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:37861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260809 19:09:39.204077 14930 catalog_manager.cc:4584] TS c738779827da4a8bbcd0b8c017e67dbc (127.7.39.1:37861): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6d139c4b90c44ff89e9b288c242156d0: Network error: Client connection negotiation failed: client connection to 127.7.39.1:37861: connect: Connection refused (error 111)
I20260809 19:09:39.205467 15726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:39.202932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44414 (local address 127.7.39.2:34303)
0809 19:09:39.203120 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:39.203126 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:39.203147 (+ 21us) server_negotiation.cc:407] Connection header received
0809 19:09:39.203317 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:39.203322 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:39.203381 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:39.203465 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:39.204838 (+ 1373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:39.204844 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:39.204849 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:09:39.204873 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:39.204903 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:09:39.204915 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:39.205038 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:39.205127 (+ 89us) server_negotiation.cc:299] Negotiation successful
0809 19:09:39.205188 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 19:09:39.206224 15476 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:39.257790 15722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:39.257293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:37861 (local address 127.0.0.1:48982)
0809 19:09:39.257520 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:39.257627 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:37861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260809 19:09:39.258868 15722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:39.258534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:37861 (local address 127.0.0.1:48988)
0809 19:09:39.258682 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:39.258750 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:37861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 19:09:39.311578 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 15278
I20260809 19:09:39.319368 15722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:39.318889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:37861 (local address 127.0.0.1:48990)
0809 19:09:39.319113 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:39.319203 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:37861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260809 19:09:39.320495 15722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:39.320127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:37861 (local address 127.0.0.1:49002)
0809 19:09:39.320306 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:39.320374 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:37861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260809 19:09:39.334890 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 15492
I20260809 19:09:39.337376 15724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:39.335642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57202 (local address 127.7.39.3:44771)
0809 19:09:39.335791 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:39.335795 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:39.335813 (+ 18us) server_negotiation.cc:407] Connection header received
0809 19:09:39.335945 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:39.335948 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:39.336051 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:39.336128 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:39.336931 (+ 803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:39.336934 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:39.336937 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:09:39.336950 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:39.336976 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:09:39.336988 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:39.337091 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:39.337124 (+ 33us) server_negotiation.cc:299] Negotiation successful
0809 19:09:39.337167 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 19:09:39.338011 15692 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:39.400996 15722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:39.400519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:37861 (local address 127.0.0.1:49014)
0809 19:09:39.400745 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:39.400851 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:37861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260809 19:09:39.402070 15722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:39.401670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:37861 (local address 127.0.0.1:49028)
0809 19:09:39.401869 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:39.401940 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:37861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
I20260809 19:09:39.422103 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 15492
I20260809 19:09:39.445288 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 14888
I20260809 19:09:39.446374 15002 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:39.548673 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 14888
2026-08-09T19:09:39Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2545 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260809 19:09:39.597397 7324 mini_oidc.cc:152] Starting JWKS server
I20260809 19:09:39.600317 7324 webserver.cc:460] Webserver started at https://127.0.0.1:42255/ using document root <none> and password file <none>
I20260809 19:09:39.600658 7324 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 19:09:39.601279 7324 webserver.cc:460] Webserver started at http://127.0.0.1:33641/ using document root <none> and password file <none>
2026-08-09T19:09:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:09:39Z Disabled control of system clock
I20260809 19:09:39.626808 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:37379
--webserver_interface=127.7.39.62
--webserver_port=0
--builtin_ntp_servers=127.7.39.20:45111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:37379
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42255/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786302538618573-7324-0/testchainca.cert with env {}
W20260809 19:09:39.936769 15789 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:39.937096 15789 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:39.937254 15789 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:39.944585 15789 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:09:39.944712 15789 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:39.944787 15789 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:39.944880 15789 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:09:39.944948 15789 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 19:09:39.945053 15789 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 19:09:39.945114 15789 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:42255/jwks.json
I20260809 19:09:39.955423 15789 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:45111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:37379
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:37379
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42255/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786302538618573-7324-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:39.956660 15789 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:39.957949 15789 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:39.969189 15799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:39.969197 15802 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:39.969247 15804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:39.969947 15789 server_base.cc:1034] running on GCE node
I20260809 19:09:39.970738 15789 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:39.971973 15789 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:39.973163 15789 hybrid_clock.cc:648] HybridClock initialized: now 1786302579973122 us; error 37 us; skew 500 ppm
I20260809 19:09:39.973487 15789 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:09:39.975658 15789 webserver.cc:460] Webserver started at http://127.7.39.62:41075/ using document root <none> and password file <none>
I20260809 19:09:39.976274 15789 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:39.976377 15789 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:39.976670 15789 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:39.979388 15789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "9ed9159cb28742e8b2d31a5b4caf9ca8"
format_stamp: "Formatted at 2026-08-09 19:09:39 on dist-test-slave-4tdj"
server_key: "345cda389dddfd3b4489e38c267e5b62"
server_key_iv: "e4c7331f218541abf01f0d0e06188e40"
server_key_version: "encryptionkey@0"
I20260809 19:09:39.980132 15789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "9ed9159cb28742e8b2d31a5b4caf9ca8"
format_stamp: "Formatted at 2026-08-09 19:09:39 on dist-test-slave-4tdj"
server_key: "345cda389dddfd3b4489e38c267e5b62"
server_key_iv: "e4c7331f218541abf01f0d0e06188e40"
server_key_version: "encryptionkey@0"
I20260809 19:09:39.984812 15789 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 19:09:39.987989 15813 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:39.989266 15789 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 19:09:39.989428 15789 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "9ed9159cb28742e8b2d31a5b4caf9ca8"
format_stamp: "Formatted at 2026-08-09 19:09:39 on dist-test-slave-4tdj"
server_key: "345cda389dddfd3b4489e38c267e5b62"
server_key_iv: "e4c7331f218541abf01f0d0e06188e40"
server_key_version: "encryptionkey@0"
I20260809 19:09:39.989616 15789 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:40.005978 15789 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:40.006893 15789 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:40.007169 15789 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:40.023981 15789 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:37379
I20260809 19:09:40.024001 15900 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:37379 every 8 connection(s)
I20260809 19:09:40.025249 15789 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:09:40.028855 15902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:40.031461 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 15789
I20260809 19:09:40.031637 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:09:40.032241 7324 external_mini_cluster.cc:1428] Setting key 1e76f012b7f7d7116ea3c9a60c547148
I20260809 19:09:40.039800 15902 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ed9159cb28742e8b2d31a5b4caf9ca8: Bootstrap starting.
I20260809 19:09:40.042887 15902 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9ed9159cb28742e8b2d31a5b4caf9ca8: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:40.043967 15902 log.cc:824] T 00000000000000000000000000000000 P 9ed9159cb28742e8b2d31a5b4caf9ca8: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:40.044756 15908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:40.033988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38984 (local address 127.7.39.62:37379)
0809 19:09:40.034889 (+ 901us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:40.034899 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:40.034939 (+ 40us) server_negotiation.cc:407] Connection header received
0809 19:09:40.036566 (+ 1627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:40.036587 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:40.037026 (+ 439us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:40.037385 (+ 359us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:40.037955 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:40.039220 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:40.040545 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:40.041193 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:40.041364 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:40.042445 (+ 1081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:40.042452 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:40.042466 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:09:40.042971 (+ 505us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:40.043086 (+ 115us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:09:40.043110 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:40.043225 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:40.043421 (+ 196us) server_negotiation.cc:299] Negotiation successful
0809 19:09:40.043691 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":521,"thread_start_us":308,"threads_started":1}
I20260809 19:09:40.046958 15902 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ed9159cb28742e8b2d31a5b4caf9ca8: No bootstrap required, opened a new log
I20260809 19:09:40.048406 7324 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:09:40.054051 15902 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9ed9159cb28742e8b2d31a5b4caf9ca8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ed9159cb28742e8b2d31a5b4caf9ca8" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 37379 } }
I20260809 19:09:40.054406 15902 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9ed9159cb28742e8b2d31a5b4caf9ca8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:40.054503 15902 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9ed9159cb28742e8b2d31a5b4caf9ca8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ed9159cb28742e8b2d31a5b4caf9ca8, State: Initialized, Role: FOLLOWER
I20260809 19:09:40.055068 15902 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ed9159cb28742e8b2d31a5b4caf9ca8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ed9159cb28742e8b2d31a5b4caf9ca8" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 37379 } }
I20260809 19:09:40.055327 15902 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9ed9159cb28742e8b2d31a5b4caf9ca8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:09:40.055474 15902 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9ed9159cb28742e8b2d31a5b4caf9ca8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:09:40.055644 15902 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9ed9159cb28742e8b2d31a5b4caf9ca8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:40.057607 15902 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9ed9159cb28742e8b2d31a5b4caf9ca8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ed9159cb28742e8b2d31a5b4caf9ca8" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 37379 } }
I20260809 19:09:40.058058 15902 leader_election.cc:302] T 00000000000000000000000000000000 P 9ed9159cb28742e8b2d31a5b4caf9ca8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9ed9159cb28742e8b2d31a5b4caf9ca8; no voters:
I20260809 19:09:40.058610 15902 leader_election.cc:288] T 00000000000000000000000000000000 P 9ed9159cb28742e8b2d31a5b4caf9ca8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:09:40.058730 15910 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9ed9159cb28742e8b2d31a5b4caf9ca8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:09:40.059358 15910 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9ed9159cb28742e8b2d31a5b4caf9ca8 [term 1 LEADER]: Becoming Leader. State: Replica: 9ed9159cb28742e8b2d31a5b4caf9ca8, State: Running, Role: LEADER
I20260809 19:09:40.059885 15910 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ed9159cb28742e8b2d31a5b4caf9ca8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ed9159cb28742e8b2d31a5b4caf9ca8" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 37379 } }
I20260809 19:09:40.060456 15902 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9ed9159cb28742e8b2d31a5b4caf9ca8 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:09:40.062666 15913 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ed9159cb28742e8b2d31a5b4caf9ca8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ed9159cb28742e8b2d31a5b4caf9ca8. Latest consensus state: current_term: 1 leader_uuid: "9ed9159cb28742e8b2d31a5b4caf9ca8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ed9159cb28742e8b2d31a5b4caf9ca8" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 37379 } } }
I20260809 19:09:40.062682 15912 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ed9159cb28742e8b2d31a5b4caf9ca8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9ed9159cb28742e8b2d31a5b4caf9ca8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ed9159cb28742e8b2d31a5b4caf9ca8" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 37379 } } }
I20260809 19:09:40.063295 15912 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ed9159cb28742e8b2d31a5b4caf9ca8 [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:40.065382 15913 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ed9159cb28742e8b2d31a5b4caf9ca8 [sys.catalog]: This master's current role is: LEADER
W20260809 19:09:40.071878 15942 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9ed9159cb28742e8b2d31a5b4caf9ca8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 19:09:40.071975 15942 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 19:09:40.072093 15928 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:09:40.074182 15928 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:09:40.082213 15928 catalog_manager.cc:1347] Generated new cluster ID: fe90aec9dc314562978b805347ca8899
I20260809 19:09:40.082340 15928 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:09:40.092753 15928 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:09:40.093998 15928 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:09:40.104806 15928 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9ed9159cb28742e8b2d31a5b4caf9ca8: Generated new TSK 0
I20260809 19:09:40.105585 15928 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 19:09:40.155355 15958 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260809 19:09:40.155558 15958 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 19:09:40.156769 15908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:40.131102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38990 (local address 127.7.39.62:37379)
0809 19:09:40.131292 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:40.131299 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:40.131881 (+ 582us) server_negotiation.cc:407] Connection header received
0809 19:09:40.132222 (+ 341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:40.132226 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:40.132291 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:40.132405 (+ 114us) server_negotiation.cc:226] Negotiated authn=JWT
0809 19:09:40.132964 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:40.133655 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:40.135722 (+ 2067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:40.136151 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:40.136242 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:40.136864 (+ 622us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 19:09:40.156117 (+ 19253us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42255/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 19:09:40.156467 (+ 350us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38990: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42255/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":57}
W20260809 19:09:40.156886 15908 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38990: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42255/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260809 19:09:40.158268 15954 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:09:40.131066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:37379 (local address 127.0.0.1:38990)
0809 19:09:40.131768 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:40.131793 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:40.131981 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:40.132461 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:40.132467 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:40.132481 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0809 19:09:40.132826 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:40.132839 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:40.133782 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:40.133788 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:40.135576 (+ 1788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:40.135592 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:40.136264 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:40.136327 (+ 63us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:40.136534 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:40.136614 (+ 80us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 19:09:40.156353 (+ 19739us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42255/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 19:09:40.156607 (+ 254us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.7.39.62:37379: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42255/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":309,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.7.39.62:37379: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42255/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260809 19:09:40.159909 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 15789
I20260809 19:09:40.161229 15896 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:40.252000 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 15789
2026-08-09T19:09:40Z chronyd exiting
I20260809 19:09:40.308869 7324 test_util.cc:175] -----------------------------------------------
I20260809 19:09:40.309005 7324 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786302538618573-7324-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (716 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260809 19:09:40.312789 7324 mini_oidc.cc:152] Starting JWKS server
I20260809 19:09:40.314551 7324 webserver.cc:460] Webserver started at https://127.0.0.1:35535/ using document root <none> and password file <none>
I20260809 19:09:40.314775 7324 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 19:09:40.315438 7324 webserver.cc:460] Webserver started at http://127.0.0.1:35517/ using document root <none> and password file <none>
2026-08-09T19:09:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:09:40Z Disabled control of system clock
I20260809 19:09:40.340301 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:40127
--webserver_interface=127.7.39.62
--webserver_port=0
--builtin_ntp_servers=127.7.39.20:38003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:40127
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35535/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786302538618573-7324-0/testchainca.cert with env {}
W20260809 19:09:40.648011 15970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:40.648303 15970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:40.648438 15970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:40.655403 15970 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:09:40.655509 15970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:40.655572 15970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:40.655655 15970 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:09:40.655719 15970 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 19:09:40.655826 15970 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 19:09:40.655886 15970 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35535/jwks.json
I20260809 19:09:40.669845 15970 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:38003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:40127
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:40127
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35535/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786302538618573-7324-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:40.671600 15970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:40.673348 15970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:40.688773 15977 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:40.688777 15976 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:40.689239 15980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:40.690503 15970 server_base.cc:1034] running on GCE node
I20260809 19:09:40.691227 15970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:40.694366 15970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:40.695655 15970 hybrid_clock.cc:648] HybridClock initialized: now 1786302580695543 us; error 97 us; skew 500 ppm
I20260809 19:09:40.696045 15970 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:09:40.698693 15970 webserver.cc:460] Webserver started at http://127.7.39.62:42237/ using document root <none> and password file <none>
I20260809 19:09:40.699344 15970 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:40.699432 15970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:40.699759 15970 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:40.702652 15970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "2f7cedfdbe154cb9b28cfe3ec05aae33"
format_stamp: "Formatted at 2026-08-09 19:09:40 on dist-test-slave-4tdj"
server_key: "feb9f248a307d1dc1f8850efd6659e8e"
server_key_iv: "93181d1114822e8ca2832c2908c22534"
server_key_version: "encryptionkey@0"
I20260809 19:09:40.703398 15970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "2f7cedfdbe154cb9b28cfe3ec05aae33"
format_stamp: "Formatted at 2026-08-09 19:09:40 on dist-test-slave-4tdj"
server_key: "feb9f248a307d1dc1f8850efd6659e8e"
server_key_iv: "93181d1114822e8ca2832c2908c22534"
server_key_version: "encryptionkey@0"
I20260809 19:09:40.708635 15970 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 19:09:40.712229 15989 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:40.713497 15970 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 19:09:40.713660 15970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "2f7cedfdbe154cb9b28cfe3ec05aae33"
format_stamp: "Formatted at 2026-08-09 19:09:40 on dist-test-slave-4tdj"
server_key: "feb9f248a307d1dc1f8850efd6659e8e"
server_key_iv: "93181d1114822e8ca2832c2908c22534"
server_key_version: "encryptionkey@0"
I20260809 19:09:40.713850 15970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:40.731781 15970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:40.732523 15970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:40.732777 15970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:40.749502 15970 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:40127
I20260809 19:09:40.749513 16076 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:40127 every 8 connection(s)
I20260809 19:09:40.750757 15970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:09:40.754280 16079 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:40.759406 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 15970
I20260809 19:09:40.759594 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:09:40.760353 7324 external_mini_cluster.cc:1428] Setting key d493d862892dfbf635a27ac5fc4fb4a4
I20260809 19:09:40.764935 16079 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f7cedfdbe154cb9b28cfe3ec05aae33: Bootstrap starting.
I20260809 19:09:40.768440 16079 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2f7cedfdbe154cb9b28cfe3ec05aae33: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:40.769582 16079 log.cc:824] T 00000000000000000000000000000000 P 2f7cedfdbe154cb9b28cfe3ec05aae33: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:40.772171 16079 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f7cedfdbe154cb9b28cfe3ec05aae33: No bootstrap required, opened a new log
I20260809 19:09:40.773176 16084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:40.762203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50896 (local address 127.7.39.62:40127)
0809 19:09:40.763214 (+ 1011us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:40.763224 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:40.763265 (+ 41us) server_negotiation.cc:407] Connection header received
0809 19:09:40.764863 (+ 1598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:40.764884 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:40.765338 (+ 454us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:40.765648 (+ 310us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:40.766163 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:40.767463 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:40.769170 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:40.769872 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:40.770033 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:40.771085 (+ 1052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:40.771093 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:40.771105 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:09:40.771598 (+ 493us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:40.771670 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:09:40.771689 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:40.771798 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:40.772004 (+ 206us) server_negotiation.cc:299] Negotiation successful
0809 19:09:40.772312 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":622,"thread_start_us":385,"threads_started":1}
I20260809 19:09:40.776569 7324 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:09:40.779461 16079 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2f7cedfdbe154cb9b28cfe3ec05aae33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f7cedfdbe154cb9b28cfe3ec05aae33" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 40127 } }
I20260809 19:09:40.779819 16079 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2f7cedfdbe154cb9b28cfe3ec05aae33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:40.779910 16079 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2f7cedfdbe154cb9b28cfe3ec05aae33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f7cedfdbe154cb9b28cfe3ec05aae33, State: Initialized, Role: FOLLOWER
I20260809 19:09:40.780402 16079 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f7cedfdbe154cb9b28cfe3ec05aae33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f7cedfdbe154cb9b28cfe3ec05aae33" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 40127 } }
I20260809 19:09:40.780615 16079 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2f7cedfdbe154cb9b28cfe3ec05aae33 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:09:40.780737 16079 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2f7cedfdbe154cb9b28cfe3ec05aae33 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:09:40.780881 16079 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2f7cedfdbe154cb9b28cfe3ec05aae33 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:40.782864 16079 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2f7cedfdbe154cb9b28cfe3ec05aae33 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f7cedfdbe154cb9b28cfe3ec05aae33" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 40127 } }
I20260809 19:09:40.783291 16079 leader_election.cc:302] T 00000000000000000000000000000000 P 2f7cedfdbe154cb9b28cfe3ec05aae33 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2f7cedfdbe154cb9b28cfe3ec05aae33; no voters:
I20260809 19:09:40.783833 16079 leader_election.cc:288] T 00000000000000000000000000000000 P 2f7cedfdbe154cb9b28cfe3ec05aae33 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:09:40.783946 16088 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2f7cedfdbe154cb9b28cfe3ec05aae33 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:09:40.784619 16088 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2f7cedfdbe154cb9b28cfe3ec05aae33 [term 1 LEADER]: Becoming Leader. State: Replica: 2f7cedfdbe154cb9b28cfe3ec05aae33, State: Running, Role: LEADER
I20260809 19:09:40.785107 16088 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2f7cedfdbe154cb9b28cfe3ec05aae33 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f7cedfdbe154cb9b28cfe3ec05aae33" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 40127 } }
I20260809 19:09:40.785790 16079 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2f7cedfdbe154cb9b28cfe3ec05aae33 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:09:40.787854 16089 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f7cedfdbe154cb9b28cfe3ec05aae33 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2f7cedfdbe154cb9b28cfe3ec05aae33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f7cedfdbe154cb9b28cfe3ec05aae33" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 40127 } } }
I20260809 19:09:40.788268 16089 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f7cedfdbe154cb9b28cfe3ec05aae33 [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:40.788136 16091 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f7cedfdbe154cb9b28cfe3ec05aae33 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f7cedfdbe154cb9b28cfe3ec05aae33. Latest consensus state: current_term: 1 leader_uuid: "2f7cedfdbe154cb9b28cfe3ec05aae33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f7cedfdbe154cb9b28cfe3ec05aae33" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 40127 } } }
I20260809 19:09:40.788439 16091 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f7cedfdbe154cb9b28cfe3ec05aae33 [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:40.789917 16101 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:09:40.794092 16101 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:09:40.801674 16101 catalog_manager.cc:1347] Generated new cluster ID: 35cfd225a26d43249031280bbe6f81ba
I20260809 19:09:40.801760 16101 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:09:40.816316 16101 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:09:40.817507 16101 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:09:40.824254 16101 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2f7cedfdbe154cb9b28cfe3ec05aae33: Generated new TSK 0
I20260809 19:09:40.824878 16101 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 19:09:40.860728 16122 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260809 19:09:40.860844 16122 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 19:09:40.861755 16084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:40.842817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50906 (local address 127.7.39.62:40127)
0809 19:09:40.843018 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:40.843025 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:40.843453 (+ 428us) server_negotiation.cc:407] Connection header received
0809 19:09:40.843684 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:40.843688 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:40.843756 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:40.843875 (+ 119us) server_negotiation.cc:226] Negotiated authn=JWT
0809 19:09:40.844482 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:40.845185 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:40.847213 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:40.847644 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:40.847733 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:40.848250 (+ 517us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 19:09:40.861263 (+ 13013us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35535/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 19:09:40.861555 (+ 292us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50906: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35535/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":58}
W20260809 19:09:40.861881 16084 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50906: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35535/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260809 19:09:40.862466 16121 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:09:40.842773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:40127 (local address 127.0.0.1:50906)
0809 19:09:40.843353 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:40.843372 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:40.843524 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:40.843910 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:40.843914 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:40.843926 (+ 12us) client_negotiation.cc:189] Negotiated authn=JWT
0809 19:09:40.844308 (+ 382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:40.844321 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:40.845332 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:40.845338 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:40.847084 (+ 1746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:40.847098 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:40.847750 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:40.847815 (+ 65us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:40.847998 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:40.848044 (+ 46us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 19:09:40.861468 (+ 13424us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35535/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 19:09:40.861750 (+ 282us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.7.39.62:40127: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35535/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":294,"threads_started":1}
I20260809 19:09:40.863945 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 15970
I20260809 19:09:40.864943 16069 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:40.954849 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 15970
2026-08-09T19:09:40Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (700 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260809 19:09:41.013837 7324 mini_oidc.cc:152] Starting JWKS server
I20260809 19:09:41.015853 7324 webserver.cc:460] Webserver started at https://127.0.0.1:41485/ using document root <none> and password file <none>
I20260809 19:09:41.016140 7324 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 19:09:41.016783 7324 webserver.cc:460] Webserver started at http://127.0.0.1:33865/ using document root <none> and password file <none>
2026-08-09T19:09:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:09:41Z Disabled control of system clock
I20260809 19:09:41.045282 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:36447
--webserver_interface=127.7.39.62
--webserver_port=0
--builtin_ntp_servers=127.7.39.20:39507
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:36447
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41485/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 19:09:41.352433 16133 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:41.352718 16133 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:41.352854 16133 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:41.359642 16133 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:09:41.359742 16133 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:41.359807 16133 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:41.359885 16133 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:09:41.359944 16133 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 19:09:41.360028 16133 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 19:09:41.360081 16133 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41485/jwks.json
I20260809 19:09:41.368607 16133 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:39507
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:36447
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:36447
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41485/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:41.369763 16133 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:41.371527 16133 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:41.382545 16139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:41.382436 16142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:41.382472 16140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:41.383296 16133 server_base.cc:1034] running on GCE node
I20260809 19:09:41.383941 16133 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:41.385142 16133 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:41.386355 16133 hybrid_clock.cc:648] HybridClock initialized: now 1786302581386311 us; error 33 us; skew 500 ppm
I20260809 19:09:41.386679 16133 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:09:41.405071 16133 webserver.cc:460] Webserver started at http://127.7.39.62:37797/ using document root <none> and password file <none>
I20260809 19:09:41.405719 16133 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:41.405810 16133 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:41.406127 16133 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:41.409041 16133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "7fec5a5e31cc48a39720e03afc99eb76"
format_stamp: "Formatted at 2026-08-09 19:09:41 on dist-test-slave-4tdj"
server_key: "f6e50fd20980735e312442c3b051d3f9"
server_key_iv: "ac63747880e02541b117ad8097a37473"
server_key_version: "encryptionkey@0"
I20260809 19:09:41.409792 16133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "7fec5a5e31cc48a39720e03afc99eb76"
format_stamp: "Formatted at 2026-08-09 19:09:41 on dist-test-slave-4tdj"
server_key: "f6e50fd20980735e312442c3b051d3f9"
server_key_iv: "ac63747880e02541b117ad8097a37473"
server_key_version: "encryptionkey@0"
I20260809 19:09:41.414724 16133 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260809 19:09:41.418020 16151 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:41.419276 16133 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:09:41.419430 16133 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "7fec5a5e31cc48a39720e03afc99eb76"
format_stamp: "Formatted at 2026-08-09 19:09:41 on dist-test-slave-4tdj"
server_key: "f6e50fd20980735e312442c3b051d3f9"
server_key_iv: "ac63747880e02541b117ad8097a37473"
server_key_version: "encryptionkey@0"
I20260809 19:09:41.419611 16133 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:41.453030 16133 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:41.453781 16133 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:41.454043 16133 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:41.470737 16133 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:36447
I20260809 19:09:41.470757 16225 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:36447 every 8 connection(s)
I20260809 19:09:41.471997 16133 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:09:41.475523 16229 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:41.480762 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 16133
I20260809 19:09:41.480954 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:09:41.481570 7324 external_mini_cluster.cc:1428] Setting key dccf25f823aa59741b0e68e99a7bf9d3
I20260809 19:09:41.486012 16229 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7fec5a5e31cc48a39720e03afc99eb76: Bootstrap starting.
I20260809 19:09:41.488915 16229 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7fec5a5e31cc48a39720e03afc99eb76: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:41.489861 16229 log.cc:824] T 00000000000000000000000000000000 P 7fec5a5e31cc48a39720e03afc99eb76: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:41.492594 16229 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7fec5a5e31cc48a39720e03afc99eb76: No bootstrap required, opened a new log
I20260809 19:09:41.493844 16232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:41.483384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36388 (local address 127.7.39.62:36447)
0809 19:09:41.484345 (+ 961us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:41.484355 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:41.484394 (+ 39us) server_negotiation.cc:407] Connection header received
0809 19:09:41.485954 (+ 1560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:41.485974 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:41.486438 (+ 464us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:41.486775 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:41.487301 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:41.488507 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:41.489754 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:41.490485 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:41.490683 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:41.491798 (+ 1115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:41.491808 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:41.491821 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:09:41.492309 (+ 488us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:41.492382 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:09:41.492401 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:41.492500 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:41.492732 (+ 232us) server_negotiation.cc:299] Negotiation successful
0809 19:09:41.492996 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":557,"thread_start_us":326,"threads_started":1}
I20260809 19:09:41.497321 7324 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:09:41.500001 16229 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7fec5a5e31cc48a39720e03afc99eb76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fec5a5e31cc48a39720e03afc99eb76" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 36447 } }
I20260809 19:09:41.500372 16229 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7fec5a5e31cc48a39720e03afc99eb76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:41.500474 16229 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7fec5a5e31cc48a39720e03afc99eb76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fec5a5e31cc48a39720e03afc99eb76, State: Initialized, Role: FOLLOWER
I20260809 19:09:41.500927 16229 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7fec5a5e31cc48a39720e03afc99eb76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fec5a5e31cc48a39720e03afc99eb76" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 36447 } }
I20260809 19:09:41.501132 16229 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7fec5a5e31cc48a39720e03afc99eb76 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:09:41.501231 16229 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7fec5a5e31cc48a39720e03afc99eb76 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:09:41.501341 16229 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7fec5a5e31cc48a39720e03afc99eb76 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:41.503360 16229 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7fec5a5e31cc48a39720e03afc99eb76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fec5a5e31cc48a39720e03afc99eb76" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 36447 } }
I20260809 19:09:41.503836 16229 leader_election.cc:302] T 00000000000000000000000000000000 P 7fec5a5e31cc48a39720e03afc99eb76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7fec5a5e31cc48a39720e03afc99eb76; no voters:
I20260809 19:09:41.504434 16229 leader_election.cc:288] T 00000000000000000000000000000000 P 7fec5a5e31cc48a39720e03afc99eb76 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:09:41.504537 16236 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7fec5a5e31cc48a39720e03afc99eb76 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:09:41.505162 16236 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7fec5a5e31cc48a39720e03afc99eb76 [term 1 LEADER]: Becoming Leader. State: Replica: 7fec5a5e31cc48a39720e03afc99eb76, State: Running, Role: LEADER
I20260809 19:09:41.505688 16236 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7fec5a5e31cc48a39720e03afc99eb76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fec5a5e31cc48a39720e03afc99eb76" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 36447 } }
I20260809 19:09:41.506528 16229 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7fec5a5e31cc48a39720e03afc99eb76 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:09:41.508383 16240 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7fec5a5e31cc48a39720e03afc99eb76 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7fec5a5e31cc48a39720e03afc99eb76" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fec5a5e31cc48a39720e03afc99eb76" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 36447 } } }
I20260809 19:09:41.508782 16240 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7fec5a5e31cc48a39720e03afc99eb76 [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:41.508695 16242 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7fec5a5e31cc48a39720e03afc99eb76 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7fec5a5e31cc48a39720e03afc99eb76. Latest consensus state: current_term: 1 leader_uuid: "7fec5a5e31cc48a39720e03afc99eb76" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fec5a5e31cc48a39720e03afc99eb76" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 36447 } } }
I20260809 19:09:41.509068 16242 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7fec5a5e31cc48a39720e03afc99eb76 [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:41.510282 16248 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:09:41.515517 16248 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:09:41.522825 16248 catalog_manager.cc:1347] Generated new cluster ID: daaaf98056c7469cbeeba4accd8f423f
I20260809 19:09:41.522930 16248 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:09:41.541529 16248 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:09:41.542719 16248 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:09:41.549122 16248 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7fec5a5e31cc48a39720e03afc99eb76: Generated new TSK 0
I20260809 19:09:41.549851 16248 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:09:41.579001 16232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:41.571122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36392 (local address 127.7.39.62:36447)
0809 19:09:41.571310 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:41.571317 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:41.571801 (+ 484us) server_negotiation.cc:407] Connection header received
0809 19:09:41.572014 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:41.572017 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:41.572096 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:41.572204 (+ 108us) server_negotiation.cc:226] Negotiated authn=JWT
0809 19:09:41.572711 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:41.573394 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:41.575426 (+ 2032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:41.575844 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:41.575938 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:41.576494 (+ 556us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 19:09:41.578402 (+ 1908us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41485/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 19:09:41.578684 (+ 282us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36392: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41485/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":55}
W20260809 19:09:41.579133 16232 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36392: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41485/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260809 19:09:41.579206 16274 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:09:41.571098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:36447 (local address 127.0.0.1:36392)
0809 19:09:41.571700 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:41.571719 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:41.571863 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:41.572232 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:41.572237 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:41.572250 (+ 13us) client_negotiation.cc:189] Negotiated authn=JWT
0809 19:09:41.572573 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:41.572586 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:41.573510 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:41.573516 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:41.575287 (+ 1771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:41.575303 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:41.575956 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:41.576039 (+ 83us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:41.576223 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:41.576269 (+ 46us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 19:09:41.578586 (+ 2317us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41485/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 19:09:41.578805 (+ 219us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.7.39.62:36447: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41485/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":303,"threads_started":1}
I20260809 19:09:41.580909 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 16133
I20260809 19:09:41.581761 16220 generic_service.cc:196] Checking for leaks (request via RPC)
E20260809 19:09:41.591107 16277 webserver.cc:533] Webserver: sslize failed:
E20260809 19:09:41.591210 16277 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 19:09:41.670044 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 16133
2026-08-09T19:09:41Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (715 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-09T19:09:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:09:41Z Disabled control of system clock
I20260809 19:09:41.756886 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:46009
--webserver_interface=127.7.39.62
--webserver_port=0
--builtin_ntp_servers=127.7.39.20:36525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:46009
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786302538618573-7324-0/testchainca.cert with env {}
W20260809 19:09:42.068599 16285 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:42.068866 16285 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:42.068989 16285 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:42.075932 16285 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:09:42.076022 16285 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:42.076082 16285 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:42.076159 16285 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:09:42.076221 16285 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 19:09:42.076301 16285 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 19:09:42.076351 16285 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260809 19:09:42.085666 16285 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:36525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:46009
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:46009
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786302538618573-7324-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:42.086867 16285 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:42.088078 16285 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:42.098883 16298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:42.098958 16294 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:42.098971 16295 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:42.100147 16285 server_base.cc:1034] running on GCE node
I20260809 19:09:42.100858 16285 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:42.102092 16285 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:42.103282 16285 hybrid_clock.cc:648] HybridClock initialized: now 1786302582103231 us; error 39 us; skew 500 ppm
I20260809 19:09:42.103607 16285 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:09:42.105667 16285 webserver.cc:460] Webserver started at http://127.7.39.62:33921/ using document root <none> and password file <none>
I20260809 19:09:42.106316 16285 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:42.106429 16285 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:42.106730 16285 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:42.109341 16285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "a428e1c4ccc34933a4d4a77e3d4b9474"
format_stamp: "Formatted at 2026-08-09 19:09:42 on dist-test-slave-4tdj"
server_key: "17ad0f880b9b4e9319d6bd5223016adb"
server_key_iv: "14688c2244e4aed7378e5064bf2ebf26"
server_key_version: "encryptionkey@0"
I20260809 19:09:42.110082 16285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "a428e1c4ccc34933a4d4a77e3d4b9474"
format_stamp: "Formatted at 2026-08-09 19:09:42 on dist-test-slave-4tdj"
server_key: "17ad0f880b9b4e9319d6bd5223016adb"
server_key_iv: "14688c2244e4aed7378e5064bf2ebf26"
server_key_version: "encryptionkey@0"
I20260809 19:09:42.114794 16285 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 19:09:42.117875 16306 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:42.119128 16285 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 19:09:42.119277 16285 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "a428e1c4ccc34933a4d4a77e3d4b9474"
format_stamp: "Formatted at 2026-08-09 19:09:42 on dist-test-slave-4tdj"
server_key: "17ad0f880b9b4e9319d6bd5223016adb"
server_key_iv: "14688c2244e4aed7378e5064bf2ebf26"
server_key_version: "encryptionkey@0"
I20260809 19:09:42.119462 16285 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:42.134526 16285 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:42.135213 16285 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:42.135454 16285 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:42.151682 16285 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:46009
I20260809 19:09:42.151700 16390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:46009 every 8 connection(s)
I20260809 19:09:42.153034 16285 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:09:42.157593 16392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:42.162942 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 16285
I20260809 19:09:42.163146 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:09:42.163952 7324 external_mini_cluster.cc:1428] Setting key 3d8725a221b164b933fc9778092b40f1
I20260809 19:09:42.168509 16392 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a428e1c4ccc34933a4d4a77e3d4b9474: Bootstrap starting.
I20260809 19:09:42.171980 16392 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a428e1c4ccc34933a4d4a77e3d4b9474: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:42.173229 16392 log.cc:824] T 00000000000000000000000000000000 P a428e1c4ccc34933a4d4a77e3d4b9474: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:42.176383 16392 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a428e1c4ccc34933a4d4a77e3d4b9474: No bootstrap required, opened a new log
I20260809 19:09:42.177266 16395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:42.165922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58132 (local address 127.7.39.62:46009)
0809 19:09:42.166936 (+ 1014us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:42.166946 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:42.166987 (+ 41us) server_negotiation.cc:407] Connection header received
0809 19:09:42.168587 (+ 1600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:42.168610 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:42.169077 (+ 467us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:42.169394 (+ 317us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:42.169980 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:42.171285 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:42.173046 (+ 1761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:42.173813 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:42.174031 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:42.175071 (+ 1040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:42.175079 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:42.175092 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:09:42.175626 (+ 534us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:42.175706 (+ 80us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:09:42.175727 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:42.175817 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:42.176025 (+ 208us) server_negotiation.cc:299] Negotiation successful
0809 19:09:42.176302 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":607,"thread_start_us":380,"threads_started":1}
I20260809 19:09:42.180958 7324 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:09:42.184831 16392 raft_consensus.cc:348] T 00000000000000000000000000000000 P a428e1c4ccc34933a4d4a77e3d4b9474 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a428e1c4ccc34933a4d4a77e3d4b9474" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 46009 } }
I20260809 19:09:42.185144 16392 raft_consensus.cc:374] T 00000000000000000000000000000000 P a428e1c4ccc34933a4d4a77e3d4b9474 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:42.185230 16392 raft_consensus.cc:729] T 00000000000000000000000000000000 P a428e1c4ccc34933a4d4a77e3d4b9474 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a428e1c4ccc34933a4d4a77e3d4b9474, State: Initialized, Role: FOLLOWER
I20260809 19:09:42.185688 16392 consensus_queue.cc:260] T 00000000000000000000000000000000 P a428e1c4ccc34933a4d4a77e3d4b9474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a428e1c4ccc34933a4d4a77e3d4b9474" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 46009 } }
I20260809 19:09:42.185873 16392 raft_consensus.cc:388] T 00000000000000000000000000000000 P a428e1c4ccc34933a4d4a77e3d4b9474 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:09:42.185966 16392 raft_consensus.cc:482] T 00000000000000000000000000000000 P a428e1c4ccc34933a4d4a77e3d4b9474 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:09:42.186077 16392 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a428e1c4ccc34933a4d4a77e3d4b9474 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:42.188045 16392 raft_consensus.cc:504] T 00000000000000000000000000000000 P a428e1c4ccc34933a4d4a77e3d4b9474 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a428e1c4ccc34933a4d4a77e3d4b9474" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 46009 } }
I20260809 19:09:42.188444 16392 leader_election.cc:302] T 00000000000000000000000000000000 P a428e1c4ccc34933a4d4a77e3d4b9474 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a428e1c4ccc34933a4d4a77e3d4b9474; no voters:
I20260809 19:09:42.188952 16392 leader_election.cc:288] T 00000000000000000000000000000000 P a428e1c4ccc34933a4d4a77e3d4b9474 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:09:42.189105 16397 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a428e1c4ccc34933a4d4a77e3d4b9474 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:09:42.190306 16397 raft_consensus.cc:686] T 00000000000000000000000000000000 P a428e1c4ccc34933a4d4a77e3d4b9474 [term 1 LEADER]: Becoming Leader. State: Replica: a428e1c4ccc34933a4d4a77e3d4b9474, State: Running, Role: LEADER
I20260809 19:09:42.190783 16397 consensus_queue.cc:237] T 00000000000000000000000000000000 P a428e1c4ccc34933a4d4a77e3d4b9474 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a428e1c4ccc34933a4d4a77e3d4b9474" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 46009 } }
I20260809 19:09:42.191051 16392 sys_catalog.cc:564] T 00000000000000000000000000000000 P a428e1c4ccc34933a4d4a77e3d4b9474 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:09:42.193800 16400 sys_catalog.cc:455] T 00000000000000000000000000000000 P a428e1c4ccc34933a4d4a77e3d4b9474 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a428e1c4ccc34933a4d4a77e3d4b9474" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a428e1c4ccc34933a4d4a77e3d4b9474" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 46009 } } }
I20260809 19:09:42.193884 16401 sys_catalog.cc:455] T 00000000000000000000000000000000 P a428e1c4ccc34933a4d4a77e3d4b9474 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a428e1c4ccc34933a4d4a77e3d4b9474. Latest consensus state: current_term: 1 leader_uuid: "a428e1c4ccc34933a4d4a77e3d4b9474" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a428e1c4ccc34933a4d4a77e3d4b9474" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 46009 } } }
I20260809 19:09:42.194119 16400 sys_catalog.cc:458] T 00000000000000000000000000000000 P a428e1c4ccc34933a4d4a77e3d4b9474 [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:42.194239 16401 sys_catalog.cc:458] T 00000000000000000000000000000000 P a428e1c4ccc34933a4d4a77e3d4b9474 [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:42.195101 16411 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:09:42.200769 16411 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:09:42.209232 16411 catalog_manager.cc:1347] Generated new cluster ID: 48f76a593e2944fd8a47e91036edf113
I20260809 19:09:42.209331 16411 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:09:42.223841 16411 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:09:42.225399 16411 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:09:42.233676 16411 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a428e1c4ccc34933a4d4a77e3d4b9474: Generated new TSK 0
I20260809 19:09:42.234611 16411 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:09:42.702565 16395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:42.257315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58140 (local address 127.7.39.62:46009)
0809 19:09:42.257534 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:42.257540 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:42.257832 (+ 292us) server_negotiation.cc:407] Connection header received
0809 19:09:42.258041 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:42.258045 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:42.258124 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:42.258256 (+ 132us) server_negotiation.cc:226] Negotiated authn=JWT
0809 19:09:42.258793 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:42.259546 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:42.261557 (+ 2011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:42.261985 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:42.262080 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:42.262673 (+ 593us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 19:09:42.701976 (+439303us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 19:09:42.702334 (+ 358us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58140: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":79}
W20260809 19:09:42.702661 16395 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58140: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260809 19:09:42.702907 16429 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:09:42.257100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:46009 (local address 127.0.0.1:58140)
0809 19:09:42.257728 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:42.257749 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:42.257889 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:42.258319 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:42.258325 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:42.258338 (+ 13us) client_negotiation.cc:189] Negotiated authn=JWT
0809 19:09:42.258647 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:42.258659 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:42.259691 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:42.259697 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:42.261379 (+ 1682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:42.261394 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:42.262098 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:42.262149 (+ 51us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:42.262369 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:42.262414 (+ 45us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 19:09:42.702236 (+439822us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 19:09:42.702527 (+ 291us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.7.39.62:46009: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":331,"threads_started":1}
I20260809 19:09:42.704016 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 16285
I20260809 19:09:42.705065 16385 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:42.804491 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 16285
2026-08-09T19:09:42Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1117 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (404 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (396 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:09:43 dist-test-slave-4tdj krb5kdc[16461](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:09:43 dist-test-slave-4tdj krb5kdc[16461](info): set up 2 sockets
Aug 09 19:09:43 dist-test-slave-4tdj krb5kdc[16461](info): commencing operation
krb5kdc: starting...
W20260809 19:09:44.791363 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.141s user 0.000s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:09:44 dist-test-slave-4tdj krb5kdc[16461](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:09:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:09:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.39.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
I20260809 19:09:44.979257 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:35615
--webserver_interface=127.7.39.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:37441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:35615
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:45.291697 16481 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:45.291985 16481 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:45.292124 16481 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:45.299093 16481 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:09:45.299193 16481 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:45.299269 16481 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:45.299347 16481 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:09:45.299408 16481 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:09:45.308629 16481 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:37441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:35615
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:35615
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:45.309828 16481 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:45.311091 16481 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:45.322024 16487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:45.322101 16491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:45.322135 16488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:45.322901 16481 server_base.cc:1034] running on GCE node
I20260809 19:09:45.323629 16481 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:45.324921 16481 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:45.326117 16481 hybrid_clock.cc:648] HybridClock initialized: now 1786302585326075 us; error 32 us; skew 500 ppm
I20260809 19:09:45.326468 16481 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:45 dist-test-slave-4tdj krb5kdc[16461](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302585, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:45.329332 16481 init.cc:377] Logged in from keytab as kudu/127.7.39.62@KRBTEST.COM (short username kudu)
I20260809 19:09:45.330700 16481 webserver.cc:460] Webserver started at http://127.7.39.62:36861/ using document root <none> and password file <none>
I20260809 19:09:45.331313 16481 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:45.331425 16481 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:45.331729 16481 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:45.334551 16481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "8b3732efc82c48868ba6a00db9da1b1c"
format_stamp: "Formatted at 2026-08-09 19:09:45 on dist-test-slave-4tdj"
server_key: "a8b15d7dd73e860ff94cfab2508018e3"
server_key_iv: "eb2b4716dd27c7002ff55acc309d9ff5"
server_key_version: "encryptionkey@0"
I20260809 19:09:45.335475 16481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "8b3732efc82c48868ba6a00db9da1b1c"
format_stamp: "Formatted at 2026-08-09 19:09:45 on dist-test-slave-4tdj"
server_key: "a8b15d7dd73e860ff94cfab2508018e3"
server_key_iv: "eb2b4716dd27c7002ff55acc309d9ff5"
server_key_version: "encryptionkey@0"
I20260809 19:09:45.340250 16481 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 19:09:45.343454 16500 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:45.344669 16481 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260809 19:09:45.344827 16481 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "8b3732efc82c48868ba6a00db9da1b1c"
format_stamp: "Formatted at 2026-08-09 19:09:45 on dist-test-slave-4tdj"
server_key: "a8b15d7dd73e860ff94cfab2508018e3"
server_key_iv: "eb2b4716dd27c7002ff55acc309d9ff5"
server_key_version: "encryptionkey@0"
I20260809 19:09:45.344991 16481 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:45.384181 16481 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:45.387806 16481 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:45.388057 16481 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:45.404500 16481 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:35615
I20260809 19:09:45.404562 16583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:35615 every 8 connection(s)
I20260809 19:09:45.405754 16481 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:09:45.406082 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 16481
I20260809 19:09:45.406260 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:09:45.407048 7324 external_mini_cluster.cc:1428] Setting key 829b7757fd14ac25d366d0987aaa32c9
I20260809 19:09:45.409763 16584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 19:09:45 dist-test-slave-4tdj krb5kdc[16461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:45.419622 16584 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b3732efc82c48868ba6a00db9da1b1c: Bootstrap starting.
I20260809 19:09:45.422765 16584 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b3732efc82c48868ba6a00db9da1b1c: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:45.423717 16584 log.cc:824] T 00000000000000000000000000000000 P 8b3732efc82c48868ba6a00db9da1b1c: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:45.426910 16584 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b3732efc82c48868ba6a00db9da1b1c: No bootstrap required, opened a new log
I20260809 19:09:45.427459 16587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:45.408933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45958 (local address 127.7.39.62:35615)
0809 19:09:45.409652 (+ 719us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:45.409662 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:45.409703 (+ 41us) server_negotiation.cc:407] Connection header received
0809 19:09:45.411364 (+ 1661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:45.411385 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:45.411724 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:45.412077 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:45.413452 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:45.414771 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:45.415959 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:45.416582 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:45.416765 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:45.420340 (+ 3575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:45.420347 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:45.420360 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:45.420398 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:45.423320 (+ 2922us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:45.423947 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:45.423955 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:45.423964 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:45.424161 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:45.424567 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:45.424574 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:45.424576 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:45.425159 (+ 583us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:45.425431 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:45.425787 (+ 356us) server_negotiation.cc:299] Negotiation successful
0809 19:09:45.426184 (+ 397us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":528,"thread_start_us":324,"threads_started":1}
I20260809 19:09:45.434744 16584 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b3732efc82c48868ba6a00db9da1b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b3732efc82c48868ba6a00db9da1b1c" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 35615 } }
I20260809 19:09:45.435060 16584 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8b3732efc82c48868ba6a00db9da1b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:45.435132 16584 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b3732efc82c48868ba6a00db9da1b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b3732efc82c48868ba6a00db9da1b1c, State: Initialized, Role: FOLLOWER
I20260809 19:09:45.435582 16584 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b3732efc82c48868ba6a00db9da1b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b3732efc82c48868ba6a00db9da1b1c" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 35615 } }
I20260809 19:09:45.435771 16584 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8b3732efc82c48868ba6a00db9da1b1c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:09:45.435861 16584 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b3732efc82c48868ba6a00db9da1b1c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:09:45.435973 16584 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b3732efc82c48868ba6a00db9da1b1c [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:45.438015 16584 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b3732efc82c48868ba6a00db9da1b1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b3732efc82c48868ba6a00db9da1b1c" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 35615 } }
I20260809 19:09:45.438488 16584 leader_election.cc:302] T 00000000000000000000000000000000 P 8b3732efc82c48868ba6a00db9da1b1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b3732efc82c48868ba6a00db9da1b1c; no voters:
I20260809 19:09:45.439013 16584 leader_election.cc:288] T 00000000000000000000000000000000 P 8b3732efc82c48868ba6a00db9da1b1c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:09:45.439139 16589 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8b3732efc82c48868ba6a00db9da1b1c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:09:45.439731 16589 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8b3732efc82c48868ba6a00db9da1b1c [term 1 LEADER]: Becoming Leader. State: Replica: 8b3732efc82c48868ba6a00db9da1b1c, State: Running, Role: LEADER
I20260809 19:09:45.440218 16589 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b3732efc82c48868ba6a00db9da1b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b3732efc82c48868ba6a00db9da1b1c" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 35615 } }
I20260809 19:09:45.440881 16584 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b3732efc82c48868ba6a00db9da1b1c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:09:45.443082 16592 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b3732efc82c48868ba6a00db9da1b1c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b3732efc82c48868ba6a00db9da1b1c. Latest consensus state: current_term: 1 leader_uuid: "8b3732efc82c48868ba6a00db9da1b1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b3732efc82c48868ba6a00db9da1b1c" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 35615 } } }
I20260809 19:09:45.443110 16590 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b3732efc82c48868ba6a00db9da1b1c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b3732efc82c48868ba6a00db9da1b1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b3732efc82c48868ba6a00db9da1b1c" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 35615 } } }
I20260809 19:09:45.443508 16590 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b3732efc82c48868ba6a00db9da1b1c [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:45.443509 16592 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b3732efc82c48868ba6a00db9da1b1c [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:45.448719 16596 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:09:45.452807 16596 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:09:45.459941 16596 catalog_manager.cc:1347] Generated new cluster ID: 166d2ab8b7364ddaa6eb0d8acf19f1cc
I20260809 19:09:45.460055 16596 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:09:45.483698 16596 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:09:45.485545 16596 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:09:45.492785 16596 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8b3732efc82c48868ba6a00db9da1b1c: Generated new TSK 0
I20260809 19:09:45.493705 16596 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.39.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
I20260809 19:09:45.543185 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.1:0
--local_ip_for_outbound_sockets=127.7.39.1
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:35615
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:37441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:45.854859 16617 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:45.855104 16617 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:45.855229 16617 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:45.862103 16617 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:45.862200 16617 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:45.862375 16617 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.1
I20260809 19:09:45.871762 16617 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:37441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:35615
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.1
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:45.872968 16617 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:45.874228 16617 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:45.886794 16626 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:45.886827 16631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:45.886868 16637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:45.887915 16617 server_base.cc:1034] running on GCE node
I20260809 19:09:45.888552 16617 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:45.889514 16617 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:45.890730 16617 hybrid_clock.cc:648] HybridClock initialized: now 1786302585890672 us; error 46 us; skew 500 ppm
I20260809 19:09:45.891088 16617 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:45 dist-test-slave-4tdj krb5kdc[16461](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302585, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:45.894258 16617 init.cc:377] Logged in from keytab as kudu/127.7.39.1@KRBTEST.COM (short username kudu)
I20260809 19:09:45.895707 16617 webserver.cc:460] Webserver started at http://127.7.39.1:40857/ using document root <none> and password file <none>
I20260809 19:09:45.896342 16617 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:45.896452 16617 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:45.896741 16617 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:45.899869 16617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-0/data/instance:
uuid: "287a14e6c0134862a93c25b058f91889"
format_stamp: "Formatted at 2026-08-09 19:09:45 on dist-test-slave-4tdj"
server_key: "146b774361331b0311793796f2242278"
server_key_iv: "67823fdf1574f872f8c9484542e9c088"
server_key_version: "encryptionkey@0"
I20260809 19:09:45.900653 16617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance:
uuid: "287a14e6c0134862a93c25b058f91889"
format_stamp: "Formatted at 2026-08-09 19:09:45 on dist-test-slave-4tdj"
server_key: "146b774361331b0311793796f2242278"
server_key_iv: "67823fdf1574f872f8c9484542e9c088"
server_key_version: "encryptionkey@0"
I20260809 19:09:45.905807 16617 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 19:09:45.909225 16649 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:45.910547 16617 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:09:45.910712 16617 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-0/wal
uuid: "287a14e6c0134862a93c25b058f91889"
format_stamp: "Formatted at 2026-08-09 19:09:45 on dist-test-slave-4tdj"
server_key: "146b774361331b0311793796f2242278"
server_key_iv: "67823fdf1574f872f8c9484542e9c088"
server_key_version: "encryptionkey@0"
I20260809 19:09:45.910923 16617 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:45.935724 16617 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:45.939436 16617 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:45.939687 16617 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:45.940623 16617 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:09:45.941929 16617 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:45.942004 16617 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:45.942128 16617 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:45.942183 16617 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:45.971728 16617 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.1:44171
I20260809 19:09:45.971776 16818 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.1:44171 every 8 connection(s)
I20260809 19:09:45.972924 16617 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
I20260809 19:09:45.981163 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 16617
I20260809 19:09:45.981345 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance
I20260809 19:09:45.981979 7324 external_mini_cluster.cc:1428] Setting key 3e415d694b1931293b531dbcd80e0852
Aug 09 19:09:45 dist-test-slave-4tdj krb5kdc[16461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302585, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:45.992247 16821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:45.975406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:47033 (local address 127.7.39.62:35615)
0809 19:09:45.975894 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:45.975900 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:45.976802 (+ 902us) server_negotiation.cc:407] Connection header received
0809 19:09:45.978581 (+ 1779us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:45.978586 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:45.978661 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:45.978756 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:45.980116 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:45.980887 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:45.982505 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:45.982901 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:45.983019 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:45.986489 (+ 3470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:45.986495 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:45.986499 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:45.986535 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:45.989303 (+ 2768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:45.990042 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:45.990047 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:45.990050 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:45.990186 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:45.990644 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:45.990648 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:45.990651 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:45.990969 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:45.991110 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:45.991722 (+ 612us) server_negotiation.cc:299] Negotiation successful
0809 19:09:45.991909 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":244,"threads_started":1}
I20260809 19:09:45.993433 16822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:45.975901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:35615 (local address 127.7.39.1:47033)
0809 19:09:45.976643 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:45.976684 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:45.978287 (+ 1603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:45.978936 (+ 649us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:45.978943 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:45.979420 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:45.979985 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:45.980002 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:45.981042 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:45.981045 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:45.982368 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:45.982381 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:45.983120 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:45.983128 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:45.983367 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:45.983969 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:45.983992 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:45.986252 (+ 2260us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:45.989443 (+ 3191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:45.989450 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:45.989461 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:45.989914 (+ 453us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:45.990279 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:45.990282 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:45.990285 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:45.990534 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:45.991080 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:45.991085 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:45.991358 (+ 273us) client_negotiation.cc:769] Sending connection context
0809 19:09:45.991590 (+ 232us) client_negotiation.cc:240] Negotiation successful
0809 19:09:45.992103 (+ 513us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":279,"threads_started":1}
I20260809 19:09:45.994875 16819 heartbeater.cc:347] Connected to a master server at 127.7.39.62:35615
I20260809 19:09:45.995165 16819 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:45.995828 16819 heartbeater.cc:511] Master 127.7.39.62:35615 requested a full tablet report, sending...
I20260809 19:09:45.997752 16528 ts_manager.cc:194] Registered new tserver with Master: 287a14e6c0134862a93c25b058f91889 (127.7.39.1:44171)
I20260809 19:09:45.999228 16528 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.1@KRBTEST.COM'} at 127.7.39.1:47033
WARNING: no policy specified for kudu/127.7.39.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
I20260809 19:09:46.026703 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.2:0
--local_ip_for_outbound_sockets=127.7.39.2
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:35615
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:37441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:46.336331 16825 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:46.336577 16825 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:46.336694 16825 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:46.343734 16825 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:46.343825 16825 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:46.343962 16825 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.2
I20260809 19:09:46.353219 16825 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:37441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:35615
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.2
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:46.354379 16825 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:46.355611 16825 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:46.367587 16834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:46.367623 16837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:46.367844 16833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:46.368562 16825 server_base.cc:1034] running on GCE node
I20260809 19:09:46.369105 16825 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:46.369916 16825 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:46.371109 16825 hybrid_clock.cc:648] HybridClock initialized: now 1786302586371073 us; error 26 us; skew 500 ppm
I20260809 19:09:46.371383 16825 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:46 dist-test-slave-4tdj krb5kdc[16461](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302586, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:46.374226 16825 init.cc:377] Logged in from keytab as kudu/127.7.39.2@KRBTEST.COM (short username kudu)
I20260809 19:09:46.375552 16825 webserver.cc:460] Webserver started at http://127.7.39.2:34375/ using document root <none> and password file <none>
I20260809 19:09:46.376150 16825 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:46.376256 16825 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:46.376536 16825 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:46.379294 16825 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-1/data/instance:
uuid: "f09c24a03e494966b11c3c2a71df0c8f"
format_stamp: "Formatted at 2026-08-09 19:09:46 on dist-test-slave-4tdj"
server_key: "03eaf83081ec16205f0c7cd1424f07a6"
server_key_iv: "fa81d738e34b297ebe7913228410c56a"
server_key_version: "encryptionkey@0"
I20260809 19:09:46.380004 16825 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance:
uuid: "f09c24a03e494966b11c3c2a71df0c8f"
format_stamp: "Formatted at 2026-08-09 19:09:46 on dist-test-slave-4tdj"
server_key: "03eaf83081ec16205f0c7cd1424f07a6"
server_key_iv: "fa81d738e34b297ebe7913228410c56a"
server_key_version: "encryptionkey@0"
I20260809 19:09:46.384682 16825 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 19:09:46.387858 16846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:46.388999 16825 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 19:09:46.389139 16825 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-1/wal
uuid: "f09c24a03e494966b11c3c2a71df0c8f"
format_stamp: "Formatted at 2026-08-09 19:09:46 on dist-test-slave-4tdj"
server_key: "03eaf83081ec16205f0c7cd1424f07a6"
server_key_iv: "fa81d738e34b297ebe7913228410c56a"
server_key_version: "encryptionkey@0"
I20260809 19:09:46.389318 16825 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:46.430732 16825 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:46.434708 16825 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:46.434971 16825 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:46.435873 16825 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:09:46.437157 16825 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:46.437237 16825 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:46.437350 16825 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:46.437399 16825 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:46.466636 16825 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.2:39247
I20260809 19:09:46.466697 17032 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.2:39247 every 8 connection(s)
I20260809 19:09:46.467820 16825 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
I20260809 19:09:46.474375 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 16825
I20260809 19:09:46.474548 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance
I20260809 19:09:46.475078 7324 external_mini_cluster.cc:1428] Setting key 29c0d21aabc63c0a752656fb68652d8c
Aug 09 19:09:46 dist-test-slave-4tdj krb5kdc[16461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302586, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:46.487574 16821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:46.470170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:56425 (local address 127.7.39.62:35615)
0809 19:09:46.470369 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:46.470374 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:46.471435 (+ 1061us) server_negotiation.cc:407] Connection header received
0809 19:09:46.473155 (+ 1720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:46.473162 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:46.473242 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:46.473334 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:46.475156 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:46.475887 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:46.477728 (+ 1841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:46.478334 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:46.478460 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:46.481732 (+ 3272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:46.481739 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:46.481744 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:46.481789 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:46.484654 (+ 2865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:46.485492 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:46.485495 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:46.485497 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:46.485631 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:46.486074 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:46.486077 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:46.486079 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:46.486331 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:46.486441 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:46.487180 (+ 739us) server_negotiation.cc:299] Negotiation successful
0809 19:09:46.487337 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 19:09:46.488839 17037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:46.470620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:35615 (local address 127.7.39.2:56425)
0809 19:09:46.471290 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:46.471328 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:46.472891 (+ 1563us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:46.473565 (+ 674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:46.473574 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:46.474145 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:46.474958 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:46.474983 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:46.476058 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:46.476064 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:46.477583 (+ 1519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:46.477595 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:46.478514 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:46.478518 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:46.478725 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:46.479319 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:46.479340 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:46.481519 (+ 2179us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:46.484807 (+ 3288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:46.484816 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:46.484831 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:46.485394 (+ 563us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:46.485727 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:46.485732 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:46.485734 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:46.485968 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:46.486449 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:46.486458 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:46.486835 (+ 377us) client_negotiation.cc:769] Sending connection context
0809 19:09:46.487119 (+ 284us) client_negotiation.cc:240] Negotiation successful
0809 19:09:46.487577 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":268,"threads_started":1}
I20260809 19:09:46.490149 17034 heartbeater.cc:347] Connected to a master server at 127.7.39.62:35615
I20260809 19:09:46.490476 17034 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:46.491318 17034 heartbeater.cc:511] Master 127.7.39.62:35615 requested a full tablet report, sending...
I20260809 19:09:46.492830 16528 ts_manager.cc:194] Registered new tserver with Master: f09c24a03e494966b11c3c2a71df0c8f (127.7.39.2:39247)
I20260809 19:09:46.493876 16528 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.2@KRBTEST.COM'} at 127.7.39.2:56425
WARNING: no policy specified for kudu/127.7.39.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
I20260809 19:09:46.521423 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.3:0
--local_ip_for_outbound_sockets=127.7.39.3
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:35615
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:37441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:46.825786 17041 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:46.826036 17041 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:46.826160 17041 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:46.832999 17041 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:46.833092 17041 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:46.833242 17041 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.3
I20260809 19:09:46.842331 17041 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:37441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:35615
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.3
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:46.843438 17041 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:46.844636 17041 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:46.856482 17046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:46.856556 17050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:46.856576 17047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:46.857810 17041 server_base.cc:1034] running on GCE node
I20260809 19:09:46.858436 17041 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:46.859268 17041 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:46.860456 17041 hybrid_clock.cc:648] HybridClock initialized: now 1786302586860399 us; error 45 us; skew 500 ppm
I20260809 19:09:46.860734 17041 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:46 dist-test-slave-4tdj krb5kdc[16461](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302586, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:46.863643 17041 init.cc:377] Logged in from keytab as kudu/127.7.39.3@KRBTEST.COM (short username kudu)
I20260809 19:09:46.864854 17041 webserver.cc:460] Webserver started at http://127.7.39.3:34421/ using document root <none> and password file <none>
I20260809 19:09:46.865483 17041 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:46.865595 17041 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:46.865869 17041 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:46.868562 17041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-2/data/instance:
uuid: "3c2e2d924b46443cbed594ba32802b95"
format_stamp: "Formatted at 2026-08-09 19:09:46 on dist-test-slave-4tdj"
server_key: "1ea5786ad651ccbd8d1e9d93b5a44b9e"
server_key_iv: "e84af398f46a601b88c77b23e289c787"
server_key_version: "encryptionkey@0"
I20260809 19:09:46.869277 17041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance:
uuid: "3c2e2d924b46443cbed594ba32802b95"
format_stamp: "Formatted at 2026-08-09 19:09:46 on dist-test-slave-4tdj"
server_key: "1ea5786ad651ccbd8d1e9d93b5a44b9e"
server_key_iv: "e84af398f46a601b88c77b23e289c787"
server_key_version: "encryptionkey@0"
I20260809 19:09:46.873838 17041 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260809 19:09:46.876904 17060 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:46.878063 17041 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 19:09:46.878207 17041 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-2/wal
uuid: "3c2e2d924b46443cbed594ba32802b95"
format_stamp: "Formatted at 2026-08-09 19:09:46 on dist-test-slave-4tdj"
server_key: "1ea5786ad651ccbd8d1e9d93b5a44b9e"
server_key_iv: "e84af398f46a601b88c77b23e289c787"
server_key_version: "encryptionkey@0"
I20260809 19:09:46.878427 17041 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:46.895664 17041 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:46.899080 17041 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:46.899317 17041 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:46.900167 17041 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:09:46.901345 17041 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:46.901419 17041 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:46.901551 17041 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:46.901604 17041 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:46.930693 17041 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.3:34735
I20260809 19:09:46.930733 17235 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.3:34735 every 8 connection(s)
I20260809 19:09:46.931944 17041 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
I20260809 19:09:46.935775 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 17041
I20260809 19:09:46.935948 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance
I20260809 19:09:46.936388 7324 external_mini_cluster.cc:1428] Setting key 348f5240fc7be697a734b7b99f8e61b4
Aug 09 19:09:46 dist-test-slave-4tdj krb5kdc[16461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302586, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:09:46.950902 16821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:46.934424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:43649 (local address 127.7.39.62:35615)
0809 19:09:46.934624 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:46.934630 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:46.935769 (+ 1139us) server_negotiation.cc:407] Connection header received
0809 19:09:46.937846 (+ 2077us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:46.937851 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:46.937930 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:46.938025 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:46.939757 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:46.940527 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:46.942047 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:46.942492 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:46.942594 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:46.945800 (+ 3206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:46.945804 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:46.945808 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:46.945838 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:46.948101 (+ 2263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:46.948747 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:46.948752 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:46.948756 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:46.948869 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:46.949259 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:46.949264 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:46.949268 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:46.949538 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:46.949665 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:46.950358 (+ 693us) server_negotiation.cc:299] Negotiation successful
0809 19:09:46.950604 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 19:09:46.951874 17238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:46.934895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:35615 (local address 127.7.39.3:43649)
0809 19:09:46.935619 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:46.935657 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:46.937558 (+ 1901us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:46.938264 (+ 706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:46.938272 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:46.939017 (+ 745us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:46.939602 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:46.939620 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:46.940672 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:46.940678 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:46.941912 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:46.941923 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:46.942715 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:46.942722 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:46.942944 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:46.943540 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:46.943566 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:46.945609 (+ 2043us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:46.948223 (+ 2614us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:46.948232 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:46.948247 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:46.948638 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:46.948969 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:46.948974 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:46.948978 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:46.949156 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:46.949657 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:46.949664 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:46.949961 (+ 297us) client_negotiation.cc:769] Sending connection context
0809 19:09:46.950240 (+ 279us) client_negotiation.cc:240] Negotiation successful
0809 19:09:46.950694 (+ 454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":286,"threads_started":1}
I20260809 19:09:46.953038 17236 heartbeater.cc:347] Connected to a master server at 127.7.39.62:35615
I20260809 19:09:46.953301 17236 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:46.953980 17236 heartbeater.cc:511] Master 127.7.39.62:35615 requested a full tablet report, sending...
I20260809 19:09:46.955340 16528 ts_manager.cc:194] Registered new tserver with Master: 3c2e2d924b46443cbed594ba32802b95 (127.7.39.3:34735)
I20260809 19:09:46.956122 16528 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.3@KRBTEST.COM'} at 127.7.39.3:43649
I20260809 19:09:46.963413 7324 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/test-admin.keytab.
Aug 09 19:09:46 dist-test-slave-4tdj krb5kdc[16461](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302586, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:46.992882 7324 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260809 19:09:46.997717 17246 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:09:46.995417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39722 (local address 127.7.39.1:44171)
0809 19:09:46.996063 (+ 646us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:46.996072 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:46.996099 (+ 27us) server_negotiation.cc:407] Connection header received
0809 19:09:46.996153 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:46.996159 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:46.996349 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:46.996482 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:46.997327 (+ 845us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39722: BlockingRecv error: recv got EOF from 127.0.0.1:39722 (error 108)
Metrics: {"server-negotiator.queue_time_us":470,"thread_start_us":305,"threads_started":1}
W20260809 19:09:46.997766 7324 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/krb5cc' of type FILE
Aug 09 19:09:46 dist-test-slave-4tdj krb5kdc[16461](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302586, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:46.999189 7324 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 19:09:46 dist-test-slave-4tdj krb5kdc[16461](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302586, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:47.000433 7324 init.cc:295] Successfully reacquired a new kerberos TGT
I20260809 19:09:47.001892 16819 heartbeater.cc:503] Master 127.7.39.62:35615 was elected leader, sending a full tablet report...
Aug 09 19:09:47 dist-test-slave-4tdj krb5kdc[16461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302586, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.1@KRBTEST.COM
I20260809 19:09:47.014598 17246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:47.001844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39738 (local address 127.7.39.1:44171)
0809 19:09:47.002026 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:47.002032 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:47.002780 (+ 748us) server_negotiation.cc:407] Connection header received
0809 19:09:47.002834 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:47.002838 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:47.002898 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:47.002986 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:47.003994 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:47.004899 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:47.006022 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:47.006587 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:47.006679 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:47.009813 (+ 3134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:47.009823 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:47.009836 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:47.009870 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:47.012441 (+ 2571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:47.012992 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:47.012998 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:47.013000 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:47.013118 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:47.013374 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:47.013376 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:47.013378 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:47.013675 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:47.013863 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:47.014099 (+ 236us) server_negotiation.cc:299] Negotiation successful
0809 19:09:47.014328 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
W20260809 19:09:47.019366 17246 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:09:47.017949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39746 (local address 127.7.39.1:44171)
0809 19:09:47.018113 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:47.018119 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:47.018371 (+ 252us) server_negotiation.cc:407] Connection header received
0809 19:09:47.018475 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:47.018479 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:47.018543 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:47.018612 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:47.019158 (+ 546us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39746: BlockingRecv error: recv got EOF from 127.0.0.1:39746 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260809 19:09:47.022315 7324 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/krb5cc' of type FILE
Aug 09 19:09:47 dist-test-slave-4tdj krb5kdc[16461](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302587, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:47.023934 7324 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 19:09:47 dist-test-slave-4tdj krb5kdc[16461](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302587, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:47.025408 7324 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 19:09:47 dist-test-slave-4tdj krb5kdc[16461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302587, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.1@KRBTEST.COM
I20260809 19:09:47.038592 17246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:47.027347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39750 (local address 127.7.39.1:44171)
0809 19:09:47.027499 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:47.027504 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:47.027755 (+ 251us) server_negotiation.cc:407] Connection header received
0809 19:09:47.027894 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:47.027899 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:47.027951 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:47.028022 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:47.028879 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:47.029556 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:47.030764 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:47.031165 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:47.031267 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:47.034213 (+ 2946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:47.034217 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:47.034220 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:47.034247 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:47.036371 (+ 2124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:47.036921 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:47.036926 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:47.036930 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:47.037043 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:47.037368 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:47.037373 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:47.037377 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:47.037624 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:47.037837 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:47.038142 (+ 305us) server_negotiation.cc:299] Negotiation successful
0809 19:09:47.038370 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
W20260809 19:09:47.042205 17246 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:09:47.040782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39764 (local address 127.7.39.1:44171)
0809 19:09:47.040937 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:47.040942 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:47.041054 (+ 112us) server_negotiation.cc:407] Connection header received
0809 19:09:47.041202 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:47.041207 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:47.041273 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:47.041342 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:47.041998 (+ 656us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39764: BlockingRecv error: recv got EOF from 127.0.0.1:39764 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260809 19:09:47.042320 7324 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786302538618573-7324-0/krb5kdc/krb5cc' of type FILE
Aug 09 19:09:47 dist-test-slave-4tdj krb5kdc[16461](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302587, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:47.043583 7324 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 19:09:47 dist-test-slave-4tdj krb5kdc[16461](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302587, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:47.044687 7324 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 19:09:47 dist-test-slave-4tdj krb5kdc[16461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302587, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.1@KRBTEST.COM
I20260809 19:09:47.057413 17246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:47.045783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39778 (local address 127.7.39.1:44171)
0809 19:09:47.045942 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:47.045948 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:47.046189 (+ 241us) server_negotiation.cc:407] Connection header received
0809 19:09:47.046350 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:47.046355 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:47.046408 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:47.046480 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:47.047324 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:47.048043 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:47.049273 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:47.049715 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:47.049812 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:47.053074 (+ 3262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:47.053079 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:47.053082 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:47.053108 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:47.055217 (+ 2109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:47.055769 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:47.055773 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:47.055776 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:47.055910 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:47.056251 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:47.056255 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:47.056257 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:47.056482 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:47.056751 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:47.056970 (+ 219us) server_negotiation.cc:299] Negotiation successful
0809 19:09:47.057164 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 19:09:47.058617 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 16617
I20260809 19:09:47.068445 17246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:47.059198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39792 (local address 127.7.39.1:44171)
0809 19:09:47.059319 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:47.059323 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:47.059632 (+ 309us) server_negotiation.cc:407] Connection header received
0809 19:09:47.059765 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:47.059769 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:47.059848 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:47.059915 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:47.060691 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:47.061284 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:47.062351 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:47.062740 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:47.062829 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:47.064445 (+ 1616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:47.064449 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:47.064452 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:47.064477 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:47.066682 (+ 2205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:47.067181 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:47.067184 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:47.067186 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:47.067289 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:47.067543 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:47.067546 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:47.067548 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:47.067753 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:47.067920 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:47.068087 (+ 167us) server_negotiation.cc:299] Negotiation successful
0809 19:09:47.068218 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 19:09:47.068892 16809 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:47.149367 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 16617
I20260809 19:09:47.171962 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 16825
Aug 09 19:09:47 dist-test-slave-4tdj krb5kdc[16461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302587, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.2@KRBTEST.COM
I20260809 19:09:47.185845 17262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:47.172796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44892 (local address 127.7.39.2:39247)
0809 19:09:47.173353 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:47.173359 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:47.173385 (+ 26us) server_negotiation.cc:407] Connection header received
0809 19:09:47.173445 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:47.173451 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:47.173667 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:47.173795 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:47.174780 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:47.175796 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:47.176962 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:47.177489 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:47.177593 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:47.180955 (+ 3362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:47.180967 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:47.180981 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:47.181021 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:47.183580 (+ 2559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:47.184148 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:47.184155 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:47.184157 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:47.184273 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:47.184582 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:47.184585 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:47.184587 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:47.184890 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:47.185109 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:47.185342 (+ 233us) server_negotiation.cc:299] Negotiation successful
0809 19:09:47.185528 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":279,"threads_started":1}
I20260809 19:09:47.187101 17025 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:47.266108 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 16825
I20260809 19:09:47.288332 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 17041
Aug 09 19:09:47 dist-test-slave-4tdj krb5kdc[16461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302587, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.3@KRBTEST.COM
I20260809 19:09:47.302815 17266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:47.289345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48468 (local address 127.7.39.3:34735)
0809 19:09:47.289977 (+ 632us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:47.289984 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:47.290016 (+ 32us) server_negotiation.cc:407] Connection header received
0809 19:09:47.290081 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:47.290087 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:47.290286 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:47.290483 (+ 197us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:47.291382 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:47.292387 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:47.293557 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:47.294072 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:47.294161 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:47.297726 (+ 3565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:47.297736 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:47.297749 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:47.297781 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:47.300392 (+ 2611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:47.301116 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:47.301123 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:47.301125 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:47.301247 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:47.301554 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:47.301557 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:47.301559 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:47.301882 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:47.302108 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:47.302332 (+ 224us) server_negotiation.cc:299] Negotiation successful
0809 19:09:47.302524 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":485,"thread_start_us":322,"threads_started":1}
I20260809 19:09:47.304008 17231 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:47.384516 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 17041
I20260809 19:09:47.403411 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 16481
I20260809 19:09:47.404565 16578 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:47.505798 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 16481
2026-08-09T19:09:47Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (3903 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:09:47 dist-test-slave-4tdj krb5kdc[17274](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:09:47 dist-test-slave-4tdj krb5kdc[17274](info): set up 2 sockets
Aug 09 19:09:47 dist-test-slave-4tdj krb5kdc[17274](info): commencing operation
krb5kdc: starting...
W20260809 19:09:48.718005 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.165s user 0.000s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:09:48 dist-test-slave-4tdj krb5kdc[17274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302588, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:09:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:09:48Z Disabled control of system clock
WARNING: no policy specified for oryx/127.7.39.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.39.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.39.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.62.keytab.
Entry for principal oryx/127.7.39.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.62.keytab.
I20260809 19:09:48.920897 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:33935
--webserver_interface=127.7.39.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.62.keytab
--principal=oryx/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:42393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:33935
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:49.247822 17297 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:49.248103 17297 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:49.248245 17297 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:49.255573 17297 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:09:49.255683 17297 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:49.255762 17297 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:49.255848 17297 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:09:49.255910 17297 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:09:49.265528 17297 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:42393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:33935
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.62.keytab
--principal=oryx/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:33935
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:49.266876 17297 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:49.268187 17297 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:49.279469 17306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:49.279546 17305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:49.279523 17308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:49.280665 17297 server_base.cc:1034] running on GCE node
I20260809 19:09:49.281365 17297 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:49.282749 17297 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:49.283967 17297 hybrid_clock.cc:648] HybridClock initialized: now 1786302589283915 us; error 36 us; skew 500 ppm
I20260809 19:09:49.284287 17297 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:49 dist-test-slave-4tdj krb5kdc[17274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302589, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:49.287317 17297 init.cc:377] Logged in from keytab as oryx/127.7.39.62@KRBTEST.COM (short username oryx)
I20260809 19:09:49.288733 17297 webserver.cc:460] Webserver started at http://127.7.39.62:38377/ using document root <none> and password file <none>
I20260809 19:09:49.289355 17297 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:49.289479 17297 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:49.289759 17297 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:49.292636 17297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "1ea647a72fce400dad91d0cf80781fb0"
format_stamp: "Formatted at 2026-08-09 19:09:49 on dist-test-slave-4tdj"
server_key: "ab5f901189811a95ca61cf9228d12911"
server_key_iv: "64d07a0d39602e98a7147bbc9ff97738"
server_key_version: "encryptionkey@0"
I20260809 19:09:49.293347 17297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "1ea647a72fce400dad91d0cf80781fb0"
format_stamp: "Formatted at 2026-08-09 19:09:49 on dist-test-slave-4tdj"
server_key: "ab5f901189811a95ca61cf9228d12911"
server_key_iv: "64d07a0d39602e98a7147bbc9ff97738"
server_key_version: "encryptionkey@0"
I20260809 19:09:49.298151 17297 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.005s
I20260809 19:09:49.301422 17319 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:49.302762 17297 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:09:49.302932 17297 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "1ea647a72fce400dad91d0cf80781fb0"
format_stamp: "Formatted at 2026-08-09 19:09:49 on dist-test-slave-4tdj"
server_key: "ab5f901189811a95ca61cf9228d12911"
server_key_iv: "64d07a0d39602e98a7147bbc9ff97738"
server_key_version: "encryptionkey@0"
I20260809 19:09:49.303105 17297 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:49.315807 17297 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:49.319658 17297 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:49.319903 17297 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:49.336581 17297 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:33935
I20260809 19:09:49.336599 17406 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:33935 every 8 connection(s)
I20260809 19:09:49.337836 17297 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:09:49.341250 17407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:49.348078 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 17297
I20260809 19:09:49.348280 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:09:49.349066 7324 external_mini_cluster.cc:1428] Setting key 8175ba3ba3ab30bfe04be5b802fb033b
I20260809 19:09:49.351915 17407 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0: Bootstrap starting.
I20260809 19:09:49.355049 17407 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:49.355985 17407 log.cc:824] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:49.358596 17407 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0: No bootstrap required, opened a new log
Aug 09 19:09:49 dist-test-slave-4tdj krb5kdc[17274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302588, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM
I20260809 19:09:49.365741 17407 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } }
I20260809 19:09:49.366065 17407 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:49.366204 17407 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ea647a72fce400dad91d0cf80781fb0, State: Initialized, Role: FOLLOWER
I20260809 19:09:49.366786 17407 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } }
I20260809 19:09:49.367008 17407 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:09:49.367153 17407 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:09:49.367314 17407 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:49.369549 17407 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } }
I20260809 19:09:49.369892 17411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:49.351083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34166 (local address 127.7.39.62:33935)
0809 19:09:49.351787 (+ 704us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:49.351799 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:49.351839 (+ 40us) server_negotiation.cc:407] Connection header received
0809 19:09:49.353687 (+ 1848us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:49.353710 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:49.354077 (+ 367us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:49.354449 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:49.355891 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:49.357239 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:49.358461 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:49.359155 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:49.359323 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:49.363107 (+ 3784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:49.363115 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:49.363128 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:49.363170 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:49.366011 (+ 2841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:49.366715 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:49.366722 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:49.366728 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:49.366896 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:49.367293 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:49.367297 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:49.367299 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:49.367849 (+ 550us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:49.368169 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:49.368577 (+ 408us) server_negotiation.cc:299] Negotiation successful
0809 19:09:49.368957 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512,"thread_start_us":328,"threads_started":1}
I20260809 19:09:49.370013 17407 leader_election.cc:302] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1ea647a72fce400dad91d0cf80781fb0; no voters:
I20260809 19:09:49.370754 17407 leader_election.cc:288] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:09:49.370838 17413 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:09:49.372004 17413 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [term 1 LEADER]: Becoming Leader. State: Replica: 1ea647a72fce400dad91d0cf80781fb0, State: Running, Role: LEADER
I20260809 19:09:49.372534 17413 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } }
I20260809 19:09:49.372902 17407 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:09:49.375175 17416 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1ea647a72fce400dad91d0cf80781fb0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } }
I20260809 19:09:49.375564 17416 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:49.375576 17417 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ea647a72fce400dad91d0cf80781fb0. Latest consensus state: current_term: 1 leader_uuid: "1ea647a72fce400dad91d0cf80781fb0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } }
I20260809 19:09:49.375885 17417 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:49.376551 17425 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:09:49.382545 17425 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:09:49.390792 17425 catalog_manager.cc:1347] Generated new cluster ID: 16c59a70236c44159b71e16fd90c7b65
I20260809 19:09:49.390894 17425 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:09:49.418191 17425 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:09:49.419479 17425 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:09:49.425631 17425 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0: Generated new TSK 0
I20260809 19:09:49.426347 17425 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.7.39.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.39.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.39.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.1.keytab.
Entry for principal oryx/127.7.39.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.1.keytab.
I20260809 19:09:49.481773 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.1:0
--local_ip_for_outbound_sockets=127.7.39.1
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:33935
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.1.keytab
--principal=oryx/127.7.39.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:42393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:49.819478 17442 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:49.819787 17442 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:49.819878 17442 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:49.826849 17442 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:49.826949 17442 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:49.827064 17442 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.1
I20260809 19:09:49.836337 17442 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:42393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.1.keytab
--principal=oryx/127.7.39.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:33935
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.1
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:49.837502 17442 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:49.838762 17442 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:49.850842 17455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:49.850804 17461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:49.850870 17458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:49.851753 17442 server_base.cc:1034] running on GCE node
I20260809 19:09:49.852329 17442 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:49.853195 17442 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:49.854373 17442 hybrid_clock.cc:648] HybridClock initialized: now 1786302589854319 us; error 45 us; skew 500 ppm
I20260809 19:09:49.854651 17442 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:49 dist-test-slave-4tdj krb5kdc[17274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302589, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:49.857542 17442 init.cc:377] Logged in from keytab as oryx/127.7.39.1@KRBTEST.COM (short username oryx)
I20260809 19:09:49.858839 17442 webserver.cc:460] Webserver started at http://127.7.39.1:46617/ using document root <none> and password file <none>
I20260809 19:09:49.859460 17442 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:49.859576 17442 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:49.859841 17442 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:49.862601 17442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-0/data/instance:
uuid: "dcf1a29c27c44bbfabe9397a91a80197"
format_stamp: "Formatted at 2026-08-09 19:09:49 on dist-test-slave-4tdj"
server_key: "83a22264bc5a45b70709fcf5a421e858"
server_key_iv: "f14e2d520309793b3773f6cc8d7df800"
server_key_version: "encryptionkey@0"
I20260809 19:09:49.863303 17442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance:
uuid: "dcf1a29c27c44bbfabe9397a91a80197"
format_stamp: "Formatted at 2026-08-09 19:09:49 on dist-test-slave-4tdj"
server_key: "83a22264bc5a45b70709fcf5a421e858"
server_key_iv: "f14e2d520309793b3773f6cc8d7df800"
server_key_version: "encryptionkey@0"
I20260809 19:09:49.868057 17442 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 19:09:49.871241 17475 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:49.872555 17442 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:09:49.872710 17442 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-0/wal
uuid: "dcf1a29c27c44bbfabe9397a91a80197"
format_stamp: "Formatted at 2026-08-09 19:09:49 on dist-test-slave-4tdj"
server_key: "83a22264bc5a45b70709fcf5a421e858"
server_key_iv: "f14e2d520309793b3773f6cc8d7df800"
server_key_version: "encryptionkey@0"
I20260809 19:09:49.872882 17442 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:49.885198 17442 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:49.888916 17442 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:49.889204 17442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:49.890084 17442 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:09:49.891408 17442 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:49.891496 17442 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:49.891623 17442 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:49.891690 17442 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:49.922838 17442 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.1:33499
I20260809 19:09:49.922885 17665 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.1:33499 every 8 connection(s)
I20260809 19:09:49.924072 17442 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
I20260809 19:09:49.933447 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 17442
I20260809 19:09:49.933634 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance
I20260809 19:09:49.934235 7324 external_mini_cluster.cc:1428] Setting key a988084e96706f9d2d23d6df8e0bc272
Aug 09 19:09:49 dist-test-slave-4tdj krb5kdc[17274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302589, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM
I20260809 19:09:49.943325 17668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:49.926646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:50077 (local address 127.7.39.62:33935)
0809 19:09:49.927047 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:49.927052 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:49.928049 (+ 997us) server_negotiation.cc:407] Connection header received
0809 19:09:49.929754 (+ 1705us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:49.929758 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:49.929830 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:49.929925 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:49.931404 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:49.932116 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:49.933577 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:49.934014 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:49.934131 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:49.938092 (+ 3961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:49.938097 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:49.938101 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:49.938132 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:49.940425 (+ 2293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:49.941208 (+ 783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:49.941211 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:49.941213 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:49.941327 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:49.941749 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:49.941752 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:49.941754 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:49.942020 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:49.942129 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:49.942899 (+ 770us) server_negotiation.cc:299] Negotiation successful
0809 19:09:49.943068 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":190,"threads_started":1}
I20260809 19:09:49.944518 17671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:49.927182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.7.39.1:50077)
0809 19:09:49.927895 (+ 713us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:49.927932 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:49.929514 (+ 1582us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:49.930141 (+ 627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:49.930149 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:49.930706 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:49.931256 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:49.931272 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:49.932227 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:49.932230 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:49.933414 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:49.933425 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:49.934234 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:49.934241 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:49.934488 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:49.935126 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:49.935147 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:49.937888 (+ 2741us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:49.940557 (+ 2669us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:49.940565 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:49.940579 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:49.941114 (+ 535us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:49.941416 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:49.941420 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:49.941422 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:49.941650 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:49.942133 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:49.942141 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:49.942521 (+ 380us) client_negotiation.cc:769] Sending connection context
0809 19:09:49.942797 (+ 276us) client_negotiation.cc:240] Negotiation successful
0809 19:09:49.943267 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":301,"threads_started":1}
I20260809 19:09:49.945960 17666 heartbeater.cc:347] Connected to a master server at 127.7.39.62:33935
I20260809 19:09:49.946237 17666 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:49.946938 17666 heartbeater.cc:511] Master 127.7.39.62:33935 requested a full tablet report, sending...
I20260809 19:09:49.949157 17345 ts_manager.cc:194] Registered new tserver with Master: dcf1a29c27c44bbfabe9397a91a80197 (127.7.39.1:33499)
I20260809 19:09:49.951100 17345 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.39.1@KRBTEST.COM'} at 127.7.39.1:50077
WARNING: no policy specified for oryx/127.7.39.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.39.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.39.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.2.keytab.
Entry for principal oryx/127.7.39.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.2.keytab.
I20260809 19:09:49.983011 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.2:0
--local_ip_for_outbound_sockets=127.7.39.2
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:33935
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.2.keytab
--principal=oryx/127.7.39.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:42393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:50.294622 17677 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:50.294869 17677 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:50.294966 17677 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:50.301748 17677 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:50.301836 17677 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:50.301946 17677 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.2
I20260809 19:09:50.311192 17677 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:42393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.2.keytab
--principal=oryx/127.7.39.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:33935
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.2
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:50.312322 17677 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:50.313535 17677 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:50.325690 17685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:50.325734 17687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:50.325824 17691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:50.326721 17677 server_base.cc:1034] running on GCE node
I20260809 19:09:50.327288 17677 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:50.328133 17677 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:50.329332 17677 hybrid_clock.cc:648] HybridClock initialized: now 1786302590329281 us; error 45 us; skew 500 ppm
I20260809 19:09:50.329671 17677 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:50 dist-test-slave-4tdj krb5kdc[17274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302590, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:50.332686 17677 init.cc:377] Logged in from keytab as oryx/127.7.39.2@KRBTEST.COM (short username oryx)
I20260809 19:09:50.334024 17677 webserver.cc:460] Webserver started at http://127.7.39.2:37123/ using document root <none> and password file <none>
I20260809 19:09:50.334714 17677 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:50.334818 17677 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:50.335086 17677 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:50.337845 17677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-1/data/instance:
uuid: "30d1a3f78bbc4e4594806e0bbd55e46a"
format_stamp: "Formatted at 2026-08-09 19:09:50 on dist-test-slave-4tdj"
server_key: "5f3676797104d67614bb0544b5a0ac8a"
server_key_iv: "ceae07f347ad606daa747af0e658b3ec"
server_key_version: "encryptionkey@0"
I20260809 19:09:50.338605 17677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance:
uuid: "30d1a3f78bbc4e4594806e0bbd55e46a"
format_stamp: "Formatted at 2026-08-09 19:09:50 on dist-test-slave-4tdj"
server_key: "5f3676797104d67614bb0544b5a0ac8a"
server_key_iv: "ceae07f347ad606daa747af0e658b3ec"
server_key_version: "encryptionkey@0"
I20260809 19:09:50.343483 17677 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 19:09:50.346792 17702 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:50.348125 17677 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260809 19:09:50.348271 17677 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-1/wal
uuid: "30d1a3f78bbc4e4594806e0bbd55e46a"
format_stamp: "Formatted at 2026-08-09 19:09:50 on dist-test-slave-4tdj"
server_key: "5f3676797104d67614bb0544b5a0ac8a"
server_key_iv: "ceae07f347ad606daa747af0e658b3ec"
server_key_version: "encryptionkey@0"
I20260809 19:09:50.348436 17677 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:50.367936 17677 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:50.371542 17677 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:50.371796 17677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:50.372678 17677 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:09:50.374001 17677 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:50.374074 17677 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:50.374176 17677 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:50.374229 17677 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:50.404102 17677 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.2:46223
I20260809 19:09:50.404165 17884 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.2:46223 every 8 connection(s)
I20260809 19:09:50.405314 17677 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
I20260809 19:09:50.410966 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 17677
I20260809 19:09:50.411141 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance
I20260809 19:09:50.411705 7324 external_mini_cluster.cc:1428] Setting key 751c5c535b2efc5c3e912f6e9f8a86a0
Aug 09 19:09:50 dist-test-slave-4tdj krb5kdc[17274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302590, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM
I20260809 19:09:50.424553 17668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:50.407788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:48943 (local address 127.7.39.62:33935)
0809 19:09:50.407967 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:50.407972 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:50.409078 (+ 1106us) server_negotiation.cc:407] Connection header received
0809 19:09:50.410869 (+ 1791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:50.410874 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:50.410942 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:50.411028 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:50.412897 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:50.413714 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:50.415233 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:50.415639 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:50.415751 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:50.419335 (+ 3584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:50.419340 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:50.419343 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:50.419375 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:50.421791 (+ 2416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:50.422477 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:50.422481 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:50.422483 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:50.422615 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:50.423003 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:50.423006 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:50.423008 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:50.423247 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:50.423387 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:50.423997 (+ 610us) server_negotiation.cc:299] Negotiation successful
0809 19:09:50.424213 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 19:09:50.425396 17890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:50.408229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.7.39.2:48943)
0809 19:09:50.408918 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:50.408961 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:50.410567 (+ 1606us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:50.411304 (+ 737us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:50.411315 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:50.412007 (+ 692us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:50.412717 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:50.412742 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:50.413860 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:50.413865 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:50.415100 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:50.415112 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:50.415847 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:50.415854 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:50.416070 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:50.416757 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:50.416790 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:50.419139 (+ 2349us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:50.421916 (+ 2777us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:50.421925 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:50.421940 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:50.422362 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:50.422715 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:50.422720 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:50.422724 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:50.422895 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:50.423366 (+ 471us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:50.423373 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:50.423671 (+ 298us) client_negotiation.cc:769] Sending connection context
0809 19:09:50.423885 (+ 214us) client_negotiation.cc:240] Negotiation successful
0809 19:09:50.424353 (+ 468us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":265,"threads_started":1}
I20260809 19:09:50.426681 17888 heartbeater.cc:347] Connected to a master server at 127.7.39.62:33935
I20260809 19:09:50.426935 17888 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:50.427594 17888 heartbeater.cc:511] Master 127.7.39.62:33935 requested a full tablet report, sending...
I20260809 19:09:50.428880 17345 ts_manager.cc:194] Registered new tserver with Master: 30d1a3f78bbc4e4594806e0bbd55e46a (127.7.39.2:46223)
I20260809 19:09:50.429620 17345 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.39.2@KRBTEST.COM'} at 127.7.39.2:48943
WARNING: no policy specified for oryx/127.7.39.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.39.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.39.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.3.keytab.
Entry for principal oryx/127.7.39.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.3.keytab.
I20260809 19:09:50.454643 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.3:0
--local_ip_for_outbound_sockets=127.7.39.3
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:33935
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.3.keytab
--principal=oryx/127.7.39.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:42393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:50.777544 17893 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:50.777807 17893 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:50.777932 17893 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:50.784929 17893 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:50.785022 17893 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:50.785133 17893 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.3
I20260809 19:09:50.794237 17893 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:42393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.3.keytab
--principal=oryx/127.7.39.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:33935
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.3
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:50.795387 17893 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:50.796595 17893 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:50.808736 17900 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:50.808866 17902 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:50.809257 17905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:50.809917 17893 server_base.cc:1034] running on GCE node
I20260809 19:09:50.810572 17893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:50.811450 17893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:50.812640 17893 hybrid_clock.cc:648] HybridClock initialized: now 1786302590812589 us; error 41 us; skew 500 ppm
I20260809 19:09:50.812924 17893 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:50 dist-test-slave-4tdj krb5kdc[17274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302590, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:50.815871 17893 init.cc:377] Logged in from keytab as oryx/127.7.39.3@KRBTEST.COM (short username oryx)
I20260809 19:09:50.817188 17893 webserver.cc:460] Webserver started at http://127.7.39.3:40111/ using document root <none> and password file <none>
I20260809 19:09:50.817831 17893 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:50.817937 17893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:50.818220 17893 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:50.821215 17893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-2/data/instance:
uuid: "fd4789b5fa2f4f5682434dedf03355a9"
format_stamp: "Formatted at 2026-08-09 19:09:50 on dist-test-slave-4tdj"
server_key: "31248fcaaadaa2f55462730ce3d7d5e7"
server_key_iv: "5d34938d06269c7b01c61cb0fed443e4"
server_key_version: "encryptionkey@0"
I20260809 19:09:50.821939 17893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance:
uuid: "fd4789b5fa2f4f5682434dedf03355a9"
format_stamp: "Formatted at 2026-08-09 19:09:50 on dist-test-slave-4tdj"
server_key: "31248fcaaadaa2f55462730ce3d7d5e7"
server_key_iv: "5d34938d06269c7b01c61cb0fed443e4"
server_key_version: "encryptionkey@0"
I20260809 19:09:50.826867 17893 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260809 19:09:50.830037 17916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:50.831284 17893 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260809 19:09:50.831429 17893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-2/wal
uuid: "fd4789b5fa2f4f5682434dedf03355a9"
format_stamp: "Formatted at 2026-08-09 19:09:50 on dist-test-slave-4tdj"
server_key: "31248fcaaadaa2f55462730ce3d7d5e7"
server_key_iv: "5d34938d06269c7b01c61cb0fed443e4"
server_key_version: "encryptionkey@0"
I20260809 19:09:50.831595 17893 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:50.846246 17893 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:50.849776 17893 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:50.850016 17893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:50.850929 17893 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:09:50.852218 17893 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:50.852298 17893 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:50.852413 17893 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:50.852466 17893 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:50.882223 17893 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.3:37589
I20260809 19:09:50.882257 18106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.3:37589 every 8 connection(s)
I20260809 19:09:50.883576 17893 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
I20260809 19:09:50.892025 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 17893
I20260809 19:09:50.892185 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance
I20260809 19:09:50.892614 7324 external_mini_cluster.cc:1428] Setting key 1b0ea5e080f088df7e485926c9fdffcd
Aug 09 19:09:50 dist-test-slave-4tdj krb5kdc[17274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302590, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM
I20260809 19:09:50.902648 17668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:50.886021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:42625 (local address 127.7.39.62:33935)
0809 19:09:50.886226 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:50.886233 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:50.887416 (+ 1183us) server_negotiation.cc:407] Connection header received
0809 19:09:50.889229 (+ 1813us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:50.889234 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:50.889301 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:50.889388 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:50.890949 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:50.891768 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:50.893484 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:50.894027 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:50.894158 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:50.897573 (+ 3415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:50.897578 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:50.897581 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:50.897613 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:50.900026 (+ 2413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:50.900684 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:50.900688 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:50.900690 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:50.900804 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:50.901196 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:50.901200 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:50.901202 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:50.901478 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:50.901609 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:50.902184 (+ 575us) server_negotiation.cc:299] Negotiation successful
0809 19:09:50.902392 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 19:09:50.903537 18112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:50.886492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.7.39.3:42625)
0809 19:09:50.887243 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:50.887295 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:50.888970 (+ 1675us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:50.889603 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:50.889611 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:50.890119 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:50.890792 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:50.890813 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:50.891931 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:50.891935 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:50.893336 (+ 1401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:50.893351 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:50.894233 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:50.894238 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:50.894576 (+ 338us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:50.895222 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:50.895245 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:50.897384 (+ 2139us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:50.900155 (+ 2771us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:50.900161 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:50.900173 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:50.900588 (+ 415us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:50.900880 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:50.900883 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:50.900886 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:50.901075 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:50.901608 (+ 533us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:50.901614 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:50.901894 (+ 280us) client_negotiation.cc:769] Sending connection context
0809 19:09:50.902106 (+ 212us) client_negotiation.cc:240] Negotiation successful
0809 19:09:50.902492 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":281,"threads_started":1}
I20260809 19:09:50.904779 18108 heartbeater.cc:347] Connected to a master server at 127.7.39.62:33935
I20260809 19:09:50.905021 18108 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:50.905669 18108 heartbeater.cc:511] Master 127.7.39.62:33935 requested a full tablet report, sending...
I20260809 19:09:50.907107 17345 ts_manager.cc:194] Registered new tserver with Master: fd4789b5fa2f4f5682434dedf03355a9 (127.7.39.3:37589)
I20260809 19:09:50.908012 7324 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 19:09:50.908082 17345 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.39.3@KRBTEST.COM'} at 127.7.39.3:42625
WARNING: no policy specified for oryx/127.7.39.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.39.61@KRBTEST.COM" created.
I20260809 19:09:50.954006 17666 heartbeater.cc:503] Master 127.7.39.62:33935 was elected leader, sending a full tablet report...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.39.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.61.keytab.
Entry for principal oryx/127.7.39.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.61.keytab.
I20260809 19:09:50.956260 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.61:46355
--webserver_interface=127.7.39.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.61.keytab
--principal=oryx/127.7.39.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:42393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:33935,127.7.39.61:46355
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:51.271371 18118 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:51.271647 18118 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:51.271773 18118 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:51.278841 18118 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:09:51.278944 18118 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:51.279013 18118 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:51.279088 18118 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:09:51.279145 18118 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:09:51.288331 18118 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:42393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:33935,127.7.39.61:46355
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.61.keytab
--principal=oryx/127.7.39.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.61:46355
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.7.39.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
W20260809 19:09:51.288647 18118 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.7.39.62:33935,127.7.39.61:46355'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260809 19:09:51.289588 18118 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:51.290864 18118 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:51.301561 18126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:51.301647 18127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:51.301623 18130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:51.302416 18118 server_base.cc:1034] running on GCE node
I20260809 19:09:51.303079 18118 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:51.304283 18118 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:51.305486 18118 hybrid_clock.cc:648] HybridClock initialized: now 1786302591305429 us; error 36 us; skew 500 ppm
I20260809 19:09:51.305809 18118 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:51 dist-test-slave-4tdj krb5kdc[17274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302591, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:51.308833 18118 init.cc:377] Logged in from keytab as oryx/127.7.39.61@KRBTEST.COM (short username oryx)
I20260809 19:09:51.310163 18118 webserver.cc:460] Webserver started at http://127.7.39.61:39945/ using document root <none> and password file <none>
I20260809 19:09:51.310822 18118 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:51.310913 18118 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:51.311203 18118 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:51.313972 18118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-1/data/instance:
uuid: "dc6e5da415ab45d98a660ab46d312620"
format_stamp: "Formatted at 2026-08-09 19:09:51 on dist-test-slave-4tdj"
server_key: "66b2f92f54a7d082021d75ba02c3777b"
server_key_iv: "700db6ba76a57f08634823e550e1dd7a"
server_key_version: "encryptionkey@0"
I20260809 19:09:51.314733 18118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-1/wal/instance:
uuid: "dc6e5da415ab45d98a660ab46d312620"
format_stamp: "Formatted at 2026-08-09 19:09:51 on dist-test-slave-4tdj"
server_key: "66b2f92f54a7d082021d75ba02c3777b"
server_key_iv: "700db6ba76a57f08634823e550e1dd7a"
server_key_version: "encryptionkey@0"
I20260809 19:09:51.319324 18118 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 19:09:51.322502 18140 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:51.323736 18118 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 19:09:51.323887 18118 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-1/wal
uuid: "dc6e5da415ab45d98a660ab46d312620"
format_stamp: "Formatted at 2026-08-09 19:09:51 on dist-test-slave-4tdj"
server_key: "66b2f92f54a7d082021d75ba02c3777b"
server_key_iv: "700db6ba76a57f08634823e550e1dd7a"
server_key_version: "encryptionkey@0"
I20260809 19:09:51.324059 18118 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:51.338008 18118 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:51.341781 18118 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:51.341996 18118 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:51.358448 18118 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.61:46355
I20260809 19:09:51.358469 18225 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.61:46355 every 8 connection(s)
I20260809 19:09:51.359649 18118 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-1/data/info.pb
I20260809 19:09:51.362994 18226 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:51.364711 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 18118
I20260809 19:09:51.372136 18226 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 19:09:51 dist-test-slave-4tdj krb5kdc[17274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302588, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.39.61@KRBTEST.COM
Aug 09 19:09:51 dist-test-slave-4tdj krb5kdc[17274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302591, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.61@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM
I20260809 19:09:51.387730 18230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:51.366873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51530 (local address 127.7.39.61:46355)
0809 19:09:51.367642 (+ 769us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:51.367656 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:51.367704 (+ 48us) server_negotiation.cc:407] Connection header received
0809 19:09:51.369299 (+ 1595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:51.369330 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:51.369783 (+ 453us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:51.370206 (+ 423us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:51.371575 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:51.373584 (+ 2009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:51.375164 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:51.376126 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:51.376275 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:51.380684 (+ 4409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:51.380691 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:51.380702 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:51.380744 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:51.383739 (+ 2995us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:51.384359 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:51.384367 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:51.384375 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:51.384553 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:51.384916 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:51.384920 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:51.384924 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:51.385582 (+ 658us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:51.385849 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:51.386220 (+ 371us) server_negotiation.cc:299] Negotiation successful
0809 19:09:51.386610 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":531,"thread_start_us":319,"threads_started":1}
I20260809 19:09:51.389648 17668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:51.374894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34182 (local address 127.7.39.62:33935)
0809 19:09:51.375035 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:51.375046 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:51.375887 (+ 841us) server_negotiation.cc:407] Connection header received
0809 19:09:51.376041 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:51.376045 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:51.376108 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:51.376188 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:51.377477 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:51.378286 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:51.379862 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:51.380259 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:51.380350 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:51.383912 (+ 3562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:51.383917 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:51.383920 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:51.383952 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:51.387058 (+ 3106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:51.387693 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:51.387698 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:51.387701 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:51.387855 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:51.388264 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:51.388269 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:51.388272 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:51.388578 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:51.388708 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:51.389146 (+ 438us) server_negotiation.cc:299] Negotiation successful
0809 19:09:51.389334 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 19:09:51.389732 18231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:51.374958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.0.0.1:34182)
0809 19:09:51.375752 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:51.375792 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:51.375932 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:51.376266 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:51.376273 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:51.376977 (+ 704us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:51.377310 (+ 333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:51.377324 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:51.378436 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:51.378442 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:51.379732 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:51.379746 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:51.380465 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:51.380473 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:51.380667 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:51.381271 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:51.381295 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:51.383738 (+ 2443us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:51.387179 (+ 3441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:51.387187 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:51.387191 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:51.387582 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:51.387996 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:51.388000 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:51.388004 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:51.388158 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:51.388701 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:51.388707 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:51.388863 (+ 156us) client_negotiation.cc:769] Sending connection context
0809 19:09:51.389035 (+ 172us) client_negotiation.cc:240] Negotiation successful
0809 19:09:51.389321 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":375,"threads_started":1}
I20260809 19:09:51.391343 18226 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 19:09:51 dist-test-slave-4tdj krb5kdc[17274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302591, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.61@KRBTEST.COM for oryx/127.7.39.61@KRBTEST.COM
I20260809 19:09:51.401664 18231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:51.391884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:46355 (local address 127.0.0.1:51542)
0809 19:09:51.392047 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:51.392061 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:51.392139 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:51.392344 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:51.392347 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:51.392632 (+ 285us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:51.392746 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:51.392753 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:51.393570 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:51.393573 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:51.394436 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:51.394447 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:51.395034 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:51.395045 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:51.395158 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:51.395539 (+ 381us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:51.395555 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:51.397282 (+ 1727us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:51.399683 (+ 2401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:51.399688 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:51.399692 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:51.400009 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:51.400300 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:51.400305 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:51.400309 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:51.400419 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:51.400861 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:51.400865 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:51.400994 (+ 129us) client_negotiation.cc:769] Sending connection context
0809 19:09:51.401102 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 19:09:51.401343 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260809 19:09:51.401793 18230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:51.391905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51542 (local address 127.7.39.61:46355)
0809 19:09:51.392060 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:51.392065 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:51.392102 (+ 37us) server_negotiation.cc:407] Connection header received
0809 19:09:51.392209 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:51.392212 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:51.392258 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:51.392325 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:51.392848 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:51.393476 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:51.394545 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:51.394920 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:51.395003 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:51.397437 (+ 2434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:51.397441 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:51.397444 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:51.397469 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:51.399576 (+ 2107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:51.400108 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:51.400113 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:51.400115 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:51.400210 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:51.400510 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:51.400514 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:51.400517 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:51.400760 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:51.400874 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:51.401188 (+ 314us) server_negotiation.cc:299] Negotiation successful
0809 19:09:51.401476 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":110,"server-negotiator.queue_time_us":46}
I20260809 19:09:51.406041 18226 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620: Bootstrap starting.
I20260809 19:09:51.409085 18226 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:51.410010 18226 log.cc:824] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:51.412319 18226 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620: No bootstrap required, opened a new log
I20260809 19:09:51.418877 18226 raft_consensus.cc:348] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } }
I20260809 19:09:51.419181 18226 raft_consensus.cc:374] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:51.419265 18226 raft_consensus.cc:729] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc6e5da415ab45d98a660ab46d312620, State: Initialized, Role: FOLLOWER
I20260809 19:09:51.419764 18226 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } }
I20260809 19:09:51.420493 18233 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } } }
I20260809 19:09:51.420770 18233 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:09:51.421342 18226 sys_catalog.cc:564] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 19:09:51.429517 18248 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 19:09:51.429632 18248 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 19:09:51.431859 17888 heartbeater.cc:503] Master 127.7.39.62:33935 was elected leader, sending a full tablet report...
I20260809 19:09:51.433205 18118 master_runner.cc:428] Detected that this master dc6e5da415ab45d98a660ab46d312620 is joining an existing cluster
I20260809 19:09:51.433305 18118 master_runner.cc:432] Initiating AddMaster RPC to add 127.7.39.61:46355
I20260809 19:09:51.455404 18258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:51.436994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:46355 (local address 127.0.0.1:51558)
0809 19:09:51.437782 (+ 788us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:51.437807 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:51.437948 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:51.438468 (+ 520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:51.438473 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:51.439174 (+ 701us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:51.439591 (+ 417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:51.439605 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:51.441058 (+ 1453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:51.441063 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:51.442600 (+ 1537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:51.442610 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:51.443746 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:51.443752 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:51.443979 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:51.447496 (+ 3517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:51.447520 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:51.448680 (+ 1160us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:51.452593 (+ 3913us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:51.452598 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:51.452602 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:51.453086 (+ 484us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:51.453501 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:51.453505 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:51.453508 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:51.453663 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:51.454346 (+ 683us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:51.454352 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:51.454502 (+ 150us) client_negotiation.cc:769] Sending connection context
0809 19:09:51.454643 (+ 141us) client_negotiation.cc:240] Negotiation successful
0809 19:09:51.454919 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":636,"mutex_wait_us":53,"thread_start_us":477,"threads_started":1}
I20260809 19:09:51.455430 18230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:51.436888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51558 (local address 127.7.39.61:46355)
0809 19:09:51.437070 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:51.437076 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:51.437898 (+ 822us) server_negotiation.cc:407] Connection header received
0809 19:09:51.438088 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:51.438093 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:51.438170 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:51.438275 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:51.439759 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:51.440877 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:51.442718 (+ 1841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:51.443397 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:51.443479 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:51.448845 (+ 5366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:51.448851 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:51.448859 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:51.448899 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:51.452455 (+ 3556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:51.453206 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:51.453211 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:51.453214 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:51.453368 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:51.453802 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:51.453808 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:51.453811 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:51.454192 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:51.454388 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:51.454773 (+ 385us) server_negotiation.cc:299] Negotiation successful
0809 19:09:51.455089 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":82,"server-negotiator.queue_time_us":55}
I20260809 19:09:51.455987 17668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:51.436750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34190 (local address 127.7.39.62:33935)
0809 19:09:51.436920 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:51.436927 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:51.438567 (+ 1640us) server_negotiation.cc:407] Connection header received
0809 19:09:51.438719 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:51.438725 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:51.438787 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:51.438864 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:51.439895 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:51.440611 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:51.442721 (+ 2110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:51.443342 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:51.443438 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:51.449292 (+ 5854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:51.449298 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:51.449303 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:51.449339 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:51.453136 (+ 3797us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:51.453842 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:51.453847 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:51.453850 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:51.453970 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:51.454373 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:51.454378 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:51.454381 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:51.454746 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:51.454866 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:51.455437 (+ 571us) server_negotiation.cc:299] Negotiation successful
0809 19:09:51.455668 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 19:09:51.456763 18259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:51.437222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.0.0.1:34190)
0809 19:09:51.438477 (+ 1255us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:51.438490 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:51.438612 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:51.438909 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:51.438913 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:51.439494 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:51.439764 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:51.439773 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:51.440791 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:51.440796 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:51.442558 (+ 1762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:51.442578 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:51.443715 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:51.443725 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:51.443926 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:51.447589 (+ 3663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:51.447612 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:51.449088 (+ 1476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:51.453278 (+ 4190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:51.453283 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:51.453286 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:51.453748 (+ 462us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:51.454075 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:51.454079 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:51.454083 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:51.454225 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:51.454938 (+ 713us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:51.454942 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:51.455125 (+ 183us) client_negotiation.cc:769] Sending connection context
0809 19:09:51.456212 (+ 1087us) client_negotiation.cc:240] Negotiation successful
0809 19:09:51.456468 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1158,"mutex_wait_us":53,"spinlock_wait_cycles":25344,"thread_start_us":955,"threads_started":1}
WARNING: no policy specified for oryx/127.7.39.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.39.60@KRBTEST.COM" created.
Aug 09 19:09:51 dist-test-slave-4tdj krb5kdc[17274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302589, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.62@KRBTEST.COM for oryx/127.7.39.61@KRBTEST.COM
I20260809 19:09:51.479264 18230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:51.461958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51574 (local address 127.7.39.61:46355)
0809 19:09:51.462119 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:51.462125 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:51.462894 (+ 769us) server_negotiation.cc:407] Connection header received
0809 19:09:51.463219 (+ 325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:51.463225 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:51.463312 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:51.463400 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:51.464524 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:51.465186 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:51.466425 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:51.466900 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:51.467013 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:51.472267 (+ 5254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:51.472274 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:51.472279 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:51.472315 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:51.475833 (+ 3518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:51.476738 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:51.476743 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:51.476747 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:51.476918 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:51.477365 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:51.477374 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:51.477378 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:51.477732 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:51.477874 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:51.478699 (+ 825us) server_negotiation.cc:299] Negotiation successful
0809 19:09:51.478909 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 19:09:51.479319 18265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:51.461953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:46355 (local address 127.0.0.1:51574)
0809 19:09:51.462776 (+ 823us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:51.462811 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:51.463016 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:51.463631 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:51.463636 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:51.464196 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:51.464381 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:51.464389 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:51.465318 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:51.465323 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:51.466282 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:51.466321 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:51.467052 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:51.467058 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:51.467249 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:51.467780 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:51.467801 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:51.472080 (+ 4279us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:51.475966 (+ 3886us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:51.475979 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:51.475987 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:51.476552 (+ 565us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:51.477025 (+ 473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:51.477029 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:51.477032 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:51.477238 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:51.477955 (+ 717us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:51.477964 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:51.478178 (+ 214us) client_negotiation.cc:769] Sending connection context
0809 19:09:51.478571 (+ 393us) client_negotiation.cc:240] Negotiation successful
0809 19:09:51.478898 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":619,"thread_start_us":476,"threads_started":1}
I20260809 19:09:51.481465 17345 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.7.39.61:46355: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "dc6e5da415ab45d98a660ab46d312620"
member_type: NON_VOTER
last_known_addr {
host: "127.7.39.61"
port: 46355
}
attrs {
promote: true
}
}
dest_uuid: "1ea647a72fce400dad91d0cf80781fb0"
cas_config_opid_index: -1
I20260809 19:09:51.482713 17345 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: NON_VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: true } }
I20260809 19:09:51.490278 18186 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:51.494444 18186 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [term 1 FOLLOWER]: Refusing update from remote peer 1ea647a72fce400dad91d0cf80781fb0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260809 19:09:51.494845 18270 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER dc6e5da415ab45d98a660ab46d312620 (127.7.39.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: NON_VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: true } } }
I20260809 19:09:51.496161 18269 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: NON_VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:09:51.500378 18270 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.7.39.61:46355
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.39.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.60.keytab.
Entry for principal oryx/127.7.39.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.60.keytab.
I20260809 19:09:51.501389 18118 master.cc:537] Master@127.7.39.61:46355 shutting down...
I20260809 19:09:51.502807 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.60:36903
--webserver_interface=127.7.39.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.60.keytab
--principal=oryx/127.7.39.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:42393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:33935,127.7.39.61:46355,127.7.39.60:36903
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 19:09:51.512468 18269 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "1ea647a72fce400dad91d0cf80781fb0" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: NON_VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: true } } }
I20260809 19:09:51.512804 18269 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:51.542186 18186 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [term 1 LEARNER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER dc6e5da415ab45d98a660ab46d312620 (127.7.39.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: NON_VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: true } } }
I20260809 19:09:51.546720 18282 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1ea647a72fce400dad91d0cf80781fb0" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: NON_VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: true } } }
I20260809 19:09:51.547155 18282 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [sys.catalog]: This master's current role is: LEARNER
I20260809 19:09:51.547454 18276 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1ea647a72fce400dad91d0cf80781fb0" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: NON_VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: true } } }
I20260809 19:09:51.547789 18276 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [sys.catalog]: This master's current role is: LEARNER
I20260809 19:09:51.547013 18233 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ea647a72fce400dad91d0cf80781fb0. Latest consensus state: current_term: 1 leader_uuid: "1ea647a72fce400dad91d0cf80781fb0" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: NON_VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: true } } }
I20260809 19:09:51.548029 18233 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [sys.catalog]: This master's current role is: LEARNER
I20260809 19:09:51.550074 18118 raft_consensus.cc:2229] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [term 1 LEARNER]: Raft consensus shutting down.
I20260809 19:09:51.550573 18118 raft_consensus.cc:2258] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [term 1 LEARNER]: Raft consensus is shut down!
I20260809 19:09:51.550731 18118 tablet_replica.cc:330] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620: stopping tablet replica
I20260809 19:09:51.558805 18118 master.cc:552] Master@127.7.39.61:46355 shutdown complete.
I20260809 19:09:51.558986 18118 master_runner.cc:305] Clearing existing system tablet
I20260809 19:09:51.559504 18118 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:51.559639 18118 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:51.562536 18118 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260809 19:09:51.564261 18286 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:51.564642 18118 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:51.565115 18118 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260809 19:09:51.565303 18118 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-1/wal
uuid: "dc6e5da415ab45d98a660ab46d312620"
format_stamp: "Formatted at 2026-08-09 19:09:51 on dist-test-slave-4tdj"
server_key: "66b2f92f54a7d082021d75ba02c3777b"
server_key_iv: "700db6ba76a57f08634823e550e1dd7a"
server_key_version: "encryptionkey@0"
I20260809 19:09:51.570195 18118 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:09:51.576996 18118 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 19:09:51.577240 18118 log.cc:1196] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260809 19:09:51.577801 18118 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620: Deleting consensus metadata
I20260809 19:09:51.578120 18118 master_runner.cc:315] Copying system tablet from 127.7.39.62:33935
I20260809 19:09:51.584357 18118 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620: tablet copy: Beginning tablet copy session from remote peer at address 127.7.39.62:33935
I20260809 19:09:51.601267 17668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:51.585420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34192 (local address 127.7.39.62:33935)
0809 19:09:51.585610 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:51.585616 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:51.586837 (+ 1221us) server_negotiation.cc:407] Connection header received
0809 19:09:51.587174 (+ 337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:51.587181 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:51.587282 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:51.587358 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:51.588579 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:51.589708 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:51.591593 (+ 1885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:51.592232 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:51.592330 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:51.594759 (+ 2429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:51.594766 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:51.594771 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:51.594812 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:51.598128 (+ 3316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:51.598943 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:51.598948 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:51.598951 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:51.599118 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:51.599564 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:51.599570 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:51.599573 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:51.599958 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:51.600112 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:51.600670 (+ 558us) server_negotiation.cc:299] Negotiation successful
0809 19:09:51.600912 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 19:09:51.602504 18293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:51.585411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.0.0.1:34192)
0809 19:09:51.586728 (+ 1317us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:51.586750 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:51.586970 (+ 220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:51.587577 (+ 607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:51.587582 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:51.588111 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:51.588385 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:51.588399 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:51.589895 (+ 1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:51.589900 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:51.591418 (+ 1518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:51.591434 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:51.592584 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:51.592589 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:51.592791 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:51.593468 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:51.593495 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:51.594529 (+ 1034us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:51.598279 (+ 3750us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:51.598284 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:51.598288 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:51.598799 (+ 511us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:51.599262 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:51.599267 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:51.599270 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:51.599431 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:51.600197 (+ 766us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:51.600202 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:51.600380 (+ 178us) client_negotiation.cc:769] Sending connection context
0809 19:09:51.601694 (+ 1314us) client_negotiation.cc:240] Negotiation successful
0809 19:09:51.602031 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1169,"thread_start_us":1038,"threads_started":1}
I20260809 19:09:51.603713 17381 tablet_copy_service.cc:140] P 1ea647a72fce400dad91d0cf80781fb0: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer dc6e5da415ab45d98a660ab46d312620 ({username='oryx', principal='oryx/127.7.39.61@KRBTEST.COM'} at 127.0.0.1:34192)
I20260809 19:09:51.604207 17381 tablet_copy_service.cc:161] P 1ea647a72fce400dad91d0cf80781fb0: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer dc6e5da415ab45d98a660ab46d312620 at {username='oryx', principal='oryx/127.7.39.61@KRBTEST.COM'} at 127.0.0.1:34192: session id = dc6e5da415ab45d98a660ab46d312620-00000000000000000000000000000000
I20260809 19:09:51.609157 17381 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 19:09:51.611711 18118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 19:09:51.618569 18118 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620: tablet copy: Starting download of 0 data blocks...
I20260809 19:09:51.618960 18118 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620: tablet copy: Starting download of 1 WAL segments...
I20260809 19:09:51.622449 18118 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 19:09:51.626955 17381 tablet_copy_service.cc:342] P 1ea647a72fce400dad91d0cf80781fb0: Request end of tablet copy session dc6e5da415ab45d98a660ab46d312620-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.7.39.61@KRBTEST.COM'} at 127.0.0.1:34192
I20260809 19:09:51.627206 17381 tablet_copy_service.cc:433] P 1ea647a72fce400dad91d0cf80781fb0: ending tablet copy session dc6e5da415ab45d98a660ab46d312620-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer dc6e5da415ab45d98a660ab46d312620
I20260809 19:09:51.639767 18118 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:51.642144 18294 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:51.642590 18295 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:51.649787 18118 server_base.cc:1034] running on GCE node
W20260809 19:09:51.650211 18297 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:51.650676 18118 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:51.651283 18118 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:51.652530 18118 hybrid_clock.cc:648] HybridClock initialized: now 1786302591652475 us; error 35 us; skew 500 ppm
I20260809 19:09:51.652743 18118 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:51 dist-test-slave-4tdj krb5kdc[17274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302591, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:51.655009 18118 init.cc:377] Logged in from keytab as oryx/127.7.39.61@KRBTEST.COM (short username oryx)
I20260809 19:09:51.659153 18118 webserver.cc:460] Webserver started at http://127.7.39.61:36581/ using document root <none> and password file <none>
I20260809 19:09:51.659462 18118 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:51.659536 18118 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:51.662388 18118 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260809 19:09:51.664428 18311 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:51.664849 18118 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.002s
I20260809 19:09:51.664980 18118 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-1/wal
uuid: "dc6e5da415ab45d98a660ab46d312620"
format_stamp: "Formatted at 2026-08-09 19:09:51 on dist-test-slave-4tdj"
server_key: "66b2f92f54a7d082021d75ba02c3777b"
server_key_iv: "700db6ba76a57f08634823e550e1dd7a"
server_key_version: "encryptionkey@0"
I20260809 19:09:51.665160 18118 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:51.690505 18118 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:51.694769 18118 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:51.729499 18118 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.61:46355
I20260809 19:09:51.729553 18391 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.61:46355 every 8 connection(s)
I20260809 19:09:51.730681 18118 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-1/data/info.pb
I20260809 19:09:51.736150 18393 sys_catalog.cc:263] Verifying existing consensus state
I20260809 19:09:51.740203 18393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620: Bootstrap starting.
I20260809 19:09:51.754439 18393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 19:09:51.754989 18393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620: Bootstrap complete.
I20260809 19:09:51.756040 18393 raft_consensus.cc:348] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: NON_VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: true } }
I20260809 19:09:51.756304 18393 raft_consensus.cc:729] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: dc6e5da415ab45d98a660ab46d312620, State: Initialized, Role: LEARNER
I20260809 19:09:51.756613 18393 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: NON_VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: true } }
I20260809 19:09:51.757512 18397 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: NON_VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: true } } }
I20260809 19:09:51.757799 18393 sys_catalog.cc:564] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:09:51.757961 18397 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [sys.catalog]: This master's current role is: LEARNER
I20260809 19:09:51.768294 18416 catalog_manager.cc:1259] Loaded cluster ID: 16c59a70236c44159b71e16fd90c7b65
I20260809 19:09:51.768385 18416 catalog_manager.cc:1552] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620: loading cluster ID for follower catalog manager: success
I20260809 19:09:51.772061 18416 catalog_manager.cc:1574] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620: acquiring CA information for follower catalog manager: success
I20260809 19:09:51.774784 18416 catalog_manager.cc:1602] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260809 19:09:51.882524 18273 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:51.882792 18273 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:51.882927 18273 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:51.889850 18273 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:09:51.889940 18273 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:51.890009 18273 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:51.890082 18273 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:09:51.890137 18273 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:09:51.899607 18273 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:42393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:33935,127.7.39.61:46355,127.7.39.60:36903
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.60.keytab
--principal=oryx/127.7.39.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.60:36903
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.7.39.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:51.900764 18273 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:51.901970 18273 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 19:09:51.910319 18108 heartbeater.cc:503] Master 127.7.39.62:33935 was elected leader, sending a full tablet report...
W20260809 19:09:51.913345 18421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:51.913370 18422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:51.913447 18426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:51.914119 18273 server_base.cc:1034] running on GCE node
I20260809 19:09:51.914913 18273 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:51.916232 18273 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:51.917425 18273 hybrid_clock.cc:648] HybridClock initialized: now 1786302591917368 us; error 46 us; skew 500 ppm
I20260809 19:09:51.917749 18273 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:51 dist-test-slave-4tdj krb5kdc[17274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302591, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:51.920730 18273 init.cc:377] Logged in from keytab as oryx/127.7.39.60@KRBTEST.COM (short username oryx)
I20260809 19:09:51.922073 18273 webserver.cc:460] Webserver started at http://127.7.39.60:34681/ using document root <none> and password file <none>
I20260809 19:09:51.922773 18273 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:51.922892 18273 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:51.923225 18273 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:51.926123 18273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-2/data/instance:
uuid: "7dc69093513f4aed81bf2c78f57e1438"
format_stamp: "Formatted at 2026-08-09 19:09:51 on dist-test-slave-4tdj"
server_key: "58e9e4bb168c28099279f2b555885978"
server_key_iv: "5a39769a0dcc94029caeb464015f3dc2"
server_key_version: "encryptionkey@0"
I20260809 19:09:51.926908 18273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-2/wal/instance:
uuid: "7dc69093513f4aed81bf2c78f57e1438"
format_stamp: "Formatted at 2026-08-09 19:09:51 on dist-test-slave-4tdj"
server_key: "58e9e4bb168c28099279f2b555885978"
server_key_iv: "5a39769a0dcc94029caeb464015f3dc2"
server_key_version: "encryptionkey@0"
I20260809 19:09:51.931860 18273 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 19:09:51.935160 18438 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:51.936468 18273 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 19:09:51.936621 18273 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-2/wal
uuid: "7dc69093513f4aed81bf2c78f57e1438"
format_stamp: "Formatted at 2026-08-09 19:09:51 on dist-test-slave-4tdj"
server_key: "58e9e4bb168c28099279f2b555885978"
server_key_iv: "5a39769a0dcc94029caeb464015f3dc2"
server_key_version: "encryptionkey@0"
I20260809 19:09:51.936793 18273 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:51.948216 18269 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1ea647a72fce400dad91d0cf80781fb0" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: NON_VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: true } } }
I20260809 19:09:51.948604 18269 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:51.953495 18273 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:51.955861 18265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:51.948393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:46355 (local address 127.0.0.1:51588)
0809 19:09:51.948775 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:51.948793 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:51.948909 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:51.950187 (+ 1278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:51.950193 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:51.950223 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:51.950429 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:51.950441 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:51.951815 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:51.951821 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:51.953756 (+ 1935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:51.953772 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:51.955102 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:51.955108 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:51.955336 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:51.955399 (+ 63us) client_negotiation.cc:769] Sending connection context
0809 19:09:51.955487 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 19:09:51.955600 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257}
I20260809 19:09:51.956007 18448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:51.949194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51588 (local address 127.7.39.61:46355)
0809 19:09:51.949774 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:51.949779 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:51.949799 (+ 20us) server_negotiation.cc:407] Connection header received
0809 19:09:51.949880 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:51.949884 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:51.949971 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:51.950084 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:51.950595 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:51.951633 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:51.953899 (+ 2266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:51.954934 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:51.955055 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:51.955226 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:51.955533 (+ 307us) server_negotiation.cc:299] Negotiation successful
0809 19:09:51.955681 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":452,"thread_start_us":302,"threads_started":1}
I20260809 19:09:51.957456 18397 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ea647a72fce400dad91d0cf80781fb0. Latest consensus state: current_term: 1 leader_uuid: "1ea647a72fce400dad91d0cf80781fb0" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: NON_VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: true } } }
I20260809 19:09:51.957765 18397 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [sys.catalog]: This master's current role is: LEARNER
I20260809 19:09:51.958317 18273 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:51.958606 18270 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0: attempting to promote NON_VOTER dc6e5da415ab45d98a660ab46d312620 to VOTER
I20260809 19:09:51.958613 18273 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:51.959544 18270 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false } }
I20260809 19:09:51.961249 18355 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [term 1 LEARNER]: Refusing update from remote peer 1ea647a72fce400dad91d0cf80781fb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 19:09:51.961822 18447 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260809 19:09:51.965121 18270 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, dc6e5da415ab45d98a660ab46d312620 (127.7.39.61) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false } } }
I20260809 19:09:51.966892 18355 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, dc6e5da415ab45d98a660ab46d312620 (127.7.39.61) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false } } }
I20260809 19:09:51.968777 18269 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "1ea647a72fce400dad91d0cf80781fb0" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false } } }
I20260809 19:09:51.968989 18269 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:51.969259 18270 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1ea647a72fce400dad91d0cf80781fb0" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false } } }
I20260809 19:09:51.969447 18270 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:51.970312 18397 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1ea647a72fce400dad91d0cf80781fb0" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false } } }
I20260809 19:09:51.970515 18397 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:09:51.982189 18273 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.60:36903
I20260809 19:09:51.982219 18526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.60:36903 every 8 connection(s)
I20260809 19:09:51.983460 18273 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-2/data/info.pb
I20260809 19:09:51.987010 18527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:51.990327 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 18273
I20260809 19:09:51.993871 18527 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 19:09:51 dist-test-slave-4tdj krb5kdc[17274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302588, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.39.60@KRBTEST.COM
Aug 09 19:09:51 dist-test-slave-4tdj krb5kdc[17274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302591, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.60@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM
I20260809 19:09:52.011792 17668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:51.996862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34208 (local address 127.7.39.62:33935)
0809 19:09:51.997044 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:51.997050 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:51.997698 (+ 648us) server_negotiation.cc:407] Connection header received
0809 19:09:51.997859 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:51.997863 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:51.997921 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:51.997997 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:51.999248 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.000293 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.001948 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.002413 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.002526 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:52.005837 (+ 3311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:52.005841 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:52.005844 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:52.005876 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:52.008731 (+ 2855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:52.009548 (+ 817us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:52.009553 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:52.009556 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:52.009702 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:52.010038 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:52.010042 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:52.010045 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:52.010411 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:52.010536 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:52.011237 (+ 701us) server_negotiation.cc:299] Negotiation successful
0809 19:09:52.011454 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 19:09:52.012171 18531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:51.992287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38956 (local address 127.7.39.60:36903)
0809 19:09:51.992975 (+ 688us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:51.992987 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:51.993028 (+ 41us) server_negotiation.cc:407] Connection header received
0809 19:09:51.994601 (+ 1573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:51.994623 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:51.994993 (+ 370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:51.995321 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:51.996699 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:51.998641 (+ 1942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.000213 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.001144 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.001303 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:52.005555 (+ 4252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:52.005566 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:52.005580 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:52.005616 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:52.008330 (+ 2714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:52.008922 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:52.008932 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:52.008936 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:52.009138 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:52.009550 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:52.009571 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:52.009574 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:52.010146 (+ 572us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:52.010436 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:52.010790 (+ 354us) server_negotiation.cc:299] Negotiation successful
0809 19:09:52.011089 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":509,"spinlock_wait_cycles":12672,"thread_start_us":316,"threads_started":1}
I20260809 19:09:52.012217 18533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:51.996784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.0.0.1:34208)
0809 19:09:51.997550 (+ 766us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:51.997597 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:51.997760 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:51.998078 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:51.998085 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:51.998855 (+ 770us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:51.999093 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:51.999102 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.000410 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.000415 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:52.001818 (+ 1403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:52.001829 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.002621 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.002629 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:52.002757 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:52.003298 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:52.003318 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:52.005674 (+ 2356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:52.008847 (+ 3173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:52.008857 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:52.008868 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:52.009428 (+ 560us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:52.009801 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:52.009803 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:52.009806 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:52.009939 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:52.010570 (+ 631us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:52.010577 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:52.010771 (+ 194us) client_negotiation.cc:769] Sending connection context
0809 19:09:52.011137 (+ 366us) client_negotiation.cc:240] Negotiation successful
0809 19:09:52.011348 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":381,"threads_started":1}
I20260809 19:09:52.013545 18527 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 19:09:52 dist-test-slave-4tdj krb5kdc[17274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302591, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.60@KRBTEST.COM for oryx/127.7.39.61@KRBTEST.COM
I20260809 19:09:52.024845 18533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:52.014281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:46355 (local address 127.0.0.1:51604)
0809 19:09:52.014464 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:52.014482 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:52.014574 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:52.015007 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:52.015011 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:52.015293 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:52.015403 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:52.015410 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.016410 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.016414 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:52.017289 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:52.017299 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.017879 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.017883 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:52.017991 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:52.018464 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:52.018480 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:52.020210 (+ 1730us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:52.023048 (+ 2838us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:52.023053 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:52.023057 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:52.023459 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:52.023773 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:52.023776 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:52.023778 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:52.023887 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:52.024256 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:52.024259 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:52.024359 (+ 100us) client_negotiation.cc:769] Sending connection context
0809 19:09:52.024455 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 19:09:52.024652 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260809 19:09:52.024938 18448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:52.014373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51604 (local address 127.7.39.61:46355)
0809 19:09:52.014572 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:52.014577 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:52.014595 (+ 18us) server_negotiation.cc:407] Connection header received
0809 19:09:52.014681 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:52.014686 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:52.014765 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:52.014859 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:52.015549 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.016283 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.017391 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.017777 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.017860 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:52.020359 (+ 2499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:52.020363 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:52.020366 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:52.020395 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:52.022927 (+ 2532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:52.023555 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:52.023559 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:52.023561 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:52.023695 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:52.023956 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:52.023959 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:52.023960 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:52.024182 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:52.024279 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:52.024523 (+ 244us) server_negotiation.cc:299] Negotiation successful
0809 19:09:52.024707 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260809 19:09:52.025784 18527 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.39.60" port: 36903 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 19:09:52 dist-test-slave-4tdj krb5kdc[17274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302591, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.60@KRBTEST.COM for oryx/127.7.39.60@KRBTEST.COM
I20260809 19:09:52.036788 18533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:52.026279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:36903 (local address 127.0.0.1:38972)
0809 19:09:52.026472 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:52.026489 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:52.026582 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:52.026806 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:52.026809 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:52.027102 (+ 293us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:52.027221 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:52.027228 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.028048 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.028052 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:52.028840 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:52.028849 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.029422 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.029426 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:52.029591 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:52.029999 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:52.030014 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:52.032126 (+ 2112us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:52.034840 (+ 2714us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:52.034843 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:52.034845 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:52.035171 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:52.035492 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:52.035497 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:52.035499 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:52.035644 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:52.036107 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:52.036110 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:52.036223 (+ 113us) client_negotiation.cc:769] Sending connection context
0809 19:09:52.036328 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 19:09:52.036499 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260809 19:09:52.036842 18531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:52.026483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38972 (local address 127.7.39.60:36903)
0809 19:09:52.026606 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:52.026611 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:52.026639 (+ 28us) server_negotiation.cc:407] Connection header received
0809 19:09:52.026672 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:52.026675 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:52.026722 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:52.026785 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:52.027325 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.027950 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.028945 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.029315 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.029400 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:52.032311 (+ 2911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:52.032316 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:52.032319 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:52.032348 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:52.034737 (+ 2389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:52.035268 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:52.035272 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:52.035274 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:52.035386 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:52.035732 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:52.035735 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:52.035737 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:52.036014 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:52.036114 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:52.036389 (+ 275us) server_negotiation.cc:299] Negotiation successful
0809 19:09:52.036609 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":41}
I20260809 19:09:52.041213 18527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438: Bootstrap starting.
I20260809 19:09:52.044359 18527 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:52.045385 18527 log.cc:824] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:52.048030 18527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438: No bootstrap required, opened a new log
I20260809 19:09:52.055051 18527 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } } peers { permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 36903 } }
I20260809 19:09:52.055358 18527 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:52.055467 18527 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dc69093513f4aed81bf2c78f57e1438, State: Initialized, Role: FOLLOWER
I20260809 19:09:52.056007 18527 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } } peers { permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 36903 } }
I20260809 19:09:52.056891 18538 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } } peers { permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 36903 } } }
I20260809 19:09:52.057226 18538 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:09:52.057786 18527 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 19:09:52.066671 18553 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260809 19:09:52.066918 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 17442
W20260809 19:09:52.067076 18553 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 19:09:52.071301 18273 master_runner.cc:428] Detected that this master 7dc69093513f4aed81bf2c78f57e1438 is joining an existing cluster
I20260809 19:09:52.071415 18273 master_runner.cc:432] Initiating AddMaster RPC to add 127.7.39.60:36903
Aug 09 19:09:52 dist-test-slave-4tdj krb5kdc[17274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302588, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.39.1@KRBTEST.COM
I20260809 19:09:52.084522 18538 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:09:52.084884 18538 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } } peers { permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 36903 } }
I20260809 19:09:52.087100 18538 leader_election.cc:288] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ea647a72fce400dad91d0cf80781fb0 (127.7.39.62:33935), dc6e5da415ab45d98a660ab46d312620 (127.7.39.61:46355)
I20260809 19:09:52.087522 17361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7dc69093513f4aed81bf2c78f57e1438" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ea647a72fce400dad91d0cf80781fb0" is_pre_election: true
I20260809 19:09:52.087821 18355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7dc69093513f4aed81bf2c78f57e1438" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc6e5da415ab45d98a660ab46d312620" is_pre_election: true
I20260809 19:09:52.088739 18443 leader_election.cc:302] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7dc69093513f4aed81bf2c78f57e1438; no voters: 1ea647a72fce400dad91d0cf80781fb0, dc6e5da415ab45d98a660ab46d312620
I20260809 19:09:52.089493 18538 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260809 19:09:52.091806 18557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:52.067897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44782 (local address 127.7.39.1:33499)
0809 19:09:52.068922 (+ 1025us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:52.068928 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:52.068951 (+ 23us) server_negotiation.cc:407] Connection header received
0809 19:09:52.069003 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:52.069010 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:52.069175 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:52.069319 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:52.070734 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.071933 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.073508 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.074086 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.074194 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:52.080228 (+ 6034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:52.080242 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:52.080259 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:52.080305 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:52.084150 (+ 3845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:52.085911 (+ 1761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:52.085920 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:52.085923 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:52.086076 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:52.086545 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:52.086550 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:52.086554 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:52.086955 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:52.087234 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:52.087852 (+ 618us) server_negotiation.cc:299] Negotiation successful
0809 19:09:52.088132 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":875,"thread_start_us":749,"threads_started":1}
I20260809 19:09:52.093760 17658 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:52.094309 17668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:52.076949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34220 (local address 127.7.39.62:33935)
0809 19:09:52.077117 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:52.077123 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:52.077292 (+ 169us) server_negotiation.cc:407] Connection header received
0809 19:09:52.077576 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:52.077582 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:52.077660 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:52.077727 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:52.079403 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.080616 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.082744 (+ 2128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.083472 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.083565 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:52.088319 (+ 4754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:52.088325 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:52.088330 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:52.088367 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:52.091359 (+ 2992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:52.092066 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:52.092072 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:52.092075 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:52.092241 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:52.092746 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:52.092752 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:52.092755 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:52.093086 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:52.093244 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:52.093757 (+ 513us) server_negotiation.cc:299] Negotiation successful
0809 19:09:52.093955 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 19:09:52.094368 18565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:52.076556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.0.0.1:34220)
0809 19:09:52.077198 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:52.077219 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:52.077396 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:52.077939 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:52.077943 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:52.078802 (+ 859us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:52.079213 (+ 411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:52.079226 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.080803 (+ 1577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.080809 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:52.082562 (+ 1753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:52.082579 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.083859 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.083868 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:52.084071 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:52.084741 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:52.084769 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:52.088161 (+ 3392us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:52.091490 (+ 3329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:52.091496 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:52.091500 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:52.091932 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:52.092402 (+ 470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:52.092407 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:52.092411 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:52.092614 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:52.093216 (+ 602us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:52.093220 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:52.093456 (+ 236us) client_negotiation.cc:769] Sending connection context
0809 19:09:52.093619 (+ 163us) client_negotiation.cc:240] Negotiation successful
0809 19:09:52.093899 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":571,"threads_started":1}
I20260809 19:09:52.109179 18448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:52.077700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51608 (local address 127.7.39.61:46355)
0809 19:09:52.077876 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:52.077881 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:52.085291 (+ 7410us) server_negotiation.cc:407] Connection header received
0809 19:09:52.086334 (+ 1043us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:52.086340 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:52.086413 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:52.086467 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:52.095618 (+ 9151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.096521 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.098531 (+ 2010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.099146 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.099237 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:52.101521 (+ 2284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:52.101527 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:52.101532 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:52.101568 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:52.104796 (+ 3228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:52.105627 (+ 831us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:52.105632 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:52.105636 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:52.105777 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:52.106265 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:52.106270 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:52.106273 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:52.106671 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:52.106808 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:52.108594 (+ 1786us) server_negotiation.cc:299] Negotiation successful
0809 19:09:52.108819 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
Aug 09 19:09:52 dist-test-slave-4tdj krb5kdc[17274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302589, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.62@KRBTEST.COM for oryx/127.7.39.60@KRBTEST.COM
I20260809 19:09:52.110230 18566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:52.078179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:46355 (local address 127.0.0.1:51608)
0809 19:09:52.085171 (+ 6992us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:52.085191 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:52.085515 (+ 324us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:52.086692 (+ 1177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:52.086696 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:52.095058 (+ 8362us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:52.095344 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:52.095355 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.096670 (+ 1315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.096675 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:52.098366 (+ 1691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:52.098383 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.099536 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.099542 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:52.099695 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:52.100262 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:52.100284 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:52.101318 (+ 1034us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:52.104950 (+ 3632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:52.104954 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:52.104961 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:52.105493 (+ 532us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:52.105907 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:52.105911 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:52.105914 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:52.106095 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:52.106938 (+ 843us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:52.106942 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:52.108284 (+ 1342us) client_negotiation.cc:769] Sending connection context
0809 19:09:52.109451 (+ 1167us) client_negotiation.cc:240] Negotiation successful
0809 19:09:52.109782 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6827,"thread_start_us":7115,"threads_started":1}
I20260809 19:09:52.113931 18568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:52.086080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:36903 (local address 127.0.0.1:38976)
0809 19:09:52.090098 (+ 4018us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:52.090115 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:52.090231 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:52.090610 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:52.090614 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:52.095364 (+ 4750us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:52.100636 (+ 5272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:52.100652 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.102122 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.102127 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:52.103697 (+ 1570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:52.103715 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.104988 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.104994 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:52.105169 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:52.105773 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:52.105796 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:52.106941 (+ 1145us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:52.111151 (+ 4210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:52.111156 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:52.111160 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:52.111649 (+ 489us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:52.112165 (+ 516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:52.112170 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:52.112175 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:52.112328 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:52.112959 (+ 631us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:52.112963 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:52.113117 (+ 154us) client_negotiation.cc:769] Sending connection context
0809 19:09:52.113241 (+ 124us) client_negotiation.cc:240] Negotiation successful
0809 19:09:52.113486 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3883,"thread_start_us":8226,"threads_started":1}
I20260809 19:09:52.114975 18531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:52.085830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38976 (local address 127.7.39.60:36903)
0809 19:09:52.085972 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:52.085977 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:52.090198 (+ 4221us) server_negotiation.cc:407] Connection header received
0809 19:09:52.090396 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:52.090401 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:52.090470 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:52.090576 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:52.100767 (+ 10191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.101887 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.103862 (+ 1975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.104629 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.104741 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:52.107112 (+ 2371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:52.107118 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:52.107126 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:52.107163 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:52.111020 (+ 3857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:52.111854 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:52.111859 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:52.111863 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:52.112045 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:52.112448 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:52.112453 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:52.112456 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:52.112788 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:52.112913 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:52.114427 (+ 1514us) server_negotiation.cc:299] Negotiation successful
0809 19:09:52.114626 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 19:09:52.118993 18265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:52.099867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:36903 (local address 127.0.0.1:38992)
0809 19:09:52.100196 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:52.100214 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:52.100303 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:52.102045 (+ 1742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:52.102049 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:52.102537 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:52.102740 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:52.102751 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.104757 (+ 2006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.104762 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:52.106090 (+ 1328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:52.106104 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.107157 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.107163 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:52.107330 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:52.107895 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:52.107916 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:52.110707 (+ 2791us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:52.116786 (+ 6079us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:52.116791 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:52.116794 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:52.117132 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:52.117466 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:52.117470 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:52.117473 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:52.117586 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:52.118057 (+ 471us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:52.118061 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:52.118201 (+ 140us) client_negotiation.cc:769] Sending connection context
0809 19:09:52.118355 (+ 154us) client_negotiation.cc:240] Negotiation successful
0809 19:09:52.118616 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210}
I20260809 19:09:52.119041 18572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:52.100166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38992 (local address 127.7.39.60:36903)
0809 19:09:52.101689 (+ 1523us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:52.101694 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:52.101714 (+ 20us) server_negotiation.cc:407] Connection header received
0809 19:09:52.101793 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:52.101798 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:52.101871 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:52.102874 (+ 1003us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:52.103235 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.104593 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.106267 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.106993 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.111140 (+ 4147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:52.111432 (+ 292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:52.111438 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:52.111443 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:52.111472 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:52.116663 (+ 5191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:52.117241 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:52.117245 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:52.117247 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:52.117364 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:52.117687 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:52.117692 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:52.117694 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:52.117941 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:52.118066 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:52.118446 (+ 380us) server_negotiation.cc:299] Negotiation successful
0809 19:09:52.118643 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":1381,"spinlock_wait_cycles":6912,"thread_start_us":11567,"threads_started":1}
I20260809 19:09:52.120409 17345 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.7.39.60:36903: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438"
member_type: NON_VOTER
last_known_addr {
host: "127.7.39.60"
port: 36903
}
attrs {
promote: true
}
}
dest_uuid: "1ea647a72fce400dad91d0cf80781fb0"
cas_config_opid_index: 6
I20260809 19:09:52.121047 17345 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false } } peers { permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438" member_type: NON_VOTER last_known_addr { host: "127.7.39.60" port: 36903 } attrs { promote: true } }
I20260809 19:09:52.123124 18355 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [term 1 FOLLOWER]: Refusing update from remote peer 1ea647a72fce400dad91d0cf80781fb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260809 19:09:52.123646 18270 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260809 19:09:52.125703 18269 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 7dc69093513f4aed81bf2c78f57e1438 (127.7.39.60) added. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false } } peers { permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438" member_type: NON_VOTER last_known_addr { host: "127.7.39.60" port: 36903 } attrs { promote: true } } }
I20260809 19:09:52.126344 18355 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 7dc69093513f4aed81bf2c78f57e1438 (127.7.39.60) added. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false } } peers { permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438" member_type: NON_VOTER last_known_addr { host: "127.7.39.60" port: 36903 } attrs { promote: true } } }
I20260809 19:09:52.129480 18269 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.7.39.60:36903
I20260809 19:09:52.129848 18269 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1ea647a72fce400dad91d0cf80781fb0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false } } peers { permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438" member_type: NON_VOTER last_known_addr { host: "127.7.39.60" port: 36903 } attrs { promote: true } } }
I20260809 19:09:52.129947 18447 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "1ea647a72fce400dad91d0cf80781fb0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false } } peers { permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438" member_type: NON_VOTER last_known_addr { host: "127.7.39.60" port: 36903 } attrs { promote: true } } }
I20260809 19:09:52.130180 18269 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:52.130234 18447 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:52.130959 18397 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1ea647a72fce400dad91d0cf80781fb0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false } } peers { permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438" member_type: NON_VOTER last_known_addr { host: "127.7.39.60" port: 36903 } attrs { promote: true } } }
I20260809 19:09:52.131244 18397 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:09:52.138671 18273 master.cc:537] Master@127.7.39.60:36903 shutting down...
I20260809 19:09:52.139715 18490 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:52.143949 18490 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [term 1 FOLLOWER]: Refusing update from remote peer 1ea647a72fce400dad91d0cf80781fb0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260809 19:09:52.144757 18270 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438" member_type: NON_VOTER last_known_addr { host: "127.7.39.60" port: 36903 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 19:09:52.147423 17324 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260809 19:09:52.150976 17324 consensus_peers.cc:487] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 -> Peer 7dc69093513f4aed81bf2c78f57e1438 (127.7.39.60:36903): Couldn't send request to peer 7dc69093513f4aed81bf2c78f57e1438. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260809 19:09:52.153167 18273 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:09:52.153528 18273 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:09:52.153712 18273 tablet_replica.cc:330] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438: stopping tablet replica
I20260809 19:09:52.159905 18273 master.cc:552] Master@127.7.39.60:36903 shutdown complete.
I20260809 19:09:52.159979 18273 master_runner.cc:305] Clearing existing system tablet
I20260809 19:09:52.160362 18273 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:52.160447 18273 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:52.163223 18273 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260809 19:09:52.164788 18578 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:52.165084 18273 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:52.165400 18273 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 19:09:52.165503 18273 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-2/wal
uuid: "7dc69093513f4aed81bf2c78f57e1438"
format_stamp: "Formatted at 2026-08-09 19:09:51 on dist-test-slave-4tdj"
server_key: "58e9e4bb168c28099279f2b555885978"
server_key_iv: "5a39769a0dcc94029caeb464015f3dc2"
server_key_version: "encryptionkey@0"
I20260809 19:09:52.170378 18273 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:09:52.177107 18273 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 19:09:52.177289 18273 log.cc:1196] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260809 19:09:52.177778 18273 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438: Deleting consensus metadata
I20260809 19:09:52.178020 18273 master_runner.cc:315] Copying system tablet from 127.7.39.62:33935
I20260809 19:09:52.183746 18273 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438: tablet copy: Beginning tablet copy session from remote peer at address 127.7.39.62:33935
I20260809 19:09:52.199980 17668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:52.184582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34226 (local address 127.7.39.62:33935)
0809 19:09:52.184776 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:52.184783 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:52.186802 (+ 2019us) server_negotiation.cc:407] Connection header received
0809 19:09:52.186968 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:52.186973 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:52.187060 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:52.187159 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:52.188134 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.189285 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.191070 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.191689 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.191808 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:52.193929 (+ 2121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:52.193935 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:52.193940 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:52.193977 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:52.197117 (+ 3140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:52.197877 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:52.197883 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:52.197886 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:52.198039 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:52.198479 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:52.198484 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:52.198487 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:52.198816 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:52.198957 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:52.199392 (+ 435us) server_negotiation.cc:299] Negotiation successful
0809 19:09:52.199617 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 19:09:52.200021 18589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:52.184543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.0.0.1:34226)
0809 19:09:52.186676 (+ 2133us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:52.186700 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:52.186851 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:52.187218 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:52.187223 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:52.187737 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:52.187985 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:52.187998 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.189430 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.189436 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:52.190899 (+ 1463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:52.190914 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.191842 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.191849 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:52.192021 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:52.192661 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:52.192686 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:52.193728 (+ 1042us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:52.197247 (+ 3519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:52.197252 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:52.197256 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:52.197743 (+ 487us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:52.198148 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:52.198154 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:52.198158 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:52.198382 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:52.198941 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:52.198946 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:52.199114 (+ 168us) client_negotiation.cc:769] Sending connection context
0809 19:09:52.199256 (+ 142us) client_negotiation.cc:240] Negotiation successful
0809 19:09:52.199584 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1974,"thread_start_us":1883,"threads_started":1}
I20260809 19:09:52.201000 17381 tablet_copy_service.cc:140] P 1ea647a72fce400dad91d0cf80781fb0: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 7dc69093513f4aed81bf2c78f57e1438 ({username='oryx', principal='oryx/127.7.39.60@KRBTEST.COM'} at 127.0.0.1:34226)
I20260809 19:09:52.201167 17381 tablet_copy_service.cc:161] P 1ea647a72fce400dad91d0cf80781fb0: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 7dc69093513f4aed81bf2c78f57e1438 at {username='oryx', principal='oryx/127.7.39.60@KRBTEST.COM'} at 127.0.0.1:34226: session id = 7dc69093513f4aed81bf2c78f57e1438-00000000000000000000000000000000
I20260809 19:09:52.204591 17381 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 19:09:52.206388 18273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 19:09:52.213325 18273 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438: tablet copy: Starting download of 0 data blocks...
I20260809 19:09:52.213656 18273 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438: tablet copy: Starting download of 1 WAL segments...
I20260809 19:09:52.216472 18273 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 19:09:52.221060 17381 tablet_copy_service.cc:342] P 1ea647a72fce400dad91d0cf80781fb0: Request end of tablet copy session 7dc69093513f4aed81bf2c78f57e1438-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.7.39.60@KRBTEST.COM'} at 127.0.0.1:34226
I20260809 19:09:52.221282 17381 tablet_copy_service.cc:433] P 1ea647a72fce400dad91d0cf80781fb0: ending tablet copy session 7dc69093513f4aed81bf2c78f57e1438-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 7dc69093513f4aed81bf2c78f57e1438
I20260809 19:09:52.222311 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 17442
I20260809 19:09:52.236393 18273 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:52.238865 18590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:52.245711 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.1:33499
--local_ip_for_outbound_sockets=127.7.39.1
--tserver_master_addrs=127.7.39.62:33935
--webserver_port=46617
--webserver_interface=127.7.39.1
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.1.keytab
--principal=oryx/127.7.39.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:42393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.7.39.62:33935,127.7.39.61:46355
--tserver_master_addrs=127.7.39.62:33935,127.7.39.61:46355,127.7.39.60:36903 with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:52.252532 18596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:52.254985 18592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:52.255450 18273 server_base.cc:1034] running on GCE node
I20260809 19:09:52.256049 18273 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:52.256778 18273 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:52.258013 18273 hybrid_clock.cc:648] HybridClock initialized: now 1786302592257974 us; error 30 us; skew 500 ppm
I20260809 19:09:52.258237 18273 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:52 dist-test-slave-4tdj krb5kdc[17274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302592, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:52.260416 18273 init.cc:377] Logged in from keytab as oryx/127.7.39.60@KRBTEST.COM (short username oryx)
I20260809 19:09:52.271205 18273 webserver.cc:460] Webserver started at http://127.7.39.60:37419/ using document root <none> and password file <none>
I20260809 19:09:52.271551 18273 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:52.271699 18273 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:52.274785 18273 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260809 19:09:52.276769 18614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:52.277215 18273 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260809 19:09:52.277340 18273 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-2/wal
uuid: "7dc69093513f4aed81bf2c78f57e1438"
format_stamp: "Formatted at 2026-08-09 19:09:51 on dist-test-slave-4tdj"
server_key: "58e9e4bb168c28099279f2b555885978"
server_key_iv: "5a39769a0dcc94029caeb464015f3dc2"
server_key_version: "encryptionkey@0"
I20260809 19:09:52.277520 18273 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:52.298456 18273 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:52.302457 18273 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:52.328632 18273 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.60:36903
I20260809 19:09:52.328688 18686 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.60:36903 every 8 connection(s)
I20260809 19:09:52.329820 18273 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/master-2/data/info.pb
I20260809 19:09:52.335561 18687 sys_catalog.cc:263] Verifying existing consensus state
I20260809 19:09:52.352494 18687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438: Bootstrap starting.
I20260809 19:09:52.372478 18687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 19:09:52.373023 18687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438: Bootstrap complete.
I20260809 19:09:52.374402 18687 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false } } peers { permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438" member_type: NON_VOTER last_known_addr { host: "127.7.39.60" port: 36903 } attrs { promote: true } }
I20260809 19:09:52.374744 18687 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7dc69093513f4aed81bf2c78f57e1438, State: Initialized, Role: LEARNER
I20260809 19:09:52.375053 18687 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false } } peers { permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438" member_type: NON_VOTER last_known_addr { host: "127.7.39.60" port: 36903 } attrs { promote: true } }
I20260809 19:09:52.375931 18693 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false } } peers { permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438" member_type: NON_VOTER last_known_addr { host: "127.7.39.60" port: 36903 } attrs { promote: true } } }
I20260809 19:09:52.376251 18687 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:09:52.376420 18693 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [sys.catalog]: This master's current role is: LEARNER
I20260809 19:09:52.384797 18716 catalog_manager.cc:1259] Loaded cluster ID: 16c59a70236c44159b71e16fd90c7b65
I20260809 19:09:52.384898 18716 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438: loading cluster ID for follower catalog manager: success
I20260809 19:09:52.388319 18716 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438: acquiring CA information for follower catalog manager: success
I20260809 19:09:52.390568 18716 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260809 19:09:52.612300 18603 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:52.612569 18603 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:52.612702 18603 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:52.620697 18603 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:52.620805 18603 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:52.620945 18603 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.1
I20260809 19:09:52.630149 18603 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:42393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.1.keytab
--principal=oryx/127.7.39.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.1:33499
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.39.1
--webserver_port=46617
--tserver_master_addrs=127.7.39.62:33935,127.7.39.61:46355,127.7.39.60:36903
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.1
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:52.631508 18603 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:52.632827 18603 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:52.645344 18724 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:52.645448 18726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:52.646392 18728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:52.647080 18603 server_base.cc:1034] running on GCE node
I20260809 19:09:52.647703 18603 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:52.648567 18603 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:52.649771 18603 hybrid_clock.cc:648] HybridClock initialized: now 1786302592649721 us; error 40 us; skew 500 ppm
I20260809 19:09:52.650121 18603 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:52 dist-test-slave-4tdj krb5kdc[17274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302592, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:52.653235 18603 init.cc:377] Logged in from keytab as oryx/127.7.39.1@KRBTEST.COM (short username oryx)
I20260809 19:09:52.654577 18603 webserver.cc:460] Webserver started at http://127.7.39.1:46617/ using document root <none> and password file <none>
I20260809 19:09:52.655195 18603 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:52.655303 18603 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:52.660461 18603 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.003s
I20260809 19:09:52.663180 18743 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:52.664422 18603 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:09:52.664577 18603 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-0/wal
uuid: "dcf1a29c27c44bbfabe9397a91a80197"
format_stamp: "Formatted at 2026-08-09 19:09:49 on dist-test-slave-4tdj"
server_key: "83a22264bc5a45b70709fcf5a421e858"
server_key_iv: "f14e2d520309793b3773f6cc8d7df800"
server_key_version: "encryptionkey@0"
I20260809 19:09:52.665539 18603 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:52.683048 18603 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:52.688427 18603 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:52.688812 18603 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:52.689958 18603 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:09:52.692077 18603 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:52.692303 18603 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:52.692454 18603 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:52.692570 18603 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:52.763377 18603 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.1:33499
I20260809 19:09:52.763437 18939 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.1:33499 every 8 connection(s)
I20260809 19:09:52.764969 18603 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
I20260809 19:09:52.770656 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 18603
I20260809 19:09:52.771065 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 17677
I20260809 19:09:52.796718 18962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:52.775886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:36903 (local address 127.0.0.1:39006)
0809 19:09:52.778749 (+ 2863us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:52.778770 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:52.778916 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:52.781742 (+ 2826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:52.781749 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:52.781783 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:52.788187 (+ 6404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:52.788206 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.790440 (+ 2234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.790445 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:52.793677 (+ 3232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:52.793694 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.795804 (+ 2110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.795810 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:52.796071 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:52.796106 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 19:09:52.796192 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 19:09:52.796324 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2724,"mutex_wait_us":26,"thread_start_us":2622,"threads_started":1}
I20260809 19:09:52.797569 18966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:52.776498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39006 (local address 127.7.39.60:36903)
0809 19:09:52.777667 (+ 1169us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:52.777673 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:52.779116 (+ 1443us) server_negotiation.cc:407] Connection header received
0809 19:09:52.779200 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:52.779206 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:52.779296 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:52.779415 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:52.788427 (+ 9012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.790178 (+ 1751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.793864 (+ 3686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.795324 (+ 1460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.795450 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:52.795678 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:52.797008 (+ 1330us) server_negotiation.cc:299] Negotiation successful
0809 19:09:52.797145 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":1023,"thread_start_us":692,"threads_started":1}
I20260809 19:09:52.798839 18652 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.7] Dedup: 1.7->[]
I20260809 19:09:52.799443 18693 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ea647a72fce400dad91d0cf80781fb0. Latest consensus state: current_term: 1 leader_uuid: "1ea647a72fce400dad91d0cf80781fb0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false } } peers { permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438" member_type: NON_VOTER last_known_addr { host: "127.7.39.60" port: 36903 } attrs { promote: true } } }
I20260809 19:09:52.799790 18693 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [sys.catalog]: This master's current role is: LEARNER
Aug 09 19:09:52 dist-test-slave-4tdj krb5kdc[17274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302592, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.61@KRBTEST.COM
Aug 09 19:09:52 dist-test-slave-4tdj krb5kdc[17274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302592, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.60@KRBTEST.COM
Aug 09 19:09:52 dist-test-slave-4tdj krb5kdc[17274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302592, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM
Aug 09 19:09:52 dist-test-slave-4tdj krb5kdc[17274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302588, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.39.2@KRBTEST.COM
I20260809 19:09:52.811820 18950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:52.768653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:55009 (local address 127.7.39.61:46355)
0809 19:09:52.785511 (+ 16858us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:52.785518 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:52.785544 (+ 26us) server_negotiation.cc:407] Connection header received
0809 19:09:52.787289 (+ 1745us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:52.787295 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:52.787389 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:52.787482 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:52.792620 (+ 5138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.793808 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.796426 (+ 2618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.797014 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.797105 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:52.804082 (+ 6977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:52.804090 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:52.804095 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:52.804142 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:52.807929 (+ 3787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:52.808932 (+ 1003us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:52.808938 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:52.808942 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:52.809085 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:52.809607 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:52.809612 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:52.809615 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:52.809947 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:52.810102 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:52.811232 (+ 1130us) server_negotiation.cc:299] Negotiation successful
0809 19:09:52.811444 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16731,"thread_start_us":16893,"threads_started":1}
I20260809 19:09:52.814353 18972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:52.769462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:46355 (local address 127.7.39.1:55009)
0809 19:09:52.784625 (+ 15163us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:52.784641 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:52.786944 (+ 2303us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:52.790175 (+ 3231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:52.790186 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:52.791162 (+ 976us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:52.792400 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:52.792429 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.794033 (+ 1604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.794038 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:52.796266 (+ 2228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:52.796279 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.797572 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.797582 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:52.798690 (+ 1108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:52.800473 (+ 1783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:52.800501 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:52.803776 (+ 3275us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:52.808053 (+ 4277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:52.808063 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:52.808082 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:52.808780 (+ 698us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:52.809225 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:52.809230 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:52.809233 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:52.809457 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:52.810202 (+ 745us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:52.810210 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:52.810786 (+ 576us) client_negotiation.cc:769] Sending connection context
0809 19:09:52.812336 (+ 1550us) client_negotiation.cc:240] Negotiation successful
0809 19:09:52.812853 (+ 517us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15007,"mutex_wait_us":32,"spinlock_wait_cycles":114560,"thread_start_us":10871,"threads_started":1}
I20260809 19:09:52.815385 18951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:52.768715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:56347 (local address 127.7.39.62:33935)
0809 19:09:52.793005 (+ 24290us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:52.793009 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:52.793027 (+ 18us) server_negotiation.cc:407] Connection header received
0809 19:09:52.793070 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:52.793073 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:52.793145 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:52.793256 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:52.794545 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.795888 (+ 1343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.800357 (+ 4469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.800965 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.801082 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:52.807138 (+ 6056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:52.807145 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:52.807149 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:52.807193 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:52.811237 (+ 4044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:52.812082 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:52.812089 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:52.812093 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:52.812271 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:52.812805 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:52.812811 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:52.812814 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:52.813185 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:52.813324 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:52.814748 (+ 1424us) server_negotiation.cc:299] Negotiation successful
0809 19:09:52.814966 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":24174,"thread_start_us":24043,"threads_started":1}
I20260809 19:09:52.814541 18954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:52.769470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.7.39.1:56347)
0809 19:09:52.780474 (+ 11004us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:52.784156 (+ 3682us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:52.786944 (+ 2788us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:52.793309 (+ 6365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:52.793315 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:52.793762 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:52.794325 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:52.794339 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.796111 (+ 1772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.796116 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:52.800227 (+ 4111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:52.800241 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.801325 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.801331 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:52.801507 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:52.802142 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:52.802163 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:52.806884 (+ 4721us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:52.811420 (+ 4536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:52.811426 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:52.811431 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:52.811920 (+ 489us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:52.812423 (+ 503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:52.812429 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:52.812433 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:52.812652 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:52.813389 (+ 737us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:52.813394 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:52.813565 (+ 171us) client_negotiation.cc:769] Sending connection context
0809 19:09:52.813737 (+ 172us) client_negotiation.cc:240] Negotiation successful
0809 19:09:52.814014 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10602,"thread_start_us":22641,"threads_started":1}
I20260809 19:09:52.816386 18968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:52.783478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:51125 (local address 127.7.39.60:36903)
0809 19:09:52.784073 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:52.784079 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:52.793514 (+ 9435us) server_negotiation.cc:407] Connection header received
0809 19:09:52.793640 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:52.793647 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:52.793728 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:52.793840 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:52.795908 (+ 2068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.797113 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.801037 (+ 3924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.801680 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.801782 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:52.809399 (+ 7617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:52.809407 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:52.809412 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:52.809456 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:52.813096 (+ 3640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:52.813986 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:52.813992 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:52.813995 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:52.814141 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:52.814696 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:52.814702 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:52.814705 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:52.815081 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:52.815215 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:52.815765 (+ 550us) server_negotiation.cc:299] Negotiation successful
0809 19:09:52.815989 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":240,"threads_started":1}
I20260809 19:09:52.816421 18944 heartbeater.cc:347] Connected to a master server at 127.7.39.62:33935
I20260809 19:09:52.816468 18946 heartbeater.cc:347] Connected to a master server at 127.7.39.61:46355
I20260809 19:09:52.816768 18946 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:52.816774 18944 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:52.817394 18952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:52.783957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:36903 (local address 127.7.39.1:51125)
0809 19:09:52.792543 (+ 8586us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:52.792559 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:52.792705 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:52.794244 (+ 1539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:52.794249 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:52.795078 (+ 829us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:52.795485 (+ 407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:52.795499 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.797315 (+ 1816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.797321 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:52.800827 (+ 3506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:52.800843 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.802132 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.802139 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:52.802412 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:52.803068 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:52.803095 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:52.809138 (+ 6043us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:52.813280 (+ 4142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:52.813285 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:52.813289 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:52.813834 (+ 545us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:52.814326 (+ 492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:52.814331 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:52.814339 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:52.814551 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:52.815305 (+ 754us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:52.815310 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:52.815455 (+ 145us) client_negotiation.cc:769] Sending connection context
0809 19:09:52.816632 (+ 1177us) client_negotiation.cc:240] Negotiation successful
0809 19:09:52.816920 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8452,"mutex_wait_us":1,"thread_start_us":7882,"threads_started":1}
I20260809 19:09:52.817876 18946 heartbeater.cc:511] Master 127.7.39.61:46355 requested a full tablet report, sending...
I20260809 19:09:52.817909 18944 heartbeater.cc:511] Master 127.7.39.62:33935 requested a full tablet report, sending...
I20260809 19:09:52.818605 18942 heartbeater.cc:347] Connected to a master server at 127.7.39.60:36903
I20260809 19:09:52.818704 18960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:52.775254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50756 (local address 127.7.39.2:46223)
0809 19:09:52.781666 (+ 6412us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:52.781676 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:52.781704 (+ 28us) server_negotiation.cc:407] Connection header received
0809 19:09:52.781996 (+ 292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:52.782007 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:52.787485 (+ 5478us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:52.787693 (+ 208us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:52.797517 (+ 9824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.800350 (+ 2833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.802412 (+ 2062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:52.803571 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:52.803717 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:52.809344 (+ 5627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:52.809357 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:52.809373 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:52.809411 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:52.813759 (+ 4348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:52.814701 (+ 942us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:52.814709 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:52.814713 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:52.814853 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:52.815282 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:52.815287 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:52.815290 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:52.816721 (+ 1431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:52.817006 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:52.818068 (+ 1062us) server_negotiation.cc:299] Negotiation successful
0809 19:09:52.818338 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5955,"thread_start_us":2885,"threads_started":1}
I20260809 19:09:52.818746 18942 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:52.819197 18942 heartbeater.cc:511] Master 127.7.39.60:36903 requested a full tablet report, sending...
I20260809 19:09:52.819943 17345 ts_manager.cc:194] Re-registered known tserver with Master: dcf1a29c27c44bbfabe9397a91a80197 (127.7.39.1:33499)
I20260809 19:09:52.819851 17878 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:52.821043 17345 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.39.1@KRBTEST.COM'} at 127.7.39.1:56347
I20260809 19:09:52.821043 18338 ts_manager.cc:194] Registered new tserver with Master: dcf1a29c27c44bbfabe9397a91a80197 (127.7.39.1:33499)
I20260809 19:09:52.821568 18637 ts_manager.cc:194] Registered new tserver with Master: dcf1a29c27c44bbfabe9397a91a80197 (127.7.39.1:33499)
I20260809 19:09:52.904713 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 17677
I20260809 19:09:52.927371 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.2:46223
--local_ip_for_outbound_sockets=127.7.39.2
--tserver_master_addrs=127.7.39.62:33935
--webserver_port=37123
--webserver_interface=127.7.39.2
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.2.keytab
--principal=oryx/127.7.39.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:42393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.7.39.62:33935,127.7.39.61:46355
--tserver_master_addrs=127.7.39.62:33935,127.7.39.61:46355,127.7.39.60:36903 with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 19:09:53.154748 18270 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1ea647a72fce400dad91d0cf80781fb0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false } } peers { permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438" member_type: NON_VOTER last_known_addr { host: "127.7.39.60" port: 36903 } attrs { promote: true } } }
I20260809 19:09:53.155169 18270 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:53.156469 18270 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0: attempting to promote NON_VOTER 7dc69093513f4aed81bf2c78f57e1438 to VOTER
I20260809 19:09:53.157271 18270 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false } } peers { permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 36903 } attrs { promote: false } }
I20260809 19:09:53.160090 18652 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [term 1 LEARNER]: Refusing update from remote peer 1ea647a72fce400dad91d0cf80781fb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260809 19:09:53.160346 18355 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [term 1 FOLLOWER]: Refusing update from remote peer 1ea647a72fce400dad91d0cf80781fb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260809 19:09:53.160724 18977 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 36903 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260809 19:09:53.161235 18270 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260809 19:09:53.168205 18270 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 7dc69093513f4aed81bf2c78f57e1438 (127.7.39.60) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false } } peers { permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 36903 } attrs { promote: false } } }
I20260809 19:09:53.170632 18652 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 7dc69093513f4aed81bf2c78f57e1438 (127.7.39.60) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false } } peers { permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 36903 } attrs { promote: false } } }
I20260809 19:09:53.178738 18355 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 7dc69093513f4aed81bf2c78f57e1438 (127.7.39.60) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false } } peers { permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 36903 } attrs { promote: false } } }
I20260809 19:09:53.179265 18977 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "1ea647a72fce400dad91d0cf80781fb0" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false } } peers { permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 36903 } attrs { promote: false } } }
I20260809 19:09:53.179795 18977 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:53.180249 18977 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1ea647a72fce400dad91d0cf80781fb0" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false } } peers { permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 36903 } attrs { promote: false } } }
I20260809 19:09:53.180567 18977 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:53.180462 18979 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1ea647a72fce400dad91d0cf80781fb0" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false } } peers { permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 36903 } attrs { promote: false } } }
I20260809 19:09:53.181278 18979 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0 [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:53.181809 18693 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1ea647a72fce400dad91d0cf80781fb0" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false } } peers { permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 36903 } attrs { promote: false } } }
I20260809 19:09:53.182098 18693 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:09:53.182987 18988 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1ea647a72fce400dad91d0cf80781fb0" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false } } peers { permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 36903 } attrs { promote: false } } }
I20260809 19:09:53.183362 18988 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [sys.catalog]: This master's current role is: FOLLOWER
W20260809 19:09:53.272992 18975 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:53.273252 18975 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:53.273391 18975 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:53.280898 18975 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:53.280999 18975 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:53.281116 18975 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.2
I20260809 19:09:53.290654 18975 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:42393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.2.keytab
--principal=oryx/127.7.39.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.2:46223
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.39.2
--webserver_port=37123
--tserver_master_addrs=127.7.39.62:33935,127.7.39.61:46355,127.7.39.60:36903
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.2
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:53.291831 18975 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:53.293084 18975 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:53.306591 18997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:53.306627 19000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:53.307188 18996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:53.307657 18975 server_base.cc:1034] running on GCE node
I20260809 19:09:53.308293 18975 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:53.309206 18975 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:53.310384 18975 hybrid_clock.cc:648] HybridClock initialized: now 1786302593310339 us; error 30 us; skew 500 ppm
I20260809 19:09:53.310711 18975 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:53 dist-test-slave-4tdj krb5kdc[17274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302593, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:53.313829 18975 init.cc:377] Logged in from keytab as oryx/127.7.39.2@KRBTEST.COM (short username oryx)
I20260809 19:09:53.315165 18975 webserver.cc:460] Webserver started at http://127.7.39.2:37123/ using document root <none> and password file <none>
I20260809 19:09:53.315804 18975 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:53.315929 18975 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:53.321198 18975 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 19:09:53.324261 19010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:53.325748 18975 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 19:09:53.325896 18975 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-1/wal
uuid: "30d1a3f78bbc4e4594806e0bbd55e46a"
format_stamp: "Formatted at 2026-08-09 19:09:50 on dist-test-slave-4tdj"
server_key: "5f3676797104d67614bb0544b5a0ac8a"
server_key_iv: "ceae07f347ad606daa747af0e658b3ec"
server_key_version: "encryptionkey@0"
I20260809 19:09:53.326933 18975 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:53.357120 18975 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:53.361078 18975 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:53.361354 18975 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:53.362349 18975 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:09:53.363795 18975 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:53.363894 18975 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:53.364010 18975 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:53.364096 18975 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:53.395790 18975 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.2:46223
I20260809 19:09:53.395849 19194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.2:46223 every 8 connection(s)
I20260809 19:09:53.397277 18975 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
I20260809 19:09:53.398335 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 18975
I20260809 19:09:53.398618 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 17893
Aug 09 19:09:53 dist-test-slave-4tdj krb5kdc[17274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302593, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.60@KRBTEST.COM
Aug 09 19:09:53 dist-test-slave-4tdj krb5kdc[17274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302588, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.39.3@KRBTEST.COM
I20260809 19:09:53.437922 19202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:53.400905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:36903 (local address 127.7.39.2:52901)
0809 19:09:53.414710 (+ 13805us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:53.414762 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:53.417286 (+ 2524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:53.418432 (+ 1146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:53.418444 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:53.419231 (+ 787us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:53.420062 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:53.420087 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:53.421805 (+ 1718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:53.421810 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:53.423905 (+ 2095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:53.423921 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:53.425117 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:53.425124 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:53.425437 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:53.426158 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:53.426186 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:53.429295 (+ 3109us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:53.433299 (+ 4004us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:53.433307 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:53.433322 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:53.433906 (+ 584us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:53.434395 (+ 489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:53.434399 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:53.434403 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:53.434625 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:53.435292 (+ 667us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:53.435298 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:53.435705 (+ 407us) client_negotiation.cc:769] Sending connection context
0809 19:09:53.435992 (+ 287us) client_negotiation.cc:240] Negotiation successful
0809 19:09:53.436486 (+ 494us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13519,"thread_start_us":13284,"threads_started":1}
Aug 09 19:09:53 dist-test-slave-4tdj krb5kdc[17274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302593, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM
I20260809 19:09:53.439082 19203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:53.401522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:52901 (local address 127.7.39.60:36903)
0809 19:09:53.414108 (+ 12586us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:53.414115 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:53.417659 (+ 3544us) server_negotiation.cc:407] Connection header received
0809 19:09:53.417738 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:53.417744 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:53.417832 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:53.417932 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:53.420340 (+ 2408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:53.421574 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:53.424081 (+ 2507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:53.424687 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:53.424774 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:53.429558 (+ 4784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:53.429566 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:53.429571 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:53.429613 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:53.433132 (+ 3519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:53.434059 (+ 927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:53.434065 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:53.434068 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:53.434225 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:53.434755 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:53.434760 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:53.434764 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:53.435077 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:53.435224 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:53.438493 (+ 3269us) server_negotiation.cc:299] Negotiation successful
0809 19:09:53.438722 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12444,"thread_start_us":12294,"threads_started":1}
I20260809 19:09:53.440574 19195 heartbeater.cc:347] Connected to a master server at 127.7.39.60:36903
I20260809 19:09:53.440836 19195 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:53.441704 19195 heartbeater.cc:511] Master 127.7.39.60:36903 requested a full tablet report, sending...
I20260809 19:09:53.443595 18637 ts_manager.cc:194] Registered new tserver with Master: 30d1a3f78bbc4e4594806e0bbd55e46a (127.7.39.2:46223)
Aug 09 19:09:53 dist-test-slave-4tdj krb5kdc[17274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302593, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.61@KRBTEST.COM
I20260809 19:09:53.447222 19207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:53.414173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:54807 (local address 127.7.39.62:33935)
0809 19:09:53.430898 (+ 16725us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:53.430904 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:53.430924 (+ 20us) server_negotiation.cc:407] Connection header received
0809 19:09:53.430982 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:53.430987 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:53.431079 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:53.432345 (+ 1266us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:53.432496 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:53.433511 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:53.435305 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:53.435902 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:53.436562 (+ 660us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:53.439688 (+ 3126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:53.439694 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:53.439698 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:53.439732 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:53.443557 (+ 3825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:53.444679 (+ 1122us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:53.444685 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:53.444689 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:53.444829 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:53.445942 (+ 1113us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:53.445946 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:53.445948 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:53.446254 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:53.446447 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:53.446825 (+ 378us) server_negotiation.cc:299] Negotiation successful
0809 19:09:53.446977 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16601,"thread_start_us":24288,"threads_started":1}
I20260809 19:09:53.447491 19212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:53.414183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.7.39.2:54807)
0809 19:09:53.427919 (+ 13736us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:53.427936 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:53.428049 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:53.431244 (+ 3195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:53.431249 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:53.431872 (+ 623us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:53.432191 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:53.432204 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:53.433664 (+ 1460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:53.433669 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:53.435136 (+ 1467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:53.435150 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:53.436103 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:53.436110 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:53.436280 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:53.436867 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:53.436888 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:53.439374 (+ 2486us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:53.443695 (+ 4321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:53.443700 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:53.443704 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:53.444237 (+ 533us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:53.444954 (+ 717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:53.444959 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:53.444963 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:53.445143 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:53.446398 (+ 1255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:53.446403 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:53.446573 (+ 170us) client_negotiation.cc:769] Sending connection context
0809 19:09:53.446719 (+ 146us) client_negotiation.cc:240] Negotiation successful
0809 19:09:53.446996 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13612,"thread_start_us":24110,"threads_started":1}
I20260809 19:09:53.448645 19197 heartbeater.cc:347] Connected to a master server at 127.7.39.62:33935
I20260809 19:09:53.448800 19197 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:53.449252 19197 heartbeater.cc:511] Master 127.7.39.62:33935 requested a full tablet report, sending...
I20260809 19:09:53.450150 19201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:53.399938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48418 (local address 127.7.39.3:37589)
0809 19:09:53.412148 (+ 12210us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:53.412158 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:53.419193 (+ 7035us) server_negotiation.cc:407] Connection header received
0809 19:09:53.420495 (+ 1302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:53.420506 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:53.420779 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:53.420942 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:53.423771 (+ 2829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:53.425517 (+ 1746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:53.430030 (+ 4513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:53.431134 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:53.431280 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:53.440120 (+ 8840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:53.440132 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:53.440144 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:53.440178 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:53.445133 (+ 4955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:53.445955 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:53.445963 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:53.445966 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:53.446120 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:53.447618 (+ 1498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:53.447625 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:53.447629 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:53.448069 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:53.448350 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:53.449225 (+ 875us) server_negotiation.cc:299] Negotiation successful
0809 19:09:53.449498 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12010,"thread_start_us":11835,"threads_started":1}
I20260809 19:09:53.450266 17345 ts_manager.cc:194] Re-registered known tserver with Master: 30d1a3f78bbc4e4594806e0bbd55e46a (127.7.39.2:46223)
I20260809 19:09:53.451324 17345 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.39.2@KRBTEST.COM'} at 127.7.39.2:54807
I20260809 19:09:53.451676 18101 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:53.456002 19202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:53.421473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:46355 (local address 127.7.39.2:59173)
0809 19:09:53.439380 (+ 17907us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:53.439397 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:53.439491 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:53.440417 (+ 926us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:53.440421 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:53.440844 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:53.441020 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:53.441031 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:53.442535 (+ 1504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:53.442553 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:53.443584 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:53.443596 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:53.444539 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:53.444545 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:53.444711 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:53.445263 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:53.445284 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:53.447976 (+ 2692us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:53.453199 (+ 5223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:53.453205 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:53.453210 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:53.453929 (+ 719us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:53.454378 (+ 449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:53.454381 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:53.454384 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:53.454579 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:53.455209 (+ 630us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:53.455212 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:53.455343 (+ 131us) client_negotiation.cc:769] Sending connection context
0809 19:09:53.455485 (+ 142us) client_negotiation.cc:240] Negotiation successful
0809 19:09:53.455710 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16769,"thread_start_us":4566,"threads_started":1}
I20260809 19:09:53.456241 19210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:53.415489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:59173 (local address 127.7.39.61:46355)
0809 19:09:53.430511 (+ 15022us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:53.430518 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:53.439496 (+ 8978us) server_negotiation.cc:407] Connection header received
0809 19:09:53.439610 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:53.439615 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:53.439723 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:53.439842 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:53.441237 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:53.442366 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:53.443767 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:53.444380 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:53.444543 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:53.448147 (+ 3604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:53.448152 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:53.448155 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:53.448187 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:53.452999 (+ 4812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:53.454073 (+ 1074us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:53.454078 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:53.454082 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:53.454247 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:53.454686 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:53.454692 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:53.454695 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:53.455105 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:53.455268 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:53.455597 (+ 329us) server_negotiation.cc:299] Negotiation successful
0809 19:09:53.455832 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12849,"thread_start_us":13019,"threads_started":1}
I20260809 19:09:53.457126 19198 heartbeater.cc:347] Connected to a master server at 127.7.39.61:46355
I20260809 19:09:53.457260 19198 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:53.457762 19198 heartbeater.cc:511] Master 127.7.39.61:46355 requested a full tablet report, sending...
I20260809 19:09:53.458868 18338 ts_manager.cc:194] Registered new tserver with Master: 30d1a3f78bbc4e4594806e0bbd55e46a (127.7.39.2:46223)
I20260809 19:09:53.547451 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 17893
I20260809 19:09:53.568879 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.3:37589
--local_ip_for_outbound_sockets=127.7.39.3
--tserver_master_addrs=127.7.39.62:33935
--webserver_port=40111
--webserver_interface=127.7.39.3
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.3.keytab
--principal=oryx/127.7.39.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:42393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.7.39.62:33935,127.7.39.61:46355
--tserver_master_addrs=127.7.39.62:33935,127.7.39.61:46355,127.7.39.60:36903 with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 19:09:53.823792 18944 heartbeater.cc:503] Master 127.7.39.62:33935 was elected leader, sending a full tablet report...
W20260809 19:09:53.901646 19217 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:53.901988 19217 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:53.902102 19217 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:53.909265 19217 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:53.909363 19217 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:53.909479 19217 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.3
I20260809 19:09:53.919245 19217 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:42393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.3.keytab
--principal=oryx/127.7.39.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.3:37589
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.39.3
--webserver_port=40111
--tserver_master_addrs=127.7.39.62:33935,127.7.39.61:46355,127.7.39.60:36903
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.3
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:53.920436 19217 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:53.921685 19217 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:53.934664 19225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:53.934872 19228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:53.935268 19226 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:53.936483 19217 server_base.cc:1034] running on GCE node
I20260809 19:09:53.937074 19217 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:53.937943 19217 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:53.939146 19217 hybrid_clock.cc:648] HybridClock initialized: now 1786302593939085 us; error 52 us; skew 500 ppm
I20260809 19:09:53.939433 19217 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:53 dist-test-slave-4tdj krb5kdc[17274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302593, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:53.942373 19217 init.cc:377] Logged in from keytab as oryx/127.7.39.3@KRBTEST.COM (short username oryx)
I20260809 19:09:53.943668 19217 webserver.cc:460] Webserver started at http://127.7.39.3:40111/ using document root <none> and password file <none>
I20260809 19:09:53.944330 19217 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:53.944458 19217 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:53.950038 19217 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 19:09:53.953246 19237 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:53.954671 19217 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 19:09:53.954823 19217 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-2/wal
uuid: "fd4789b5fa2f4f5682434dedf03355a9"
format_stamp: "Formatted at 2026-08-09 19:09:50 on dist-test-slave-4tdj"
server_key: "31248fcaaadaa2f55462730ce3d7d5e7"
server_key_iv: "5d34938d06269c7b01c61cb0fed443e4"
server_key_version: "encryptionkey@0"
I20260809 19:09:53.955778 19217 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:53.966921 19217 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:53.970839 19217 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:53.971095 19217 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:53.972096 19217 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:09:53.973421 19217 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:53.973515 19217 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:53.973621 19217 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:53.973691 19217 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:54.004818 19217 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.3:37589
I20260809 19:09:54.004875 19407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.3:37589 every 8 connection(s)
I20260809 19:09:54.006261 19217 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
I20260809 19:09:54.010686 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 19217
Aug 09 19:09:54 dist-test-slave-4tdj krb5kdc[17274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302593, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM
Aug 09 19:09:54 dist-test-slave-4tdj krb5kdc[17274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302593, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.60@KRBTEST.COM
I20260809 19:09:54.052906 19415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:54.009123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:51739 (local address 127.7.39.62:33935)
0809 19:09:54.025618 (+ 16495us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:54.025625 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:54.025651 (+ 26us) server_negotiation.cc:407] Connection header received
0809 19:09:54.025723 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:54.025728 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:54.025830 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:54.025970 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:54.031819 (+ 5849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.033047 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.034806 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.035528 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.035656 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:54.043857 (+ 8201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:54.043865 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:54.043870 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:54.043932 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:54.048196 (+ 4264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:54.049969 (+ 1773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:54.049975 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:54.049979 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:54.050154 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:54.050609 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:54.050614 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:54.050617 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:54.050952 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:54.051091 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:54.052219 (+ 1128us) server_negotiation.cc:299] Negotiation successful
0809 19:09:54.052489 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16341,"thread_start_us":16948,"threads_started":1}
Aug 09 19:09:54 dist-test-slave-4tdj krb5kdc[17274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302593, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.61@KRBTEST.COM
I20260809 19:09:54.054070 19419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:54.009782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.7.39.3:51739)
0809 19:09:54.021745 (+ 11963us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:54.021812 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:54.024521 (+ 2709us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:54.029010 (+ 4489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:54.029018 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:54.029530 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:54.030278 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:54.030321 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.033187 (+ 2866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.033193 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:54.034640 (+ 1447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:54.034656 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.037454 (+ 2798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.037460 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:54.037626 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:54.039978 (+ 2352us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:54.040031 (+ 53us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:54.043587 (+ 3556us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:54.049262 (+ 5675us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:54.049272 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:54.049291 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:54.049859 (+ 568us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:54.050254 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:54.050259 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:54.050263 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:54.050507 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:54.051358 (+ 851us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:54.051367 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:54.051789 (+ 422us) client_negotiation.cc:769] Sending connection context
0809 19:09:54.052117 (+ 328us) client_negotiation.cc:240] Negotiation successful
0809 19:09:54.052656 (+ 539us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11611,"mutex_wait_us":26,"spinlock_wait_cycles":1920,"thread_start_us":11361,"threads_started":1}
I20260809 19:09:54.055904 19409 heartbeater.cc:347] Connected to a master server at 127.7.39.62:33935
I20260809 19:09:54.056260 19409 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:54.057649 19424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:54.027105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:51223 (local address 127.7.39.60:36903)
0809 19:09:54.027837 (+ 732us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:54.027843 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:54.028441 (+ 598us) server_negotiation.cc:407] Connection header received
0809 19:09:54.028582 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:54.028589 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:54.028658 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:54.028743 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:54.030922 (+ 2179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.032019 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.036186 (+ 4167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.036813 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.036902 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:54.045509 (+ 8607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:54.045516 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:54.045520 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:54.045562 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:54.049090 (+ 3528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:54.051015 (+ 1925us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:54.051033 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:54.051036 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:54.051211 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:54.054931 (+ 3720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:54.054937 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:54.054941 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:54.055327 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:54.055462 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:54.056033 (+ 571us) server_negotiation.cc:299] Negotiation successful
0809 19:09:54.057228 (+ 1195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":624,"thread_start_us":499,"threads_started":1}
I20260809 19:09:54.058842 19430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:54.027819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:36903 (local address 127.7.39.3:51223)
0809 19:09:54.028341 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:54.028355 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:54.028472 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:54.028786 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:54.028790 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:54.030499 (+ 1709us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:54.030781 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:54.030790 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.034566 (+ 3776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.034571 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:54.036016 (+ 1445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:54.036032 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.037230 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.037237 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:54.037522 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:54.040119 (+ 2597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:54.040135 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:54.045286 (+ 5151us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:54.049994 (+ 4708us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:54.049999 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:54.050002 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:54.050892 (+ 890us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:54.054610 (+ 3718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:54.054615 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:54.054619 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:54.054799 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:54.055549 (+ 750us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:54.055554 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:54.055687 (+ 133us) client_negotiation.cc:769] Sending connection context
0809 19:09:54.058115 (+ 2428us) client_negotiation.cc:240] Negotiation successful
0809 19:09:54.058409 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":415,"spinlock_wait_cycles":1170688,"thread_start_us":275,"threads_started":1}
I20260809 19:09:54.058913 19409 heartbeater.cc:511] Master 127.7.39.62:33935 requested a full tablet report, sending...
I20260809 19:09:54.060789 17345 ts_manager.cc:194] Re-registered known tserver with Master: fd4789b5fa2f4f5682434dedf03355a9 (127.7.39.3:37589)
I20260809 19:09:54.061946 17345 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.39.3@KRBTEST.COM'} at 127.7.39.3:51739
I20260809 19:09:54.062330 19408 heartbeater.cc:347] Connected to a master server at 127.7.39.60:36903
I20260809 19:09:54.062458 19408 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:54.062912 19408 heartbeater.cc:511] Master 127.7.39.60:36903 requested a full tablet report, sending...
I20260809 19:09:54.064615 19416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:54.009238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:51979 (local address 127.7.39.61:46355)
0809 19:09:54.027366 (+ 18128us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:54.027373 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:54.027393 (+ 20us) server_negotiation.cc:407] Connection header received
0809 19:09:54.027465 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:54.027470 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:54.027557 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:54.027669 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:54.030503 (+ 2834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.031618 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.037953 (+ 6335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.038634 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.038733 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:54.056241 (+ 17508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:54.056248 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:54.056253 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:54.056312 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:54.060716 (+ 4404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:54.061625 (+ 909us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:54.061631 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:54.061634 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:54.061792 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:54.062312 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:54.062318 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:54.062321 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:54.062672 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:54.062863 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:54.064031 (+ 1168us) server_negotiation.cc:299] Negotiation successful
0809 19:09:54.064255 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17988,"thread_start_us":17877,"threads_started":1}
I20260809 19:09:54.066169 19420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:54.009782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:46355 (local address 127.7.39.3:51979)
0809 19:09:54.026776 (+ 16994us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:54.026796 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:54.026915 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:54.028153 (+ 1238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:54.028167 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:54.029320 (+ 1153us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:54.030272 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:54.030326 (+ 54us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.032220 (+ 1894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.032226 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:54.034398 (+ 2172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:54.034413 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.039080 (+ 4667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.039087 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:54.039259 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:54.040001 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:54.040020 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:54.056056 (+ 16036us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:54.060988 (+ 4932us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:54.060992 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:54.060995 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:54.061470 (+ 475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:54.061934 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:54.061939 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:54.061942 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:54.062145 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:54.062951 (+ 806us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:54.062955 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:54.063706 (+ 751us) client_negotiation.cc:769] Sending connection context
0809 19:09:54.065099 (+ 1393us) client_negotiation.cc:240] Negotiation successful
0809 19:09:54.065667 (+ 568us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16826,"mutex_wait_us":101,"spinlock_wait_cycles":539648,"thread_start_us":16518,"threads_started":1}
I20260809 19:09:54.066174 18637 ts_manager.cc:194] Registered new tserver with Master: fd4789b5fa2f4f5682434dedf03355a9 (127.7.39.3:37589)
I20260809 19:09:54.067289 19413 heartbeater.cc:347] Connected to a master server at 127.7.39.61:46355
I20260809 19:09:54.067407 19413 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:54.067800 19413 heartbeater.cc:511] Master 127.7.39.61:46355 requested a full tablet report, sending...
I20260809 19:09:54.068948 18338 ts_manager.cc:194] Registered new tserver with Master: fd4789b5fa2f4f5682434dedf03355a9 (127.7.39.3:37589)
I20260809 19:09:54.075055 19415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:54.031400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34236 (local address 127.7.39.62:33935)
0809 19:09:54.053152 (+ 21752us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:54.053157 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:54.053176 (+ 19us) server_negotiation.cc:407] Connection header received
0809 19:09:54.053220 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:54.053225 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:54.053292 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:54.053384 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:54.060946 (+ 7562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.062082 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.063925 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.064535 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.064632 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:54.068129 (+ 3497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:54.068135 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:54.068140 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:54.068175 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:54.071439 (+ 3264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:54.072667 (+ 1228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:54.072673 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:54.072677 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:54.072819 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:54.073302 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:54.073307 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:54.073311 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:54.073702 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:54.073948 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:54.074488 (+ 540us) server_negotiation.cc:299] Negotiation successful
0809 19:09:54.074713 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21634,"thread_start_us":40187,"threads_started":1}
I20260809 19:09:54.080359 19439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:54.038278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39016 (local address 127.7.39.60:36903)
0809 19:09:54.057532 (+ 19254us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:54.057538 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:54.058330 (+ 792us) server_negotiation.cc:407] Connection header received
0809 19:09:54.058387 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:54.058391 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:54.058454 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:54.058543 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:54.066794 (+ 8251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.067796 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.069837 (+ 2041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.070641 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.070762 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:54.074241 (+ 3479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:54.074246 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:54.074249 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:54.074277 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:54.077402 (+ 3125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:54.078160 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:54.078166 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:54.078169 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:54.078336 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:54.078801 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:54.078806 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:54.078809 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:54.079167 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:54.079366 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:54.079808 (+ 442us) server_negotiation.cc:299] Negotiation successful
0809 19:09:54.080001 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19123,"thread_start_us":19410,"threads_started":1}
I20260809 19:09:54.082353 19437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:54.034973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51618 (local address 127.7.39.61:46355)
0809 19:09:54.063148 (+ 28175us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:54.063153 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:54.063171 (+ 18us) server_negotiation.cc:407] Connection header received
0809 19:09:54.063214 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:54.063219 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:54.063280 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:54.067116 (+ 3836us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:54.067314 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.068410 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.070483 (+ 2073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.071154 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.071849 (+ 695us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:54.074356 (+ 2507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:54.074363 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:54.074368 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:54.074405 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:54.078700 (+ 4295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:54.079583 (+ 883us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:54.079588 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:54.079591 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:54.079752 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:54.080231 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:54.080236 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:54.080239 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:54.080555 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:54.081623 (+ 1068us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:54.081740 (+ 117us) server_negotiation.cc:299] Negotiation successful
0809 19:09:54.081935 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28043,"thread_start_us":28392,"threads_started":1}
I20260809 19:09:54.080216 17345 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34236:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:09:54.089776 17345 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:09:54.128105 19457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:54.108185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:33499 (local address 127.0.0.1:44788)
0809 19:09:54.111849 (+ 3664us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:54.111869 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:54.112036 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:54.116778 (+ 4742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:54.116784 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:54.116816 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:54.117555 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:54.117570 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.120750 (+ 3180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.120755 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:54.124615 (+ 3860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:54.124630 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.127181 (+ 2551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.127187 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:54.127377 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:54.127413 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 19:09:54.127499 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 19:09:54.127635 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3426,"thread_start_us":14635,"threads_started":1}
I20260809 19:09:54.128535 19456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:54.108555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44788 (local address 127.7.39.1:33499)
0809 19:09:54.116013 (+ 7458us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:54.116033 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:54.116067 (+ 34us) server_negotiation.cc:407] Connection header received
0809 19:09:54.116203 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:54.116213 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:54.116501 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:54.117821 (+ 1320us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:54.119109 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.120597 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.124810 (+ 4213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.126983 (+ 2173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.127127 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:54.127588 (+ 461us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:54.127731 (+ 143us) server_negotiation.cc:299] Negotiation successful
0809 19:09:54.127953 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7253,"thread_start_us":7122,"threads_started":1}
I20260809 19:09:54.132545 19452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:54.107277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:46223 (local address 127.0.0.1:50758)
0809 19:09:54.108648 (+ 1371us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:54.108671 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:54.108842 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:54.121879 (+ 13037us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:54.121884 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:54.121912 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:54.122665 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:54.122680 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.125075 (+ 2395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.125079 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:54.126893 (+ 1814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:54.126905 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.131577 (+ 4672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.131585 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:54.131799 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:54.131867 (+ 68us) client_negotiation.cc:769] Sending connection context
0809 19:09:54.131948 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 19:09:54.132091 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1152,"thread_start_us":3060,"threads_started":1}
I20260809 19:09:54.134158 19453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:54.107826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50758 (local address 127.7.39.2:46223)
0809 19:09:54.121225 (+ 13399us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:54.121234 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:54.121267 (+ 33us) server_negotiation.cc:407] Connection header received
0809 19:09:54.121372 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:54.121380 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:54.121652 (+ 272us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:54.122009 (+ 357us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:54.122833 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.124912 (+ 2079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.127056 (+ 2144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.131282 (+ 4226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.132931 (+ 1649us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:54.133177 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:54.133255 (+ 78us) server_negotiation.cc:299] Negotiation successful
0809 19:09:54.133439 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13220,"thread_start_us":13414,"threads_started":1}
I20260809 19:09:54.133803 18827 tablet_service.cc:1467] Processing CreateTablet for tablet 0de61fc46e1541bfb956d0f28acd7ef3 (DEFAULT_TABLE table=test-table [id=143b9b9123584e1cab5ccc69b2e3c909]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:09:54.135810 18827 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0de61fc46e1541bfb956d0f28acd7ef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:54.136574 19454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:54.110741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:37589 (local address 127.0.0.1:48430)
0809 19:09:54.122653 (+ 11912us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:54.122674 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:54.122988 (+ 314us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:54.124093 (+ 1105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:54.124096 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:54.124118 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:54.124810 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:54.124826 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.127740 (+ 2914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.127745 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:54.131149 (+ 3404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:54.131164 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.134191 (+ 3027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.134200 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:54.135957 (+ 1757us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:54.135991 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 19:09:54.136090 (+ 99us) client_negotiation.cc:240] Negotiation successful
0809 19:09:54.136219 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11750,"thread_start_us":3596,"threads_started":1}
I20260809 19:09:54.137063 19459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:54.111434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48430 (local address 127.7.39.3:37589)
0809 19:09:54.117667 (+ 6233us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:54.117678 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:54.122791 (+ 5113us) server_negotiation.cc:407] Connection header received
0809 19:09:54.123253 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:54.123261 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:54.123488 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:54.123656 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:54.125293 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.127497 (+ 2204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.131357 (+ 3860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.133576 (+ 2219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.133714 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:54.133936 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:54.136183 (+ 2247us) server_negotiation.cc:299] Negotiation successful
0809 19:09:54.136391 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6009,"thread_start_us":5752,"threads_started":1}
I20260809 19:09:54.138481 19090 tablet_service.cc:1467] Processing CreateTablet for tablet 0de61fc46e1541bfb956d0f28acd7ef3 (DEFAULT_TABLE table=test-table [id=143b9b9123584e1cab5ccc69b2e3c909]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:09:54.139741 19090 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0de61fc46e1541bfb956d0f28acd7ef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:54.141475 19315 tablet_service.cc:1467] Processing CreateTablet for tablet 0de61fc46e1541bfb956d0f28acd7ef3 (DEFAULT_TABLE table=test-table [id=143b9b9123584e1cab5ccc69b2e3c909]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:09:54.143617 19315 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0de61fc46e1541bfb956d0f28acd7ef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:54.156165 19460 tablet_bootstrap.cc:492] T 0de61fc46e1541bfb956d0f28acd7ef3 P dcf1a29c27c44bbfabe9397a91a80197: Bootstrap starting.
I20260809 19:09:54.159189 19461 tablet_bootstrap.cc:492] T 0de61fc46e1541bfb956d0f28acd7ef3 P 30d1a3f78bbc4e4594806e0bbd55e46a: Bootstrap starting.
I20260809 19:09:54.160816 19460 tablet_bootstrap.cc:654] T 0de61fc46e1541bfb956d0f28acd7ef3 P dcf1a29c27c44bbfabe9397a91a80197: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:54.162024 19460 log.cc:824] T 0de61fc46e1541bfb956d0f28acd7ef3 P dcf1a29c27c44bbfabe9397a91a80197: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:54.162784 19461 tablet_bootstrap.cc:654] T 0de61fc46e1541bfb956d0f28acd7ef3 P 30d1a3f78bbc4e4594806e0bbd55e46a: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:54.164084 19461 log.cc:824] T 0de61fc46e1541bfb956d0f28acd7ef3 P 30d1a3f78bbc4e4594806e0bbd55e46a: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:54.167924 19461 tablet_bootstrap.cc:492] T 0de61fc46e1541bfb956d0f28acd7ef3 P 30d1a3f78bbc4e4594806e0bbd55e46a: No bootstrap required, opened a new log
I20260809 19:09:54.168215 19461 ts_tablet_manager.cc:1397] T 0de61fc46e1541bfb956d0f28acd7ef3 P 30d1a3f78bbc4e4594806e0bbd55e46a: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.006s
I20260809 19:09:54.168882 19464 tablet_bootstrap.cc:492] T 0de61fc46e1541bfb956d0f28acd7ef3 P fd4789b5fa2f4f5682434dedf03355a9: Bootstrap starting.
I20260809 19:09:54.172379 19464 tablet_bootstrap.cc:654] T 0de61fc46e1541bfb956d0f28acd7ef3 P fd4789b5fa2f4f5682434dedf03355a9: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:54.173574 19464 log.cc:824] T 0de61fc46e1541bfb956d0f28acd7ef3 P fd4789b5fa2f4f5682434dedf03355a9: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:54.178761 19460 tablet_bootstrap.cc:492] T 0de61fc46e1541bfb956d0f28acd7ef3 P dcf1a29c27c44bbfabe9397a91a80197: No bootstrap required, opened a new log
I20260809 19:09:54.179020 19460 ts_tablet_manager.cc:1397] T 0de61fc46e1541bfb956d0f28acd7ef3 P dcf1a29c27c44bbfabe9397a91a80197: Time spent bootstrapping tablet: real 0.023s user 0.014s sys 0.008s
I20260809 19:09:54.178683 19461 raft_consensus.cc:348] T 0de61fc46e1541bfb956d0f28acd7ef3 P 30d1a3f78bbc4e4594806e0bbd55e46a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d1a3f78bbc4e4594806e0bbd55e46a" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46223 } } peers { permanent_uuid: "fd4789b5fa2f4f5682434dedf03355a9" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 37589 } } peers { permanent_uuid: "dcf1a29c27c44bbfabe9397a91a80197" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33499 } }
I20260809 19:09:54.179210 19461 raft_consensus.cc:374] T 0de61fc46e1541bfb956d0f28acd7ef3 P 30d1a3f78bbc4e4594806e0bbd55e46a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:54.179316 19461 raft_consensus.cc:729] T 0de61fc46e1541bfb956d0f28acd7ef3 P 30d1a3f78bbc4e4594806e0bbd55e46a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30d1a3f78bbc4e4594806e0bbd55e46a, State: Initialized, Role: FOLLOWER
I20260809 19:09:54.180073 19464 tablet_bootstrap.cc:492] T 0de61fc46e1541bfb956d0f28acd7ef3 P fd4789b5fa2f4f5682434dedf03355a9: No bootstrap required, opened a new log
I20260809 19:09:54.180001 19461 consensus_queue.cc:260] T 0de61fc46e1541bfb956d0f28acd7ef3 P 30d1a3f78bbc4e4594806e0bbd55e46a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d1a3f78bbc4e4594806e0bbd55e46a" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46223 } } peers { permanent_uuid: "fd4789b5fa2f4f5682434dedf03355a9" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 37589 } } peers { permanent_uuid: "dcf1a29c27c44bbfabe9397a91a80197" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33499 } }
I20260809 19:09:54.180330 19464 ts_tablet_manager.cc:1397] T 0de61fc46e1541bfb956d0f28acd7ef3 P fd4789b5fa2f4f5682434dedf03355a9: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.006s
I20260809 19:09:54.190220 19461 ts_tablet_manager.cc:1428] T 0de61fc46e1541bfb956d0f28acd7ef3 P 30d1a3f78bbc4e4594806e0bbd55e46a: Time spent starting tablet: real 0.022s user 0.011s sys 0.011s
I20260809 19:09:54.190877 19197 heartbeater.cc:503] Master 127.7.39.62:33935 was elected leader, sending a full tablet report...
I20260809 19:09:54.196018 19464 raft_consensus.cc:348] T 0de61fc46e1541bfb956d0f28acd7ef3 P fd4789b5fa2f4f5682434dedf03355a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d1a3f78bbc4e4594806e0bbd55e46a" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46223 } } peers { permanent_uuid: "fd4789b5fa2f4f5682434dedf03355a9" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 37589 } } peers { permanent_uuid: "dcf1a29c27c44bbfabe9397a91a80197" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33499 } }
I20260809 19:09:54.196238 19460 raft_consensus.cc:348] T 0de61fc46e1541bfb956d0f28acd7ef3 P dcf1a29c27c44bbfabe9397a91a80197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d1a3f78bbc4e4594806e0bbd55e46a" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46223 } } peers { permanent_uuid: "fd4789b5fa2f4f5682434dedf03355a9" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 37589 } } peers { permanent_uuid: "dcf1a29c27c44bbfabe9397a91a80197" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33499 } }
I20260809 19:09:54.196587 19464 raft_consensus.cc:374] T 0de61fc46e1541bfb956d0f28acd7ef3 P fd4789b5fa2f4f5682434dedf03355a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:54.196745 19464 raft_consensus.cc:729] T 0de61fc46e1541bfb956d0f28acd7ef3 P fd4789b5fa2f4f5682434dedf03355a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4789b5fa2f4f5682434dedf03355a9, State: Initialized, Role: FOLLOWER
I20260809 19:09:54.196822 19460 raft_consensus.cc:374] T 0de61fc46e1541bfb956d0f28acd7ef3 P dcf1a29c27c44bbfabe9397a91a80197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:54.196956 19460 raft_consensus.cc:729] T 0de61fc46e1541bfb956d0f28acd7ef3 P dcf1a29c27c44bbfabe9397a91a80197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcf1a29c27c44bbfabe9397a91a80197, State: Initialized, Role: FOLLOWER
I20260809 19:09:54.197492 19464 consensus_queue.cc:260] T 0de61fc46e1541bfb956d0f28acd7ef3 P fd4789b5fa2f4f5682434dedf03355a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d1a3f78bbc4e4594806e0bbd55e46a" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46223 } } peers { permanent_uuid: "fd4789b5fa2f4f5682434dedf03355a9" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 37589 } } peers { permanent_uuid: "dcf1a29c27c44bbfabe9397a91a80197" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33499 } }
I20260809 19:09:54.197727 19460 consensus_queue.cc:260] T 0de61fc46e1541bfb956d0f28acd7ef3 P dcf1a29c27c44bbfabe9397a91a80197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d1a3f78bbc4e4594806e0bbd55e46a" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46223 } } peers { permanent_uuid: "fd4789b5fa2f4f5682434dedf03355a9" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 37589 } } peers { permanent_uuid: "dcf1a29c27c44bbfabe9397a91a80197" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33499 } }
I20260809 19:09:54.199652 19460 ts_tablet_manager.cc:1428] T 0de61fc46e1541bfb956d0f28acd7ef3 P dcf1a29c27c44bbfabe9397a91a80197: Time spent starting tablet: real 0.021s user 0.007s sys 0.009s
I20260809 19:09:54.199651 19464 ts_tablet_manager.cc:1428] T 0de61fc46e1541bfb956d0f28acd7ef3 P fd4789b5fa2f4f5682434dedf03355a9: Time spent starting tablet: real 0.019s user 0.013s sys 0.003s
I20260809 19:09:54.200354 19409 heartbeater.cc:503] Master 127.7.39.62:33935 was elected leader, sending a full tablet report...
I20260809 19:09:54.243476 19469 raft_consensus.cc:482] T 0de61fc46e1541bfb956d0f28acd7ef3 P 30d1a3f78bbc4e4594806e0bbd55e46a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:09:54.243813 19469 raft_consensus.cc:504] T 0de61fc46e1541bfb956d0f28acd7ef3 P 30d1a3f78bbc4e4594806e0bbd55e46a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d1a3f78bbc4e4594806e0bbd55e46a" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46223 } } peers { permanent_uuid: "fd4789b5fa2f4f5682434dedf03355a9" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 37589 } } peers { permanent_uuid: "dcf1a29c27c44bbfabe9397a91a80197" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33499 } }
I20260809 19:09:54.245894 19469 leader_election.cc:288] T 0de61fc46e1541bfb956d0f28acd7ef3 P 30d1a3f78bbc4e4594806e0bbd55e46a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd4789b5fa2f4f5682434dedf03355a9 (127.7.39.3:37589), dcf1a29c27c44bbfabe9397a91a80197 (127.7.39.1:33499)
I20260809 19:09:54.253298 19456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:54.246083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:53297 (local address 127.7.39.1:33499)
0809 19:09:54.246278 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:54.246284 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:54.247419 (+ 1135us) server_negotiation.cc:407] Connection header received
0809 19:09:54.247637 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:54.247643 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:54.247704 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:54.247781 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:54.248426 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.249170 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.251324 (+ 2154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.252230 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.252329 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:54.252407 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:54.252893 (+ 486us) server_negotiation.cc:299] Negotiation successful
0809 19:09:54.253039 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 19:09:54.253681 19476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:54.246612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:33499 (local address 127.7.39.2:53297)
0809 19:09:54.247308 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:54.247322 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:54.247500 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:54.247810 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:54.247814 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:54.247837 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:54.248268 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:54.248278 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.249316 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.249320 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:54.251172 (+ 1852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:54.251184 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.252530 (+ 1346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.252539 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:54.252718 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:54.252754 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 19:09:54.252851 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 19:09:54.252958 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"spinlock_wait_cycles":38144,"thread_start_us":435,"threads_started":1}
I20260809 19:09:54.253799 19459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:54.245977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:45199 (local address 127.7.39.3:37589)
0809 19:09:54.246209 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:54.246215 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:54.247392 (+ 1177us) server_negotiation.cc:407] Connection header received
0809 19:09:54.247639 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:54.247643 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:54.247700 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:54.247770 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:54.248401 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.249149 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.251449 (+ 2300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.252632 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.252754 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:54.252852 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:54.253452 (+ 600us) server_negotiation.cc:299] Negotiation successful
0809 19:09:54.253573 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260809 19:09:54.254329 19475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:54.246020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:37589 (local address 127.7.39.2:45199)
0809 19:09:54.247261 (+ 1241us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:54.247281 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:54.247482 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:54.247799 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:54.247803 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:54.247826 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:54.248259 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:54.248269 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.249270 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.249275 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:54.251300 (+ 2025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:54.251315 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.252978 (+ 1663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.252986 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:54.253245 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:54.253278 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 19:09:54.253388 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 19:09:54.253540 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1042,"spinlock_wait_cycles":896,"thread_start_us":678,"threads_started":1}
I20260809 19:09:54.255250 18867 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0de61fc46e1541bfb956d0f28acd7ef3" candidate_uuid: "30d1a3f78bbc4e4594806e0bbd55e46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcf1a29c27c44bbfabe9397a91a80197" is_pre_election: true
I20260809 19:09:54.255597 19343 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0de61fc46e1541bfb956d0f28acd7ef3" candidate_uuid: "30d1a3f78bbc4e4594806e0bbd55e46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4789b5fa2f4f5682434dedf03355a9" is_pre_election: true
I20260809 19:09:54.256143 18867 raft_consensus.cc:2454] T 0de61fc46e1541bfb956d0f28acd7ef3 P dcf1a29c27c44bbfabe9397a91a80197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30d1a3f78bbc4e4594806e0bbd55e46a in term 0.
I20260809 19:09:54.256575 19343 raft_consensus.cc:2454] T 0de61fc46e1541bfb956d0f28acd7ef3 P fd4789b5fa2f4f5682434dedf03355a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30d1a3f78bbc4e4594806e0bbd55e46a in term 0.
I20260809 19:09:54.257055 19015 leader_election.cc:302] T 0de61fc46e1541bfb956d0f28acd7ef3 P 30d1a3f78bbc4e4594806e0bbd55e46a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30d1a3f78bbc4e4594806e0bbd55e46a, dcf1a29c27c44bbfabe9397a91a80197; no voters:
I20260809 19:09:54.257529 19469 raft_consensus.cc:2781] T 0de61fc46e1541bfb956d0f28acd7ef3 P 30d1a3f78bbc4e4594806e0bbd55e46a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:09:54.257754 19469 raft_consensus.cc:482] T 0de61fc46e1541bfb956d0f28acd7ef3 P 30d1a3f78bbc4e4594806e0bbd55e46a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:09:54.257887 19469 raft_consensus.cc:3037] T 0de61fc46e1541bfb956d0f28acd7ef3 P 30d1a3f78bbc4e4594806e0bbd55e46a [term 0 FOLLOWER]: Advancing to term 1
W20260809 19:09:54.258699 19414 tablet.cc:2369] T 0de61fc46e1541bfb956d0f28acd7ef3 P fd4789b5fa2f4f5682434dedf03355a9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:09:54.261070 19469 raft_consensus.cc:504] T 0de61fc46e1541bfb956d0f28acd7ef3 P 30d1a3f78bbc4e4594806e0bbd55e46a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d1a3f78bbc4e4594806e0bbd55e46a" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46223 } } peers { permanent_uuid: "fd4789b5fa2f4f5682434dedf03355a9" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 37589 } } peers { permanent_uuid: "dcf1a29c27c44bbfabe9397a91a80197" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33499 } }
I20260809 19:09:54.261693 19469 leader_election.cc:288] T 0de61fc46e1541bfb956d0f28acd7ef3 P 30d1a3f78bbc4e4594806e0bbd55e46a [CANDIDATE]: Term 1 election: Requested vote from peers fd4789b5fa2f4f5682434dedf03355a9 (127.7.39.3:37589), dcf1a29c27c44bbfabe9397a91a80197 (127.7.39.1:33499)
I20260809 19:09:54.262178 19343 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0de61fc46e1541bfb956d0f28acd7ef3" candidate_uuid: "30d1a3f78bbc4e4594806e0bbd55e46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4789b5fa2f4f5682434dedf03355a9"
I20260809 19:09:54.262251 18867 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0de61fc46e1541bfb956d0f28acd7ef3" candidate_uuid: "30d1a3f78bbc4e4594806e0bbd55e46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcf1a29c27c44bbfabe9397a91a80197"
I20260809 19:09:54.262460 19343 raft_consensus.cc:3037] T 0de61fc46e1541bfb956d0f28acd7ef3 P fd4789b5fa2f4f5682434dedf03355a9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:54.262488 18867 raft_consensus.cc:3037] T 0de61fc46e1541bfb956d0f28acd7ef3 P dcf1a29c27c44bbfabe9397a91a80197 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:54.265729 19343 raft_consensus.cc:2454] T 0de61fc46e1541bfb956d0f28acd7ef3 P fd4789b5fa2f4f5682434dedf03355a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30d1a3f78bbc4e4594806e0bbd55e46a in term 1.
I20260809 19:09:54.266078 18867 raft_consensus.cc:2454] T 0de61fc46e1541bfb956d0f28acd7ef3 P dcf1a29c27c44bbfabe9397a91a80197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30d1a3f78bbc4e4594806e0bbd55e46a in term 1.
I20260809 19:09:54.266213 19016 leader_election.cc:302] T 0de61fc46e1541bfb956d0f28acd7ef3 P 30d1a3f78bbc4e4594806e0bbd55e46a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30d1a3f78bbc4e4594806e0bbd55e46a, fd4789b5fa2f4f5682434dedf03355a9; no voters:
I20260809 19:09:54.266685 19469 raft_consensus.cc:2781] T 0de61fc46e1541bfb956d0f28acd7ef3 P 30d1a3f78bbc4e4594806e0bbd55e46a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:09:54.267341 19469 raft_consensus.cc:686] T 0de61fc46e1541bfb956d0f28acd7ef3 P 30d1a3f78bbc4e4594806e0bbd55e46a [term 1 LEADER]: Becoming Leader. State: Replica: 30d1a3f78bbc4e4594806e0bbd55e46a, State: Running, Role: LEADER
I20260809 19:09:54.267891 19469 consensus_queue.cc:237] T 0de61fc46e1541bfb956d0f28acd7ef3 P 30d1a3f78bbc4e4594806e0bbd55e46a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d1a3f78bbc4e4594806e0bbd55e46a" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46223 } } peers { permanent_uuid: "fd4789b5fa2f4f5682434dedf03355a9" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 37589 } } peers { permanent_uuid: "dcf1a29c27c44bbfabe9397a91a80197" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33499 } }
I20260809 19:09:54.273949 17345 catalog_manager.cc:5495] T 0de61fc46e1541bfb956d0f28acd7ef3 P 30d1a3f78bbc4e4594806e0bbd55e46a reported cstate change: term changed from 0 to 1, leader changed from <none> to 30d1a3f78bbc4e4594806e0bbd55e46a (127.7.39.2). New cstate: current_term: 1 leader_uuid: "30d1a3f78bbc4e4594806e0bbd55e46a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d1a3f78bbc4e4594806e0bbd55e46a" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd4789b5fa2f4f5682434dedf03355a9" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 37589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcf1a29c27c44bbfabe9397a91a80197" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33499 } health_report { overall_health: UNKNOWN } } }
W20260809 19:09:54.297034 18947 tablet.cc:2369] T 0de61fc46e1541bfb956d0f28acd7ef3 P dcf1a29c27c44bbfabe9397a91a80197: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:09:54.316349 19453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:54.310036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50770 (local address 127.7.39.2:46223)
0809 19:09:54.310233 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:54.310239 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:54.310485 (+ 246us) server_negotiation.cc:407] Connection header received
0809 19:09:54.310700 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:54.310704 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:54.310782 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:54.310932 (+ 150us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:09:54.311311 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.312286 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.313863 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.314672 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.314796 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:54.315282 (+ 486us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:09:54.315762 (+ 480us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:09:54.315892 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:54.315980 (+ 88us) server_negotiation.cc:299] Negotiation successful
0809 19:09:54.316068 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 19:09:54.325902 18867 raft_consensus.cc:1261] T 0de61fc46e1541bfb956d0f28acd7ef3 P dcf1a29c27c44bbfabe9397a91a80197 [term 1 FOLLOWER]: Refusing update from remote peer 30d1a3f78bbc4e4594806e0bbd55e46a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:09:54.325907 19343 raft_consensus.cc:1261] T 0de61fc46e1541bfb956d0f28acd7ef3 P fd4789b5fa2f4f5682434dedf03355a9 [term 1 FOLLOWER]: Refusing update from remote peer 30d1a3f78bbc4e4594806e0bbd55e46a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:09:54.326900 19479 consensus_queue.cc:1035] T 0de61fc46e1541bfb956d0f28acd7ef3 P 30d1a3f78bbc4e4594806e0bbd55e46a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4789b5fa2f4f5682434dedf03355a9" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 37589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:09:54.327374 19469 consensus_queue.cc:1035] T 0de61fc46e1541bfb956d0f28acd7ef3 P 30d1a3f78bbc4e4594806e0bbd55e46a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcf1a29c27c44bbfabe9397a91a80197" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:09:54.350205 19483 mvcc.cc:205] Tried to move back new op lower bound from 7316695426348421120 to 7316695426125766656. Current Snapshot: MvccSnapshot[applied={T|T < 7316695426348421120}]
I20260809 19:09:54.358526 19484 mvcc.cc:205] Tried to move back new op lower bound from 7316695426348421120 to 7316695426125766656. Current Snapshot: MvccSnapshot[applied={T|T < 7316695426348421120}]
I20260809 19:09:54.376657 17345 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34236:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:09:54.376912 17345 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34236:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:09:54.385267 17345 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1ea647a72fce400dad91d0cf80781fb0: Sending DeleteTablet for 3 replicas of tablet 0de61fc46e1541bfb956d0f28acd7ef3
I20260809 19:09:54.386993 18827 tablet_service.cc:1514] Processing DeleteTablet for tablet 0de61fc46e1541bfb956d0f28acd7ef3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:09:54 UTC) from {username='oryx', principal='oryx/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:44788
I20260809 19:09:54.387733 19315 tablet_service.cc:1514] Processing DeleteTablet for tablet 0de61fc46e1541bfb956d0f28acd7ef3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:09:54 UTC) from {username='oryx', principal='oryx/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:48430
I20260809 19:09:54.388231 19090 tablet_service.cc:1514] Processing DeleteTablet for tablet 0de61fc46e1541bfb956d0f28acd7ef3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:09:54 UTC) from {username='oryx', principal='oryx/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:50758
I20260809 19:09:54.396450 19504 tablet_replica.cc:330] T 0de61fc46e1541bfb956d0f28acd7ef3 P fd4789b5fa2f4f5682434dedf03355a9: stopping tablet replica
I20260809 19:09:54.397014 19504 raft_consensus.cc:2229] T 0de61fc46e1541bfb956d0f28acd7ef3 P fd4789b5fa2f4f5682434dedf03355a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:09:54.397718 19504 raft_consensus.cc:2258] T 0de61fc46e1541bfb956d0f28acd7ef3 P fd4789b5fa2f4f5682434dedf03355a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:09:54.400198 19504 ts_tablet_manager.cc:1905] T 0de61fc46e1541bfb956d0f28acd7ef3 P fd4789b5fa2f4f5682434dedf03355a9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:09:54.402768 19507 tablet_replica.cc:330] T 0de61fc46e1541bfb956d0f28acd7ef3 P 30d1a3f78bbc4e4594806e0bbd55e46a: stopping tablet replica
I20260809 19:09:54.402921 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 17297
I20260809 19:09:54.404390 17397 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:54.409253 19504 ts_tablet_manager.cc:1918] T 0de61fc46e1541bfb956d0f28acd7ef3 P fd4789b5fa2f4f5682434dedf03355a9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:09:54.409580 19504 log.cc:1196] T 0de61fc46e1541bfb956d0f28acd7ef3 P fd4789b5fa2f4f5682434dedf03355a9: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-2/wal/wals/0de61fc46e1541bfb956d0f28acd7ef3
I20260809 19:09:54.410614 19504 ts_tablet_manager.cc:1939] T 0de61fc46e1541bfb956d0f28acd7ef3 P fd4789b5fa2f4f5682434dedf03355a9: Deleting consensus metadata
I20260809 19:09:54.415207 19500 tablet_replica.cc:330] T 0de61fc46e1541bfb956d0f28acd7ef3 P dcf1a29c27c44bbfabe9397a91a80197: stopping tablet replica
I20260809 19:09:54.415748 19500 raft_consensus.cc:2229] T 0de61fc46e1541bfb956d0f28acd7ef3 P dcf1a29c27c44bbfabe9397a91a80197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:09:54.416031 19507 raft_consensus.cc:2229] T 0de61fc46e1541bfb956d0f28acd7ef3 P 30d1a3f78bbc4e4594806e0bbd55e46a [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:09:54.416394 19500 raft_consensus.cc:2258] T 0de61fc46e1541bfb956d0f28acd7ef3 P dcf1a29c27c44bbfabe9397a91a80197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:09:54.417150 19507 raft_consensus.cc:2258] T 0de61fc46e1541bfb956d0f28acd7ef3 P 30d1a3f78bbc4e4594806e0bbd55e46a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:09:54.419121 19500 ts_tablet_manager.cc:1905] T 0de61fc46e1541bfb956d0f28acd7ef3 P dcf1a29c27c44bbfabe9397a91a80197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:09:54.420013 19507 ts_tablet_manager.cc:1905] T 0de61fc46e1541bfb956d0f28acd7ef3 P 30d1a3f78bbc4e4594806e0bbd55e46a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:09:54.427119 19437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:54.389902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51626 (local address 127.7.39.61:46355)
0809 19:09:54.390139 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:54.390146 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:54.396987 (+ 6841us) server_negotiation.cc:407] Connection header received
0809 19:09:54.397061 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:54.397066 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:54.397232 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:54.397340 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:54.401850 (+ 4510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.402909 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.410166 (+ 7257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.411098 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.411243 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:54.418436 (+ 7193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:54.418443 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:54.418448 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:54.418488 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:54.422942 (+ 4454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:54.424142 (+ 1200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:54.424148 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:54.424152 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:54.424335 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:54.424950 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:54.424955 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:54.424959 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:54.425451 (+ 492us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:54.425691 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:54.426501 (+ 810us) server_negotiation.cc:299] Negotiation successful
0809 19:09:54.426747 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 19:09:54.427656 19500 ts_tablet_manager.cc:1918] T 0de61fc46e1541bfb956d0f28acd7ef3 P dcf1a29c27c44bbfabe9397a91a80197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:09:54.427863 19500 log.cc:1196] T 0de61fc46e1541bfb956d0f28acd7ef3 P dcf1a29c27c44bbfabe9397a91a80197: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-0/wal/wals/0de61fc46e1541bfb956d0f28acd7ef3
I20260809 19:09:54.428774 19500 ts_tablet_manager.cc:1939] T 0de61fc46e1541bfb956d0f28acd7ef3 P dcf1a29c27c44bbfabe9397a91a80197: Deleting consensus metadata
I20260809 19:09:54.442624 19507 ts_tablet_manager.cc:1918] T 0de61fc46e1541bfb956d0f28acd7ef3 P 30d1a3f78bbc4e4594806e0bbd55e46a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:09:54.442850 19507 log.cc:1196] T 0de61fc46e1541bfb956d0f28acd7ef3 P 30d1a3f78bbc4e4594806e0bbd55e46a: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-1/wal/wals/0de61fc46e1541bfb956d0f28acd7ef3
I20260809 19:09:54.443531 19507 ts_tablet_manager.cc:1939] T 0de61fc46e1541bfb956d0f28acd7ef3 P 30d1a3f78bbc4e4594806e0bbd55e46a: Deleting consensus metadata
I20260809 19:09:54.457266 19439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:54.396709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39020 (local address 127.7.39.60:36903)
0809 19:09:54.396940 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:54.396946 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:54.437997 (+ 41051us) server_negotiation.cc:407] Connection header received
0809 19:09:54.438318 (+ 321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:54.438326 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:54.438410 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:54.438479 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:54.440661 (+ 2182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.441856 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.444296 (+ 2440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.444908 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.444988 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:54.449159 (+ 4171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:54.449166 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:54.449171 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:54.449212 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:54.453509 (+ 4297us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:54.454417 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:54.454423 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:54.454427 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:54.454611 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:54.455098 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:54.455103 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:54.455107 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:54.455540 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:54.455869 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:54.456539 (+ 670us) server_negotiation.cc:299] Negotiation successful
0809 19:09:54.456777 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 19:09:54.551666 17320 catalog_manager.cc:4841] TS dcf1a29c27c44bbfabe9397a91a80197 (127.7.39.1:33499): tablet 0de61fc46e1541bfb956d0f28acd7ef3 (table test-table [id=143b9b9123584e1cab5ccc69b2e3c909]) successfully deleted
I20260809 19:09:54.552306 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 17297
I20260809 19:09:54.552218 17322 catalog_manager.cc:4841] TS 30d1a3f78bbc4e4594806e0bbd55e46a (127.7.39.2:46223): tablet 0de61fc46e1541bfb956d0f28acd7ef3 (table test-table [id=143b9b9123584e1cab5ccc69b2e3c909]) successfully deleted
W20260809 19:09:54.591552 19242 connection.cc:535] server connection from 127.0.0.1:48430 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 19:09:54.612175 19439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:54.597619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39024 (local address 127.7.39.60:36903)
0809 19:09:54.597793 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:54.597799 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:54.598012 (+ 213us) server_negotiation.cc:407] Connection header received
0809 19:09:54.598124 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:54.598129 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:54.598205 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:54.598374 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:54.600348 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.601125 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.602489 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.603144 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.603271 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:54.606431 (+ 3160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:54.606436 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:54.606440 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:54.606471 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:54.609011 (+ 2540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:54.609597 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:54.609603 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:54.609607 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:54.609722 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:54.610542 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:54.610547 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:54.610551 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:54.610816 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:54.611113 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:54.611712 (+ 599us) server_negotiation.cc:299] Negotiation successful
0809 19:09:54.611903 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 19:09:54.612650 19437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:54.596366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51636 (local address 127.7.39.61:46355)
0809 19:09:54.596585 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:54.596593 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:54.597625 (+ 1032us) server_negotiation.cc:407] Connection header received
0809 19:09:54.597918 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:54.597924 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:54.598022 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:54.598125 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:54.599715 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.600528 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.602426 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:54.602856 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:54.602970 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:54.606432 (+ 3462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:54.606441 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:54.606447 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:54.606489 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:54.609701 (+ 3212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:54.610284 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:54.610309 (+ 25us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:54.610313 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:54.610461 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:54.610892 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:54.610897 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:54.610900 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:54.611237 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:54.611475 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:54.611857 (+ 382us) server_negotiation.cc:299] Negotiation successful
0809 19:09:54.612295 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 19:09:55.357769 19518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:55.356896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.7.39.3:38149)
0809 19:09:55.357365 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:55.357538 (+ 173us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":238,"threads_started":1}
W20260809 19:09:55.358412 19409 heartbeater.cc:644] Failed to heartbeat to 127.7.39.62:33935 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.7.39.62:33935: connect: Connection refused (error 111)
I20260809 19:09:55.370864 19519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:55.369966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.7.39.2:39873)
0809 19:09:55.370483 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:55.370629 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":230,"threads_started":1}
W20260809 19:09:55.371361 19197 heartbeater.cc:644] Failed to heartbeat to 127.7.39.62:33935 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.7.39.62:33935: connect: Connection refused (error 111)
I20260809 19:09:55.373167 19520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:55.372280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.7.39.1:44573)
0809 19:09:55.372916 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:55.373028 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":413,"threads_started":1}
W20260809 19:09:55.373502 18944 heartbeater.cc:644] Failed to heartbeat to 127.7.39.62:33935 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.7.39.62:33935: connect: Connection refused (error 111)
I20260809 19:09:55.886243 19522 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ea647a72fce400dad91d0cf80781fb0)
I20260809 19:09:55.886487 19523 raft_consensus.cc:482] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ea647a72fce400dad91d0cf80781fb0)
I20260809 19:09:55.886483 19522 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false } } peers { permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 36903 } attrs { promote: false } }
I20260809 19:09:55.886721 19523 raft_consensus.cc:504] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false } } peers { permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 36903 } attrs { promote: false } }
I20260809 19:09:55.887292 19522 leader_election.cc:288] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ea647a72fce400dad91d0cf80781fb0 (127.7.39.62:33935), dc6e5da415ab45d98a660ab46d312620 (127.7.39.61:46355)
I20260809 19:09:55.888317 19523 leader_election.cc:288] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ea647a72fce400dad91d0cf80781fb0 (127.7.39.62:33935), 7dc69093513f4aed81bf2c78f57e1438 (127.7.39.60:36903)
I20260809 19:09:55.895358 19524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:55.887404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.0.0.1:34684)
0809 19:09:55.894841 (+ 7437us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:55.895064 (+ 223us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":7326,"thread_start_us":7185,"threads_started":1}
I20260809 19:09:55.897874 19527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:55.888416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.0.0.1:34694)
0809 19:09:55.897382 (+ 8966us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:55.897601 (+ 219us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":8846,"thread_start_us":8699,"threads_started":1}
W20260809 19:09:55.898159 18316 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.39.62:33935: connect: Connection refused (error 111)
W20260809 19:09:55.904968 18619 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.39.62:33935: connect: Connection refused (error 111)
I20260809 19:09:55.906795 19530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:55.902698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.0.0.1:34706)
0809 19:09:55.906396 (+ 3698us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:55.906553 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3558}
W20260809 19:09:55.907064 18316 leader_election.cc:334] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1ea647a72fce400dad91d0cf80781fb0 (127.7.39.62:33935): Network error: Client connection negotiation failed: client connection to 127.7.39.62:33935: connect: Connection refused (error 111)
I20260809 19:09:55.909456 19525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:55.908978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.0.0.1:34708)
0809 19:09:55.909149 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:55.909260 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 19:09:55.909721 18619 leader_election.cc:334] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1ea647a72fce400dad91d0cf80781fb0 (127.7.39.62:33935): Network error: Client connection negotiation failed: client connection to 127.7.39.62:33935: connect: Connection refused (error 111)
I20260809 19:09:55.911589 19527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:55.888676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:36903 (local address 127.0.0.1:39030)
0809 19:09:55.902239 (+ 13563us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:55.902264 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:55.902452 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:55.904293 (+ 1841us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:55.904300 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:55.904332 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:55.904570 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:55.904582 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:55.907118 (+ 2536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:55.907124 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:55.909399 (+ 2275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:55.909410 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:55.910858 (+ 1448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:55.910865 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:55.911009 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:55.911035 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 19:09:55.911116 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 19:09:55.911252 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13452,"mutex_wait_us":65,"thread_start_us":17420,"threads_started":1}
I20260809 19:09:55.911600 19531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:55.894842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39030 (local address 127.7.39.60:36903)
0809 19:09:55.903793 (+ 8951us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:55.903799 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:55.903821 (+ 22us) server_negotiation.cc:407] Connection header received
0809 19:09:55.903897 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:55.903903 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:55.903981 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:55.904080 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:55.905654 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:55.906935 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:55.909595 (+ 2660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:55.910649 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:55.910781 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:55.910879 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:55.911158 (+ 279us) server_negotiation.cc:299] Negotiation successful
0809 19:09:55.911287 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8809,"thread_start_us":9851,"threads_started":1}
I20260809 19:09:55.912357 18652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dc6e5da415ab45d98a660ab46d312620" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "7dc69093513f4aed81bf2c78f57e1438" is_pre_election: true
I20260809 19:09:55.912772 18652 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc6e5da415ab45d98a660ab46d312620 in term 1.
I20260809 19:09:55.913343 18317 leader_election.cc:302] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7dc69093513f4aed81bf2c78f57e1438, dc6e5da415ab45d98a660ab46d312620; no voters: 1ea647a72fce400dad91d0cf80781fb0
I20260809 19:09:55.913630 19524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:55.887495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:46355 (local address 127.0.0.1:51646)
0809 19:09:55.895570 (+ 8075us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:55.895590 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:55.895759 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:55.907455 (+ 11696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:55.907461 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:55.907496 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:55.907694 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:55.907702 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:55.909440 (+ 1738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:55.909449 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:55.911288 (+ 1839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:55.911303 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:55.913016 (+ 1713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:55.913021 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:55.913203 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:55.913234 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 19:09:55.913302 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 19:09:55.913394 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7982,"mutex_wait_us":86,"thread_start_us":19819,"threads_started":1}
I20260809 19:09:55.913797 19523 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260809 19:09:55.913895 19526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:55.887627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51646 (local address 127.7.39.61:46355)
0809 19:09:55.906093 (+ 18466us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:55.906099 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:55.906120 (+ 21us) server_negotiation.cc:407] Connection header received
0809 19:09:55.906189 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:55.906193 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:55.906276 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:55.907809 (+ 1533us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:55.908024 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:55.909252 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:55.911536 (+ 2284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:55.912828 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:55.912972 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:55.913088 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:55.913357 (+ 269us) server_negotiation.cc:299] Negotiation successful
0809 19:09:55.913511 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":18309,"thread_start_us":18121,"threads_started":1}
I20260809 19:09:55.913938 19523 raft_consensus.cc:482] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1ea647a72fce400dad91d0cf80781fb0)
I20260809 19:09:55.914077 19523 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [term 1 FOLLOWER]: Advancing to term 2
I20260809 19:09:55.914425 18355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7dc69093513f4aed81bf2c78f57e1438" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "dc6e5da415ab45d98a660ab46d312620" is_pre_election: true
I20260809 19:09:55.916662 19523 raft_consensus.cc:504] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false } } peers { permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 36903 } attrs { promote: false } }
I20260809 19:09:55.917239 18355 raft_consensus.cc:2379] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7dc69093513f4aed81bf2c78f57e1438 in current term 2: Already voted for candidate dc6e5da415ab45d98a660ab46d312620 in this term.
I20260809 19:09:55.917393 19523 leader_election.cc:288] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [CANDIDATE]: Term 2 election: Requested vote from peers 1ea647a72fce400dad91d0cf80781fb0 (127.7.39.62:33935), 7dc69093513f4aed81bf2c78f57e1438 (127.7.39.60:36903)
I20260809 19:09:55.917889 19527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:55.917454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.0.0.1:34716)
0809 19:09:55.917672 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:55.917750 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260809 19:09:55.918110 18620 leader_election.cc:302] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7dc69093513f4aed81bf2c78f57e1438; no voters: 1ea647a72fce400dad91d0cf80781fb0, dc6e5da415ab45d98a660ab46d312620
I20260809 19:09:55.918267 18652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dc6e5da415ab45d98a660ab46d312620" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "7dc69093513f4aed81bf2c78f57e1438"
I20260809 19:09:55.918434 19522 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [term 1 FOLLOWER]: Advancing to term 2
I20260809 19:09:55.918926 19527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:55.918586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.0.0.1:34732)
0809 19:09:55.918730 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:55.918816 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 19:09:55.919086 18316 leader_election.cc:334] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1ea647a72fce400dad91d0cf80781fb0 (127.7.39.62:33935): Network error: Client connection negotiation failed: client connection to 127.7.39.62:33935: connect: Connection refused (error 111)
I20260809 19:09:55.920668 19522 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 19:09:55.922755 18652 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc6e5da415ab45d98a660ab46d312620 in term 2.
I20260809 19:09:55.923372 18317 leader_election.cc:302] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7dc69093513f4aed81bf2c78f57e1438, dc6e5da415ab45d98a660ab46d312620; no voters: 1ea647a72fce400dad91d0cf80781fb0
I20260809 19:09:55.923631 19523 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 19:09:55.924039 19523 raft_consensus.cc:686] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [term 2 LEADER]: Becoming Leader. State: Replica: dc6e5da415ab45d98a660ab46d312620, State: Running, Role: LEADER
I20260809 19:09:55.924391 19523 consensus_queue.cc:237] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false } } peers { permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 36903 } attrs { promote: false } }
I20260809 19:09:55.925980 19535 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dc6e5da415ab45d98a660ab46d312620. Latest consensus state: current_term: 2 leader_uuid: "dc6e5da415ab45d98a660ab46d312620" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false } } peers { permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 36903 } attrs { promote: false } } }
I20260809 19:09:55.926326 19535 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:55.926980 19537 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:09:55.931471 19537 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:09:55.932426 19537 catalog_manager.cc:1259] Loaded cluster ID: 16c59a70236c44159b71e16fd90c7b65
I20260809 19:09:55.932518 19537 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:09:55.933732 19537 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:09:55.934648 19537 catalog_manager.cc:5879] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620: Loaded TSK: 0
I20260809 19:09:55.935491 19537 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:09:55.987255 18337 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51636:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:09:55.994349 18337 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:09:55.998381 19527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:55.997944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.0.0.1:34768)
0809 19:09:55.998125 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:55.998205 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260809 19:09:55.998610 18652 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [term 2 FOLLOWER]: Refusing update from remote peer dc6e5da415ab45d98a660ab46d312620: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260809 19:09:55.999338 19527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:55.999013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.0.0.1:34782)
0809 19:09:55.999153 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:55.999220 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260809 19:09:55.999337 19535 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 36903 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260809 19:09:55.999615 18316 consensus_peers.cc:487] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 -> Peer 1ea647a72fce400dad91d0cf80781fb0 (127.7.39.62:33935): Couldn't send request to peer 1ea647a72fce400dad91d0cf80781fb0. Status: Network error: Client connection negotiation failed: client connection to 127.7.39.62:33935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 19:09:56.002019 19522 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dc6e5da415ab45d98a660ab46d312620. Latest consensus state: current_term: 2 leader_uuid: "dc6e5da415ab45d98a660ab46d312620" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false } } peers { permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 36903 } attrs { promote: false } } }
I20260809 19:09:56.002315 19522 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:09:56.003779 19540 mvcc.cc:205] Tried to move back new op lower bound from 7316695433202733056 to 7316695432909807616. Current Snapshot: MvccSnapshot[applied={T|T < 7316695433202733056}]
I20260809 19:09:56.003677 19535 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "dc6e5da415ab45d98a660ab46d312620" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false } } peers { permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 36903 } attrs { promote: false } } }
I20260809 19:09:56.003955 19535 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620 [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:56.010892 19522 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "dc6e5da415ab45d98a660ab46d312620" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1ea647a72fce400dad91d0cf80781fb0" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33935 } } peers { permanent_uuid: "dc6e5da415ab45d98a660ab46d312620" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46355 } attrs { promote: false } } peers { permanent_uuid: "7dc69093513f4aed81bf2c78f57e1438" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 36903 } attrs { promote: false } } }
I20260809 19:09:56.011200 19522 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dc69093513f4aed81bf2c78f57e1438 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:09:56.024129 19527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:56.014790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:37589 (local address 127.0.0.1:48442)
0809 19:09:56.014984 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:56.015006 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:56.015150 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:56.017291 (+ 2141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:56.017297 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:56.017325 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:56.017523 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:56.017533 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:56.019249 (+ 1716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:56.019254 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:56.021294 (+ 2040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:56.021311 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:56.023352 (+ 2041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:56.023357 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:56.023549 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:56.023599 (+ 50us) client_negotiation.cc:769] Sending connection context
0809 19:09:56.023671 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 19:09:56.023800 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":1}
I20260809 19:09:56.025023 19530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:56.015428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:33499 (local address 127.0.0.1:44796)
0809 19:09:56.015675 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:56.015692 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:56.015803 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:56.016355 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:56.016361 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:56.016390 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:56.016752 (+ 362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:56.016765 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:56.018475 (+ 1710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:56.018481 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:56.021695 (+ 3214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:56.021709 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:56.024235 (+ 2526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:56.024241 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:56.024432 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:56.024469 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 19:09:56.024535 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 19:09:56.024677 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":868}
I20260809 19:09:56.025309 19544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:56.014859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48442 (local address 127.7.39.3:37589)
0809 19:09:56.015355 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:56.015361 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:56.015380 (+ 19us) server_negotiation.cc:407] Connection header received
0809 19:09:56.015444 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:56.015449 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:56.016003 (+ 554us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:56.017658 (+ 1655us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:56.017855 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:56.019060 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:56.021918 (+ 2858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:56.023185 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:56.024647 (+ 1462us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:56.024774 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:56.024826 (+ 52us) server_negotiation.cc:299] Negotiation successful
0809 19:09:56.024967 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":274,"threads_started":1}
I20260809 19:09:56.026616 19545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:56.015589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44796 (local address 127.7.39.1:33499)
0809 19:09:56.015998 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:56.016004 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:56.016021 (+ 17us) server_negotiation.cc:407] Connection header received
0809 19:09:56.016106 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:56.016111 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:56.016188 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:56.016905 (+ 717us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:56.017099 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:56.018282 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:56.022664 (+ 4382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:56.023947 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:56.025926 (+ 1979us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:56.026053 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:56.026118 (+ 65us) server_negotiation.cc:299] Negotiation successful
0809 19:09:56.026266 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":482,"threads_started":1}
I20260809 19:09:56.027611 18827 tablet_service.cc:1467] Processing CreateTablet for tablet 2b11ff5e013146c8a172c1c569c474d0 (DEFAULT_TABLE table=test-table [id=b5ed51dc96f443ca8795970eb292596c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:09:56.028133 18827 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b11ff5e013146c8a172c1c569c474d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:56.029738 19315 tablet_service.cc:1467] Processing CreateTablet for tablet 2b11ff5e013146c8a172c1c569c474d0 (DEFAULT_TABLE table=test-table [id=b5ed51dc96f443ca8795970eb292596c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:09:56.030218 19315 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b11ff5e013146c8a172c1c569c474d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:56.033876 19527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:56.015664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:46223 (local address 127.0.0.1:50784)
0809 19:09:56.024374 (+ 8710us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:56.024392 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:56.024490 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:56.028558 (+ 4068us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:56.028562 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:56.028585 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:56.028764 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:56.028776 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:56.029752 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:56.029757 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:56.031574 (+ 1817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:56.031588 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:56.033131 (+ 1543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:56.033137 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:56.033356 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:56.033390 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 19:09:56.033483 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 19:09:56.033615 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8597,"thread_start_us":13242,"threads_started":1}
I20260809 19:09:56.034123 19548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:56.015954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50784 (local address 127.7.39.2:46223)
0809 19:09:56.028303 (+ 12349us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:56.028308 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:56.028323 (+ 15us) server_negotiation.cc:407] Connection header received
0809 19:09:56.028379 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:56.028383 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:56.028438 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:56.028528 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:56.028900 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:56.029611 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:56.031726 (+ 2115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:56.032971 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:56.033102 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:56.033202 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:56.033535 (+ 333us) server_negotiation.cc:299] Negotiation successful
0809 19:09:56.033682 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12215,"thread_start_us":12707,"threads_started":1}
I20260809 19:09:56.034926 19090 tablet_service.cc:1467] Processing CreateTablet for tablet 2b11ff5e013146c8a172c1c569c474d0 (DEFAULT_TABLE table=test-table [id=b5ed51dc96f443ca8795970eb292596c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:09:56.035209 19549 tablet_bootstrap.cc:492] T 2b11ff5e013146c8a172c1c569c474d0 P dcf1a29c27c44bbfabe9397a91a80197: Bootstrap starting.
I20260809 19:09:56.035362 19090 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b11ff5e013146c8a172c1c569c474d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:09:56.036757 19550 tablet_bootstrap.cc:492] T 2b11ff5e013146c8a172c1c569c474d0 P fd4789b5fa2f4f5682434dedf03355a9: Bootstrap starting.
I20260809 19:09:56.036850 19549 tablet_bootstrap.cc:654] T 2b11ff5e013146c8a172c1c569c474d0 P dcf1a29c27c44bbfabe9397a91a80197: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:56.038419 19550 tablet_bootstrap.cc:654] T 2b11ff5e013146c8a172c1c569c474d0 P fd4789b5fa2f4f5682434dedf03355a9: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:56.039062 19549 tablet_bootstrap.cc:492] T 2b11ff5e013146c8a172c1c569c474d0 P dcf1a29c27c44bbfabe9397a91a80197: No bootstrap required, opened a new log
I20260809 19:09:56.039196 19549 ts_tablet_manager.cc:1397] T 2b11ff5e013146c8a172c1c569c474d0 P dcf1a29c27c44bbfabe9397a91a80197: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260809 19:09:56.039880 19549 raft_consensus.cc:348] T 2b11ff5e013146c8a172c1c569c474d0 P dcf1a29c27c44bbfabe9397a91a80197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4789b5fa2f4f5682434dedf03355a9" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 37589 } } peers { permanent_uuid: "dcf1a29c27c44bbfabe9397a91a80197" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33499 } } peers { permanent_uuid: "30d1a3f78bbc4e4594806e0bbd55e46a" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46223 } }
I20260809 19:09:56.040129 19549 raft_consensus.cc:374] T 2b11ff5e013146c8a172c1c569c474d0 P dcf1a29c27c44bbfabe9397a91a80197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:56.040228 19549 raft_consensus.cc:729] T 2b11ff5e013146c8a172c1c569c474d0 P dcf1a29c27c44bbfabe9397a91a80197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcf1a29c27c44bbfabe9397a91a80197, State: Initialized, Role: FOLLOWER
I20260809 19:09:56.040508 19550 tablet_bootstrap.cc:492] T 2b11ff5e013146c8a172c1c569c474d0 P fd4789b5fa2f4f5682434dedf03355a9: No bootstrap required, opened a new log
I20260809 19:09:56.040644 19550 ts_tablet_manager.cc:1397] T 2b11ff5e013146c8a172c1c569c474d0 P fd4789b5fa2f4f5682434dedf03355a9: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.002s
I20260809 19:09:56.040477 19549 consensus_queue.cc:260] T 2b11ff5e013146c8a172c1c569c474d0 P dcf1a29c27c44bbfabe9397a91a80197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4789b5fa2f4f5682434dedf03355a9" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 37589 } } peers { permanent_uuid: "dcf1a29c27c44bbfabe9397a91a80197" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33499 } } peers { permanent_uuid: "30d1a3f78bbc4e4594806e0bbd55e46a" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46223 } }
I20260809 19:09:56.041311 19549 ts_tablet_manager.cc:1428] T 2b11ff5e013146c8a172c1c569c474d0 P dcf1a29c27c44bbfabe9397a91a80197: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 19:09:56.041438 19550 raft_consensus.cc:348] T 2b11ff5e013146c8a172c1c569c474d0 P fd4789b5fa2f4f5682434dedf03355a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4789b5fa2f4f5682434dedf03355a9" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 37589 } } peers { permanent_uuid: "dcf1a29c27c44bbfabe9397a91a80197" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33499 } } peers { permanent_uuid: "30d1a3f78bbc4e4594806e0bbd55e46a" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46223 } }
I20260809 19:09:56.041672 19550 raft_consensus.cc:374] T 2b11ff5e013146c8a172c1c569c474d0 P fd4789b5fa2f4f5682434dedf03355a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:56.041771 19550 raft_consensus.cc:729] T 2b11ff5e013146c8a172c1c569c474d0 P fd4789b5fa2f4f5682434dedf03355a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4789b5fa2f4f5682434dedf03355a9, State: Initialized, Role: FOLLOWER
I20260809 19:09:56.042023 19550 consensus_queue.cc:260] T 2b11ff5e013146c8a172c1c569c474d0 P fd4789b5fa2f4f5682434dedf03355a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4789b5fa2f4f5682434dedf03355a9" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 37589 } } peers { permanent_uuid: "dcf1a29c27c44bbfabe9397a91a80197" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33499 } } peers { permanent_uuid: "30d1a3f78bbc4e4594806e0bbd55e46a" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46223 } }
I20260809 19:09:56.042582 19555 tablet_bootstrap.cc:492] T 2b11ff5e013146c8a172c1c569c474d0 P 30d1a3f78bbc4e4594806e0bbd55e46a: Bootstrap starting.
I20260809 19:09:56.044651 18946 heartbeater.cc:503] Master 127.7.39.61:46355 was elected leader, sending a full tablet report...
I20260809 19:09:56.046018 19555 tablet_bootstrap.cc:654] T 2b11ff5e013146c8a172c1c569c474d0 P 30d1a3f78bbc4e4594806e0bbd55e46a: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:56.048924 19555 tablet_bootstrap.cc:492] T 2b11ff5e013146c8a172c1c569c474d0 P 30d1a3f78bbc4e4594806e0bbd55e46a: No bootstrap required, opened a new log
I20260809 19:09:56.048949 19550 ts_tablet_manager.cc:1428] T 2b11ff5e013146c8a172c1c569c474d0 P fd4789b5fa2f4f5682434dedf03355a9: Time spent starting tablet: real 0.008s user 0.003s sys 0.006s
I20260809 19:09:56.049072 19555 ts_tablet_manager.cc:1397] T 2b11ff5e013146c8a172c1c569c474d0 P 30d1a3f78bbc4e4594806e0bbd55e46a: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.003s
I20260809 19:09:56.049855 19555 raft_consensus.cc:348] T 2b11ff5e013146c8a172c1c569c474d0 P 30d1a3f78bbc4e4594806e0bbd55e46a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4789b5fa2f4f5682434dedf03355a9" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 37589 } } peers { permanent_uuid: "dcf1a29c27c44bbfabe9397a91a80197" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33499 } } peers { permanent_uuid: "30d1a3f78bbc4e4594806e0bbd55e46a" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46223 } }
I20260809 19:09:56.050076 19555 raft_consensus.cc:374] T 2b11ff5e013146c8a172c1c569c474d0 P 30d1a3f78bbc4e4594806e0bbd55e46a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:56.050171 19555 raft_consensus.cc:729] T 2b11ff5e013146c8a172c1c569c474d0 P 30d1a3f78bbc4e4594806e0bbd55e46a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30d1a3f78bbc4e4594806e0bbd55e46a, State: Initialized, Role: FOLLOWER
I20260809 19:09:56.050458 19555 consensus_queue.cc:260] T 2b11ff5e013146c8a172c1c569c474d0 P 30d1a3f78bbc4e4594806e0bbd55e46a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4789b5fa2f4f5682434dedf03355a9" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 37589 } } peers { permanent_uuid: "dcf1a29c27c44bbfabe9397a91a80197" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33499 } } peers { permanent_uuid: "30d1a3f78bbc4e4594806e0bbd55e46a" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46223 } }
I20260809 19:09:56.056558 19413 heartbeater.cc:503] Master 127.7.39.61:46355 was elected leader, sending a full tablet report...
I20260809 19:09:56.057631 19557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:56.041851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.7.39.1:52183)
0809 19:09:56.057182 (+ 15331us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:56.057332 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15184,"threads_started":1}
I20260809 19:09:56.058126 19555 ts_tablet_manager.cc:1428] T 2b11ff5e013146c8a172c1c569c474d0 P 30d1a3f78bbc4e4594806e0bbd55e46a: Time spent starting tablet: real 0.009s user 0.000s sys 0.009s
I20260809 19:09:56.058840 19557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:56.058456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.7.39.1:56691)
0809 19:09:56.058644 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:56.058719 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260809 19:09:56.060228 19570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:56.059193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.7.39.2:45661)
0809 19:09:56.059801 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:56.059978 (+ 177us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":696,"threads_started":1}
I20260809 19:09:56.061422 19198 heartbeater.cc:503] Master 127.7.39.61:46355 was elected leader, sending a full tablet report...
I20260809 19:09:56.061748 19561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:56.049906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.7.39.3:45639)
0809 19:09:56.061390 (+ 11484us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:56.061510 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11369,"threads_started":1}
I20260809 19:09:56.062752 19570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:56.060724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.7.39.2:58665)
0809 19:09:56.062502 (+ 1778us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:56.062591 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1682,"threads_started":1}
I20260809 19:09:56.062892 19561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:56.062484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.7.39.3:39337)
0809 19:09:56.062672 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:56.062769 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
W20260809 19:09:56.166736 19204 tablet.cc:2369] T 2b11ff5e013146c8a172c1c569c474d0 P 30d1a3f78bbc4e4594806e0bbd55e46a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:09:56.263876 19558 raft_consensus.cc:482] T 2b11ff5e013146c8a172c1c569c474d0 P fd4789b5fa2f4f5682434dedf03355a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:09:56.264112 19558 raft_consensus.cc:504] T 2b11ff5e013146c8a172c1c569c474d0 P fd4789b5fa2f4f5682434dedf03355a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4789b5fa2f4f5682434dedf03355a9" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 37589 } } peers { permanent_uuid: "dcf1a29c27c44bbfabe9397a91a80197" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33499 } } peers { permanent_uuid: "30d1a3f78bbc4e4594806e0bbd55e46a" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46223 } }
I20260809 19:09:56.265743 19558 leader_election.cc:288] T 2b11ff5e013146c8a172c1c569c474d0 P fd4789b5fa2f4f5682434dedf03355a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcf1a29c27c44bbfabe9397a91a80197 (127.7.39.1:33499), 30d1a3f78bbc4e4594806e0bbd55e46a (127.7.39.2:46223)
I20260809 19:09:56.271564 19561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:56.265998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:46223 (local address 127.7.39.3:40923)
0809 19:09:56.266453 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:56.266469 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:56.266658 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:56.266963 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:56.266968 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:56.267016 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:56.267236 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:56.267245 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:56.268173 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:56.268178 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:56.269588 (+ 1410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:56.269603 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:56.270893 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:56.270900 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:56.271069 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:56.271104 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 19:09:56.271190 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 19:09:56.271333 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":1}
I20260809 19:09:56.271625 19548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:56.266153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:40923 (local address 127.7.39.2:46223)
0809 19:09:56.266341 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:56.266347 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:56.266549 (+ 202us) server_negotiation.cc:407] Connection header received
0809 19:09:56.266795 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:56.266799 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:56.266860 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:56.266931 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:56.267366 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:56.268031 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:56.269743 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:56.270721 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:56.270823 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:56.270897 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:56.271225 (+ 328us) server_negotiation.cc:299] Negotiation successful
0809 19:09:56.271356 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 19:09:56.271921 19545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:56.266009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:46839 (local address 127.7.39.1:33499)
0809 19:09:56.266240 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:56.266246 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:56.266866 (+ 620us) server_negotiation.cc:407] Connection header received
0809 19:09:56.267043 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:56.267048 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:56.267107 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:56.267181 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:09:56.267667 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:56.268346 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:56.270095 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:56.271064 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:56.271203 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:56.271296 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:56.271586 (+ 290us) server_negotiation.cc:299] Negotiation successful
0809 19:09:56.271714 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 19:09:56.272014 19572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:56.266009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:33499 (local address 127.7.39.3:46839)
0809 19:09:56.266769 (+ 760us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:56.266783 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:56.266905 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:56.267219 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:56.267224 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:56.267247 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:09:56.267527 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:56.267537 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:56.268472 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:56.268476 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:56.269948 (+ 1472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:56.269962 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:56.271251 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:56.271257 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:56.271420 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:56.271454 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 19:09:56.271545 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 19:09:56.271673 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":663,"mutex_wait_us":126,"thread_start_us":387,"threads_started":1}
I20260809 19:09:56.272643 18867 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b11ff5e013146c8a172c1c569c474d0" candidate_uuid: "fd4789b5fa2f4f5682434dedf03355a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcf1a29c27c44bbfabe9397a91a80197" is_pre_election: true
I20260809 19:09:56.272653 19119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b11ff5e013146c8a172c1c569c474d0" candidate_uuid: "fd4789b5fa2f4f5682434dedf03355a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d1a3f78bbc4e4594806e0bbd55e46a" is_pre_election: true
I20260809 19:09:56.272851 18867 raft_consensus.cc:2454] T 2b11ff5e013146c8a172c1c569c474d0 P dcf1a29c27c44bbfabe9397a91a80197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4789b5fa2f4f5682434dedf03355a9 in term 0.
I20260809 19:09:56.273015 19119 raft_consensus.cc:2454] T 2b11ff5e013146c8a172c1c569c474d0 P 30d1a3f78bbc4e4594806e0bbd55e46a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4789b5fa2f4f5682434dedf03355a9 in term 0.
I20260809 19:09:56.273311 19238 leader_election.cc:302] T 2b11ff5e013146c8a172c1c569c474d0 P fd4789b5fa2f4f5682434dedf03355a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcf1a29c27c44bbfabe9397a91a80197, fd4789b5fa2f4f5682434dedf03355a9; no voters:
I20260809 19:09:56.273669 19558 raft_consensus.cc:2781] T 2b11ff5e013146c8a172c1c569c474d0 P fd4789b5fa2f4f5682434dedf03355a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:09:56.273778 19558 raft_consensus.cc:482] T 2b11ff5e013146c8a172c1c569c474d0 P fd4789b5fa2f4f5682434dedf03355a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:09:56.273864 19558 raft_consensus.cc:3037] T 2b11ff5e013146c8a172c1c569c474d0 P fd4789b5fa2f4f5682434dedf03355a9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:56.275977 19558 raft_consensus.cc:504] T 2b11ff5e013146c8a172c1c569c474d0 P fd4789b5fa2f4f5682434dedf03355a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4789b5fa2f4f5682434dedf03355a9" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 37589 } } peers { permanent_uuid: "dcf1a29c27c44bbfabe9397a91a80197" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33499 } } peers { permanent_uuid: "30d1a3f78bbc4e4594806e0bbd55e46a" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46223 } }
I20260809 19:09:56.276515 19558 leader_election.cc:288] T 2b11ff5e013146c8a172c1c569c474d0 P fd4789b5fa2f4f5682434dedf03355a9 [CANDIDATE]: Term 1 election: Requested vote from peers dcf1a29c27c44bbfabe9397a91a80197 (127.7.39.1:33499), 30d1a3f78bbc4e4594806e0bbd55e46a (127.7.39.2:46223)
I20260809 19:09:56.276918 18867 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b11ff5e013146c8a172c1c569c474d0" candidate_uuid: "fd4789b5fa2f4f5682434dedf03355a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcf1a29c27c44bbfabe9397a91a80197"
I20260809 19:09:56.276981 19119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b11ff5e013146c8a172c1c569c474d0" candidate_uuid: "fd4789b5fa2f4f5682434dedf03355a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d1a3f78bbc4e4594806e0bbd55e46a"
I20260809 19:09:56.277151 18867 raft_consensus.cc:3037] T 2b11ff5e013146c8a172c1c569c474d0 P dcf1a29c27c44bbfabe9397a91a80197 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:56.277151 19119 raft_consensus.cc:3037] T 2b11ff5e013146c8a172c1c569c474d0 P 30d1a3f78bbc4e4594806e0bbd55e46a [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:56.280089 18867 raft_consensus.cc:2454] T 2b11ff5e013146c8a172c1c569c474d0 P dcf1a29c27c44bbfabe9397a91a80197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4789b5fa2f4f5682434dedf03355a9 in term 1.
I20260809 19:09:56.280090 19119 raft_consensus.cc:2454] T 2b11ff5e013146c8a172c1c569c474d0 P 30d1a3f78bbc4e4594806e0bbd55e46a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4789b5fa2f4f5682434dedf03355a9 in term 1.
I20260809 19:09:56.280452 19239 leader_election.cc:302] T 2b11ff5e013146c8a172c1c569c474d0 P fd4789b5fa2f4f5682434dedf03355a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30d1a3f78bbc4e4594806e0bbd55e46a, fd4789b5fa2f4f5682434dedf03355a9; no voters:
I20260809 19:09:56.280736 19558 raft_consensus.cc:2781] T 2b11ff5e013146c8a172c1c569c474d0 P fd4789b5fa2f4f5682434dedf03355a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:09:56.281152 19558 raft_consensus.cc:686] T 2b11ff5e013146c8a172c1c569c474d0 P fd4789b5fa2f4f5682434dedf03355a9 [term 1 LEADER]: Becoming Leader. State: Replica: fd4789b5fa2f4f5682434dedf03355a9, State: Running, Role: LEADER
I20260809 19:09:56.281661 19558 consensus_queue.cc:237] T 2b11ff5e013146c8a172c1c569c474d0 P fd4789b5fa2f4f5682434dedf03355a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4789b5fa2f4f5682434dedf03355a9" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 37589 } } peers { permanent_uuid: "dcf1a29c27c44bbfabe9397a91a80197" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33499 } } peers { permanent_uuid: "30d1a3f78bbc4e4594806e0bbd55e46a" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46223 } }
I20260809 19:09:56.282171 19572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:56.281810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.7.39.3:49041)
0809 19:09:56.281981 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:56.282056 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260809 19:09:56.284823 18338 catalog_manager.cc:5495] T 2b11ff5e013146c8a172c1c569c474d0 P fd4789b5fa2f4f5682434dedf03355a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd4789b5fa2f4f5682434dedf03355a9 (127.7.39.3). New cstate: current_term: 1 leader_uuid: "fd4789b5fa2f4f5682434dedf03355a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4789b5fa2f4f5682434dedf03355a9" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 37589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcf1a29c27c44bbfabe9397a91a80197" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30d1a3f78bbc4e4594806e0bbd55e46a" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46223 } health_report { overall_health: UNKNOWN } } }
I20260809 19:09:56.313738 19544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:56.309261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48450 (local address 127.7.39.3:37589)
0809 19:09:56.309442 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:56.309446 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:56.309465 (+ 19us) server_negotiation.cc:407] Connection header received
0809 19:09:56.309552 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:56.309556 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:56.309638 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:56.309756 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:09:56.310045 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:56.310784 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:56.311933 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:56.312345 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:56.312435 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:56.312815 (+ 380us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:09:56.313327 (+ 512us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:09:56.313432 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:56.313478 (+ 46us) server_negotiation.cc:299] Negotiation successful
0809 19:09:56.313545 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 19:09:56.317787 18867 raft_consensus.cc:1261] T 2b11ff5e013146c8a172c1c569c474d0 P dcf1a29c27c44bbfabe9397a91a80197 [term 1 FOLLOWER]: Refusing update from remote peer fd4789b5fa2f4f5682434dedf03355a9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:09:56.318030 19119 raft_consensus.cc:1261] T 2b11ff5e013146c8a172c1c569c474d0 P 30d1a3f78bbc4e4594806e0bbd55e46a [term 1 FOLLOWER]: Refusing update from remote peer fd4789b5fa2f4f5682434dedf03355a9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:09:56.318610 19558 consensus_queue.cc:1035] T 2b11ff5e013146c8a172c1c569c474d0 P fd4789b5fa2f4f5682434dedf03355a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcf1a29c27c44bbfabe9397a91a80197" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:09:56.318965 19573 consensus_queue.cc:1035] T 2b11ff5e013146c8a172c1c569c474d0 P fd4789b5fa2f4f5682434dedf03355a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30d1a3f78bbc4e4594806e0bbd55e46a" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 46223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:09:56.321215 19557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:56.320665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.7.39.1:54553)
0809 19:09:56.320896 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:56.320988 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128}
I20260809 19:09:56.322062 19571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:56.321382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.7.39.2:59869)
0809 19:09:56.321673 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:56.321834 (+ 161us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155}
I20260809 19:09:56.328836 19557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:56.328404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.7.39.1:36101)
0809 19:09:56.328620 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:56.328703 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
I20260809 19:09:56.328864 19572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:56.328038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.7.39.3:38033)
0809 19:09:56.328629 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:56.328717 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":475}
I20260809 19:09:56.336977 19579 mvcc.cc:205] Tried to move back new op lower bound from 7316695434510028800 to 7316695434373419008. Current Snapshot: MvccSnapshot[applied={T|T < 7316695434510028800 or (T in {7316695434510028800})}]
I20260809 19:09:56.343484 19572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:56.343154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.7.39.3:36061)
0809 19:09:56.343284 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:56.343351 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260809 19:09:56.344929 18337 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51636:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:09:56.345201 18337 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51636:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:09:56.347565 19571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:56.347072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.7.39.2:43111)
0809 19:09:56.347300 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:56.347386 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125}
I20260809 19:09:56.354841 18337 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dc6e5da415ab45d98a660ab46d312620: Sending DeleteTablet for 3 replicas of tablet 2b11ff5e013146c8a172c1c569c474d0
I20260809 19:09:56.355993 19090 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b11ff5e013146c8a172c1c569c474d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:09:56 UTC) from {username='oryx', principal='oryx/127.7.39.61@KRBTEST.COM'} at 127.0.0.1:50784
I20260809 19:09:56.356451 19089 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b11ff5e013146c8a172c1c569c474d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:09:56 UTC) from {username='oryx', principal='oryx/127.7.39.61@KRBTEST.COM'} at 127.0.0.1:50784
I20260809 19:09:56.356505 18827 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b11ff5e013146c8a172c1c569c474d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:09:56 UTC) from {username='oryx', principal='oryx/127.7.39.61@KRBTEST.COM'} at 127.0.0.1:44796
I20260809 19:09:56.356732 19592 tablet_replica.cc:330] T 2b11ff5e013146c8a172c1c569c474d0 P 30d1a3f78bbc4e4594806e0bbd55e46a: stopping tablet replica
I20260809 19:09:56.356907 19315 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b11ff5e013146c8a172c1c569c474d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:09:56 UTC) from {username='oryx', principal='oryx/127.7.39.61@KRBTEST.COM'} at 127.0.0.1:48442
I20260809 19:09:56.356945 19592 raft_consensus.cc:2229] T 2b11ff5e013146c8a172c1c569c474d0 P 30d1a3f78bbc4e4594806e0bbd55e46a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:09:56.357141 19594 tablet_replica.cc:330] T 2b11ff5e013146c8a172c1c569c474d0 P dcf1a29c27c44bbfabe9397a91a80197: stopping tablet replica
I20260809 19:09:56.357309 19594 raft_consensus.cc:2229] T 2b11ff5e013146c8a172c1c569c474d0 P dcf1a29c27c44bbfabe9397a91a80197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:09:56.357368 19592 raft_consensus.cc:2258] T 2b11ff5e013146c8a172c1c569c474d0 P 30d1a3f78bbc4e4594806e0bbd55e46a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:09:56.357618 19594 raft_consensus.cc:2258] T 2b11ff5e013146c8a172c1c569c474d0 P dcf1a29c27c44bbfabe9397a91a80197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:09:56.358261 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 18603
I20260809 19:09:56.358882 19594 ts_tablet_manager.cc:1905] T 2b11ff5e013146c8a172c1c569c474d0 P dcf1a29c27c44bbfabe9397a91a80197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:09:56.359097 19592 ts_tablet_manager.cc:1905] T 2b11ff5e013146c8a172c1c569c474d0 P 30d1a3f78bbc4e4594806e0bbd55e46a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:09:56.365298 19595 tablet_replica.cc:330] T 2b11ff5e013146c8a172c1c569c474d0 P fd4789b5fa2f4f5682434dedf03355a9: stopping tablet replica
I20260809 19:09:56.365373 19594 ts_tablet_manager.cc:1918] T 2b11ff5e013146c8a172c1c569c474d0 P dcf1a29c27c44bbfabe9397a91a80197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:09:56.365502 19594 log.cc:1196] T 2b11ff5e013146c8a172c1c569c474d0 P dcf1a29c27c44bbfabe9397a91a80197: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-0/wal/wals/2b11ff5e013146c8a172c1c569c474d0
I20260809 19:09:56.365823 19595 raft_consensus.cc:2229] T 2b11ff5e013146c8a172c1c569c474d0 P fd4789b5fa2f4f5682434dedf03355a9 [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:09:56.365950 19594 ts_tablet_manager.cc:1939] T 2b11ff5e013146c8a172c1c569c474d0 P dcf1a29c27c44bbfabe9397a91a80197: Deleting consensus metadata
I20260809 19:09:56.367063 19595 raft_consensus.cc:2258] T 2b11ff5e013146c8a172c1c569c474d0 P fd4789b5fa2f4f5682434dedf03355a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:09:56.367054 18312 catalog_manager.cc:4841] TS dcf1a29c27c44bbfabe9397a91a80197 (127.7.39.1:33499): tablet 2b11ff5e013146c8a172c1c569c474d0 (table test-table [id=b5ed51dc96f443ca8795970eb292596c]) successfully deleted
I20260809 19:09:56.367473 19592 ts_tablet_manager.cc:1918] T 2b11ff5e013146c8a172c1c569c474d0 P 30d1a3f78bbc4e4594806e0bbd55e46a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:09:56.367602 19592 log.cc:1196] T 2b11ff5e013146c8a172c1c569c474d0 P 30d1a3f78bbc4e4594806e0bbd55e46a: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-1/wal/wals/2b11ff5e013146c8a172c1c569c474d0
I20260809 19:09:56.368050 19592 ts_tablet_manager.cc:1939] T 2b11ff5e013146c8a172c1c569c474d0 P 30d1a3f78bbc4e4594806e0bbd55e46a: Deleting consensus metadata
I20260809 19:09:56.368075 19595 ts_tablet_manager.cc:1905] T 2b11ff5e013146c8a172c1c569c474d0 P fd4789b5fa2f4f5682434dedf03355a9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:09:56.369055 18315 catalog_manager.cc:4841] TS 30d1a3f78bbc4e4594806e0bbd55e46a (127.7.39.2:46223): tablet 2b11ff5e013146c8a172c1c569c474d0 (table test-table [id=b5ed51dc96f443ca8795970eb292596c]) successfully deleted
W20260809 19:09:56.369863 18315 catalog_manager.cc:4808] TS 30d1a3f78bbc4e4594806e0bbd55e46a (127.7.39.2:46223): delete failed for tablet 2b11ff5e013146c8a172c1c569c474d0 because the tablet was not found. No further retry: Not found: Tablet not found: 2b11ff5e013146c8a172c1c569c474d0
I20260809 19:09:56.373769 19595 ts_tablet_manager.cc:1918] T 2b11ff5e013146c8a172c1c569c474d0 P fd4789b5fa2f4f5682434dedf03355a9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:09:56.373881 19595 log.cc:1196] T 2b11ff5e013146c8a172c1c569c474d0 P fd4789b5fa2f4f5682434dedf03355a9: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786302538618573-7324-0/minicluster-data/ts-2/wal/wals/2b11ff5e013146c8a172c1c569c474d0
I20260809 19:09:56.374317 19595 ts_tablet_manager.cc:1939] T 2b11ff5e013146c8a172c1c569c474d0 P fd4789b5fa2f4f5682434dedf03355a9: Deleting consensus metadata
I20260809 19:09:56.375162 18315 catalog_manager.cc:4841] TS fd4789b5fa2f4f5682434dedf03355a9 (127.7.39.3:37589): tablet 2b11ff5e013146c8a172c1c569c474d0 (table test-table [id=b5ed51dc96f443ca8795970eb292596c]) successfully deleted
I20260809 19:09:56.381639 19545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:56.359986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44804 (local address 127.7.39.1:33499)
0809 19:09:56.360157 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:56.360164 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:56.366976 (+ 6812us) server_negotiation.cc:407] Connection header received
0809 19:09:56.367122 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:56.367127 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:56.367201 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:56.367308 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:56.369376 (+ 2068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:56.370224 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:56.371972 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:56.372563 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:56.372687 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:56.376025 (+ 3338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:56.376045 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:56.376058 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:56.376088 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:56.378950 (+ 2862us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:56.379725 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:56.379732 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:56.379734 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:56.379851 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:56.380193 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:56.380199 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:56.380203 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:56.380545 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:56.380842 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:56.381113 (+ 271us) server_negotiation.cc:299] Negotiation successful
0809 19:09:56.381340 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 19:09:56.382154 18934 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:56.491355 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 18603
I20260809 19:09:56.499873 19527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:56.499337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.0.0.1:34790)
0809 19:09:56.499542 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:56.499661 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260809 19:09:56.501297 19527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:56.500887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33935 (local address 127.0.0.1:34806)
0809 19:09:56.501058 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:56.501147 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:33935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 19:09:56.515931 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 18975
I20260809 19:09:56.533840 19548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:56.516721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50796 (local address 127.7.39.2:46223)
0809 19:09:56.516908 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:56.516914 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:56.516936 (+ 22us) server_negotiation.cc:407] Connection header received
0809 19:09:56.517124 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:56.517128 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:56.517193 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:56.517291 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:56.518989 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:56.519721 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:56.521451 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:56.521830 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:56.521915 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:56.528160 (+ 6245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:56.528174 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:56.528191 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:56.528225 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:56.531225 (+ 3000us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:56.532029 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:56.532037 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:56.532040 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:56.532161 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:56.532520 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:56.532523 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:56.532525 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:56.532882 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:56.533106 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:56.533376 (+ 270us) server_negotiation.cc:299] Negotiation successful
0809 19:09:56.533552 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 19:09:56.534550 19188 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:56.650664 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 18975
I20260809 19:09:56.685458 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 19217
I20260809 19:09:56.700453 19544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:56.686204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48452 (local address 127.7.39.3:37589)
0809 19:09:56.686390 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:56.686394 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:56.686636 (+ 242us) server_negotiation.cc:407] Connection header received
0809 19:09:56.686764 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:56.686771 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:56.686869 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:56.686986 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:56.688260 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:56.689481 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:56.690727 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:56.691366 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:56.691501 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:56.693680 (+ 2179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:56.693696 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:56.693716 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:56.693774 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:56.697734 (+ 3960us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:56.698342 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:56.698352 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:56.698356 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:56.698546 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:56.698898 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:56.698904 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:56.698907 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:56.699376 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:56.699677 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:56.699833 (+ 156us) server_negotiation.cc:299] Negotiation successful
0809 19:09:56.700052 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 19:09:56.701294 19402 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:56.828100 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 19217
I20260809 19:09:56.856061 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 18118
I20260809 19:09:56.857069 18387 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:56.975849 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 18118
I20260809 19:09:56.998461 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 18273
I20260809 19:09:56.999511 18681 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:09:57.115164 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 18273
2026-08-09T19:09:57Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (9610 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:09:57 dist-test-slave-4tdj krb5kdc[19607](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:09:57 dist-test-slave-4tdj krb5kdc[19607](info): set up 2 sockets
Aug 09 19:09:57 dist-test-slave-4tdj krb5kdc[19607](info): commencing operation
krb5kdc: starting...
W20260809 19:09:58.352759 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.189s user 0.001s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:09:58 dist-test-slave-4tdj krb5kdc[19607](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302598, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:09:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:09:58Z Disabled control of system clock
WARNING: no policy specified for oryx/127.7.39.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.39.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.39.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.62.keytab.
Entry for principal oryx/127.7.39.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.62.keytab.
I20260809 19:09:58.559598 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:33279
--webserver_interface=127.7.39.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.62.keytab
--principal=oryx/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:33101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:33279
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:58.875135 19632 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:58.875397 19632 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:58.875530 19632 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:58.882437 19632 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:09:58.882535 19632 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 19:09:58.882607 19632 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:58.882685 19632 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:58.882746 19632 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:09:58.882830 19632 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:09:58.892267 19632 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:33101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:33279
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.62.keytab
--principal=oryx/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:33279
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:58.893476 19632 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:58.894830 19632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:58.906104 19639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:58.906064 19642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:58.906140 19640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:58.907003 19632 server_base.cc:1034] running on GCE node
I20260809 19:09:58.907760 19632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:58.909067 19632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:58.910282 19632 hybrid_clock.cc:648] HybridClock initialized: now 1786302598910214 us; error 44 us; skew 500 ppm
I20260809 19:09:58.910640 19632 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:58 dist-test-slave-4tdj krb5kdc[19607](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302598, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:58.913486 19632 init.cc:377] Logged in from keytab as oryx/127.7.39.62@KRBTEST.COM (short username oryx)
I20260809 19:09:58.914958 19632 webserver.cc:460] Webserver started at http://127.7.39.62:46497/ using document root <none> and password file <none>
I20260809 19:09:58.915617 19632 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:58.915721 19632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:58.916023 19632 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:58.918921 19632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "7d4db9fc530c4e6fb2db0907fabb09d1"
format_stamp: "Formatted at 2026-08-09 19:09:58 on dist-test-slave-4tdj"
server_key: "3fd0d071bde5a9c9f02986aafa3dad66"
server_key_iv: "b4a40353aa5e4112d5b6fdbf41dace82"
server_key_version: "encryptionkey@0"
I20260809 19:09:58.919688 19632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "7d4db9fc530c4e6fb2db0907fabb09d1"
format_stamp: "Formatted at 2026-08-09 19:09:58 on dist-test-slave-4tdj"
server_key: "3fd0d071bde5a9c9f02986aafa3dad66"
server_key_iv: "b4a40353aa5e4112d5b6fdbf41dace82"
server_key_version: "encryptionkey@0"
I20260809 19:09:58.924628 19632 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 19:09:58.927883 19653 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:58.929126 19632 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 19:09:58.929297 19632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "7d4db9fc530c4e6fb2db0907fabb09d1"
format_stamp: "Formatted at 2026-08-09 19:09:58 on dist-test-slave-4tdj"
server_key: "3fd0d071bde5a9c9f02986aafa3dad66"
server_key_iv: "b4a40353aa5e4112d5b6fdbf41dace82"
server_key_version: "encryptionkey@0"
I20260809 19:09:58.929488 19632 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:58.949930 19632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:58.953667 19632 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:58.953904 19632 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:58.973812 19632 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:33279
I20260809 19:09:58.973830 19757 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:33279 every 8 connection(s)
I20260809 19:09:58.975102 19632 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:09:58.977216 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 19632
I20260809 19:09:58.977442 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:09:58.978271 7324 external_mini_cluster.cc:1428] Setting key 15fafa5b97cf83e3da03ac80d017874c
I20260809 19:09:58.979470 19758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 19:09:58 dist-test-slave-4tdj krb5kdc[19607](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302598, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM
I20260809 19:09:58.992964 19758 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d4db9fc530c4e6fb2db0907fabb09d1: Bootstrap starting.
I20260809 19:09:58.996893 19758 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7d4db9fc530c4e6fb2db0907fabb09d1: Neither blocks nor log segments found. Creating new log.
I20260809 19:09:58.998092 19758 log.cc:824] T 00000000000000000000000000000000 P 7d4db9fc530c4e6fb2db0907fabb09d1: Log is configured to *not* fsync() on all Append() calls
I20260809 19:09:59.000816 19758 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d4db9fc530c4e6fb2db0907fabb09d1: No bootstrap required, opened a new log
I20260809 19:09:59.000907 19762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:58.980312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52702 (local address 127.7.39.62:33279)
0809 19:09:58.981062 (+ 750us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:58.981073 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:58.981112 (+ 39us) server_negotiation.cc:407] Connection header received
0809 19:09:58.982655 (+ 1543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:58.982677 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:58.983059 (+ 382us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:58.983378 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:58.985166 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:58.986619 (+ 1453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:58.988334 (+ 1715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:58.989010 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:58.989145 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:58.993432 (+ 4287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:58.993442 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:58.993459 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:58.993501 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:58.997134 (+ 3633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:58.997767 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:58.997774 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:58.997782 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:58.997992 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:58.998368 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:58.998372 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:58.998374 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:58.998890 (+ 516us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:58.999176 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:58.999622 (+ 446us) server_negotiation.cc:299] Negotiation successful
0809 19:09:58.999972 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":546,"thread_start_us":355,"threads_started":1}
I20260809 19:09:59.008467 19758 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7d4db9fc530c4e6fb2db0907fabb09d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d4db9fc530c4e6fb2db0907fabb09d1" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33279 } }
I20260809 19:09:59.008814 19758 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7d4db9fc530c4e6fb2db0907fabb09d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:09:59.008920 19758 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7d4db9fc530c4e6fb2db0907fabb09d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d4db9fc530c4e6fb2db0907fabb09d1, State: Initialized, Role: FOLLOWER
I20260809 19:09:59.009485 19758 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7d4db9fc530c4e6fb2db0907fabb09d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d4db9fc530c4e6fb2db0907fabb09d1" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33279 } }
I20260809 19:09:59.009711 19758 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7d4db9fc530c4e6fb2db0907fabb09d1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:09:59.009845 19758 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7d4db9fc530c4e6fb2db0907fabb09d1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:09:59.010003 19758 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7d4db9fc530c4e6fb2db0907fabb09d1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:09:59.012311 19758 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7d4db9fc530c4e6fb2db0907fabb09d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d4db9fc530c4e6fb2db0907fabb09d1" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33279 } }
I20260809 19:09:59.012797 19758 leader_election.cc:302] T 00000000000000000000000000000000 P 7d4db9fc530c4e6fb2db0907fabb09d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7d4db9fc530c4e6fb2db0907fabb09d1; no voters:
I20260809 19:09:59.013355 19758 leader_election.cc:288] T 00000000000000000000000000000000 P 7d4db9fc530c4e6fb2db0907fabb09d1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:09:59.013465 19767 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7d4db9fc530c4e6fb2db0907fabb09d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:09:59.014120 19767 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7d4db9fc530c4e6fb2db0907fabb09d1 [term 1 LEADER]: Becoming Leader. State: Replica: 7d4db9fc530c4e6fb2db0907fabb09d1, State: Running, Role: LEADER
I20260809 19:09:59.014655 19767 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7d4db9fc530c4e6fb2db0907fabb09d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d4db9fc530c4e6fb2db0907fabb09d1" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33279 } }
I20260809 19:09:59.015326 19758 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7d4db9fc530c4e6fb2db0907fabb09d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:09:59.017104 19768 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d4db9fc530c4e6fb2db0907fabb09d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7d4db9fc530c4e6fb2db0907fabb09d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d4db9fc530c4e6fb2db0907fabb09d1" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33279 } } }
I20260809 19:09:59.017546 19768 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d4db9fc530c4e6fb2db0907fabb09d1 [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:59.018370 19769 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d4db9fc530c4e6fb2db0907fabb09d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7d4db9fc530c4e6fb2db0907fabb09d1. Latest consensus state: current_term: 1 leader_uuid: "7d4db9fc530c4e6fb2db0907fabb09d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d4db9fc530c4e6fb2db0907fabb09d1" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33279 } } }
I20260809 19:09:59.018986 19778 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:09:59.018996 19769 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d4db9fc530c4e6fb2db0907fabb09d1 [sys.catalog]: This master's current role is: LEADER
I20260809 19:09:59.028573 19778 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:09:59.036375 19778 catalog_manager.cc:1347] Generated new cluster ID: ffcc3951c8424b0086dcf62530890732
I20260809 19:09:59.036482 19778 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:09:59.043510 19778 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:09:59.044687 19778 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:09:59.053735 19778 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7d4db9fc530c4e6fb2db0907fabb09d1: Generated new TSK 0
I20260809 19:09:59.054492 19778 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.7.39.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.39.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.39.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.1.keytab.
Entry for principal oryx/127.7.39.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.1.keytab.
I20260809 19:09:59.111292 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.1:0
--local_ip_for_outbound_sockets=127.7.39.1
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:33279
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.1.keytab
--principal=oryx/127.7.39.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:33101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:59.426582 19795 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:59.426820 19795 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:59.426950 19795 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:59.433848 19795 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:59.433946 19795 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:59.434069 19795 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 19:09:59.434190 19795 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.1
I20260809 19:09:59.443331 19795 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:33101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.1.keytab
--principal=oryx/127.7.39.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.39.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.39.62:33279
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.1
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:59.444455 19795 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:59.445684 19795 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:59.457820 19811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:59.457861 19806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:59.457896 19807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:59.459100 19795 server_base.cc:1034] running on GCE node
I20260809 19:09:59.459668 19795 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:59.460465 19795 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:59.461681 19795 hybrid_clock.cc:648] HybridClock initialized: now 1786302599461623 us; error 44 us; skew 500 ppm
I20260809 19:09:59.461962 19795 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:59 dist-test-slave-4tdj krb5kdc[19607](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302599, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:59.464870 19795 init.cc:377] Logged in from keytab as oryx/127.7.39.1@KRBTEST.COM (short username oryx)
I20260809 19:09:59.466149 19795 webserver.cc:460] Webserver started at http://127.7.39.1:36873/ using document root <none> and password file <none>
I20260809 19:09:59.466817 19795 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:59.466917 19795 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:59.467216 19795 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:59.469911 19795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-0/data/instance:
uuid: "d11071d9f19b4dfa94163e5732641aaa"
format_stamp: "Formatted at 2026-08-09 19:09:59 on dist-test-slave-4tdj"
server_key: "9c0b45e922aa5b9be5723c5e1e695c4d"
server_key_iv: "ece559825f52e5543f39a8231900cc52"
server_key_version: "encryptionkey@0"
I20260809 19:09:59.470682 19795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance:
uuid: "d11071d9f19b4dfa94163e5732641aaa"
format_stamp: "Formatted at 2026-08-09 19:09:59 on dist-test-slave-4tdj"
server_key: "9c0b45e922aa5b9be5723c5e1e695c4d"
server_key_iv: "ece559825f52e5543f39a8231900cc52"
server_key_version: "encryptionkey@0"
I20260809 19:09:59.475443 19795 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 19:09:59.478628 19821 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:59.479885 19795 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:09:59.480023 19795 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-0/wal
uuid: "d11071d9f19b4dfa94163e5732641aaa"
format_stamp: "Formatted at 2026-08-09 19:09:59 on dist-test-slave-4tdj"
server_key: "9c0b45e922aa5b9be5723c5e1e695c4d"
server_key_iv: "ece559825f52e5543f39a8231900cc52"
server_key_version: "encryptionkey@0"
I20260809 19:09:59.480230 19795 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:59.497576 19795 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:59.501458 19795 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:59.501693 19795 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:59.504307 19795 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:59.504405 19795 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:59.504534 19795 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:59.504604 19795 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 19:09:59 dist-test-slave-4tdj krb5kdc[19607](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302599, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM
I20260809 19:09:59.527436 19837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:59.505476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33279 (local address 127.7.39.1:56477)
0809 19:09:59.506252 (+ 776us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:59.506312 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:59.508193 (+ 1881us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:59.508949 (+ 756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:59.508960 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:59.509712 (+ 752us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:59.510506 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:59.510529 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:59.512055 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:59.512061 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:59.514050 (+ 1989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:59.514062 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:59.515188 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:59.515196 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:59.515402 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:59.516109 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:59.516149 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:59.519252 (+ 3103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:59.522658 (+ 3406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:59.522690 (+ 32us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:59.522705 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:59.523340 (+ 635us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:59.523705 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:59.523710 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:59.523718 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:59.524025 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:59.524732 (+ 707us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:59.524741 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:59.525191 (+ 450us) client_negotiation.cc:769] Sending connection context
0809 19:09:59.525477 (+ 286us) client_negotiation.cc:240] Negotiation successful
0809 19:09:59.525922 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"thread_start_us":335,"threads_started":1}
I20260809 19:09:59.528406 19836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:59.504879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:56477 (local address 127.7.39.62:33279)
0809 19:09:59.505447 (+ 568us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:59.505451 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:59.506428 (+ 977us) server_negotiation.cc:407] Connection header received
0809 19:09:59.508484 (+ 2056us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:59.508490 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:59.508582 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:59.508678 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:59.510754 (+ 2076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:59.511868 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:59.514247 (+ 2379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:59.514916 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:59.515072 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:59.519485 (+ 4413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:59.519491 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:59.519496 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:59.519537 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:59.522514 (+ 2977us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:59.523466 (+ 952us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:59.523471 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:59.523475 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:59.523599 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:59.524178 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:59.524183 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:59.524186 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:59.524511 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:59.524668 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:59.527958 (+ 3290us) server_negotiation.cc:299] Negotiation successful
0809 19:09:59.528144 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":469,"thread_start_us":363,"threads_started":1}
I20260809 19:09:59.543534 19795 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.1:33051
I20260809 19:09:59.543634 20006 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.1:33051 every 8 connection(s)
I20260809 19:09:59.544814 19795 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
I20260809 19:09:59.546840 20008 heartbeater.cc:347] Connected to a master server at 127.7.39.62:33279
I20260809 19:09:59.547063 20008 heartbeater.cc:464] Registering TS with master...
I20260809 19:09:59.547704 20008 heartbeater.cc:511] Master 127.7.39.62:33279 requested a full tablet report, sending...
I20260809 19:09:59.548424 19836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:59.534954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:42175 (local address 127.7.39.62:33279)
0809 19:09:59.535112 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:59.535116 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:59.535735 (+ 619us) server_negotiation.cc:407] Connection header received
0809 19:09:59.535896 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:09:59.535902 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:09:59.535976 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:09:59.536081 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:09:59.537294 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:59.538126 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:59.540369 (+ 2243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:09:59.540860 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:09:59.540986 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:59.543081 (+ 2095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:09:59.543088 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:09:59.543092 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:09:59.543123 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:09:59.545751 (+ 2628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:59.546578 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:59.546581 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:59.546584 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:59.546707 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:09:59.547067 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:09:59.547072 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:09:59.547076 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:09:59.547354 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:09:59.547491 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 19:09:59.547895 (+ 404us) server_negotiation.cc:299] Negotiation successful
0809 19:09:59.548098 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 19:09:59.548519 19975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:59.535033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33279 (local address 127.7.39.1:42175)
0809 19:09:59.535637 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:59.535652 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 19:09:59.535787 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:09:59.536132 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:09:59.536137 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:09:59.536764 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:09:59.537158 (+ 394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:59.537171 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:59.538265 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:59.538271 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:59.540214 (+ 1943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:09:59.540236 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:09:59.541271 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:09:59.541281 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:09:59.541461 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:09:59.542029 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:09:59.542046 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:09:59.542908 (+ 862us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:09:59.545913 (+ 3005us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:59.545917 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:59.545921 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:59.546436 (+ 515us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:59.546812 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:09:59.546817 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:09:59.546822 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:09:59.546966 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:09:59.547469 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:09:59.547474 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:09:59.547655 (+ 181us) client_negotiation.cc:769] Sending connection context
0809 19:09:59.547772 (+ 117us) client_negotiation.cc:240] Negotiation successful
0809 19:09:59.548060 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":336,"threads_started":1}
I20260809 19:09:59.549691 19685 ts_manager.cc:194] Registered new tserver with Master: d11071d9f19b4dfa94163e5732641aaa (127.7.39.1:33051)
I20260809 19:09:59.550346 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 19795
I20260809 19:09:59.550550 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance
I20260809 19:09:59.551345 7324 external_mini_cluster.cc:1428] Setting key b6216fc3088071b1cf58167434437667
I20260809 19:09:59.551726 19685 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.39.1@KRBTEST.COM'} at 127.7.39.1:56477
WARNING: no policy specified for oryx/127.7.39.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.39.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.39.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.2.keytab.
Entry for principal oryx/127.7.39.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.2.keytab.
I20260809 19:09:59.596786 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.2:0
--local_ip_for_outbound_sockets=127.7.39.2
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:33279
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.2.keytab
--principal=oryx/127.7.39.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:33101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:09:59.910809 20013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:09:59.911055 20013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:09:59.911188 20013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:09:59.918179 20013 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:09:59.918279 20013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:09:59.918424 20013 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 19:09:59.918541 20013 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.2
I20260809 19:09:59.927906 20013 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:33101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.2.keytab
--principal=oryx/127.7.39.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.39.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.39.62:33279
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.2
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:09:59.929072 20013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:09:59.930390 20013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:09:59.942699 20021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:59.942735 20024 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:09:59.943122 20022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:09:59.943491 20013 server_base.cc:1034] running on GCE node
I20260809 19:09:59.944051 20013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:09:59.944885 20013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:09:59.946101 20013 hybrid_clock.cc:648] HybridClock initialized: now 1786302599946033 us; error 43 us; skew 500 ppm
I20260809 19:09:59.946404 20013 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:09:59 dist-test-slave-4tdj krb5kdc[19607](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302599, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:09:59.949360 20013 init.cc:377] Logged in from keytab as oryx/127.7.39.2@KRBTEST.COM (short username oryx)
I20260809 19:09:59.950703 20013 webserver.cc:460] Webserver started at http://127.7.39.2:38081/ using document root <none> and password file <none>
I20260809 19:09:59.951350 20013 fs_manager.cc:359] Metadata directory not provided
I20260809 19:09:59.951443 20013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:09:59.951743 20013 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:09:59.954524 20013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-1/data/instance:
uuid: "b6f181c35b4f4302abb813ce7bf1907b"
format_stamp: "Formatted at 2026-08-09 19:09:59 on dist-test-slave-4tdj"
server_key: "22639524af872916959eb6329efb7c35"
server_key_iv: "d4e1ee0ea2bb358341c968616afc0509"
server_key_version: "encryptionkey@0"
I20260809 19:09:59.955284 20013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance:
uuid: "b6f181c35b4f4302abb813ce7bf1907b"
format_stamp: "Formatted at 2026-08-09 19:09:59 on dist-test-slave-4tdj"
server_key: "22639524af872916959eb6329efb7c35"
server_key_iv: "d4e1ee0ea2bb358341c968616afc0509"
server_key_version: "encryptionkey@0"
I20260809 19:09:59.960035 20013 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 19:09:59.963407 20036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:59.964685 20013 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 19:09:59.964836 20013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-1/wal
uuid: "b6f181c35b4f4302abb813ce7bf1907b"
format_stamp: "Formatted at 2026-08-09 19:09:59 on dist-test-slave-4tdj"
server_key: "22639524af872916959eb6329efb7c35"
server_key_iv: "d4e1ee0ea2bb358341c968616afc0509"
server_key_version: "encryptionkey@0"
I20260809 19:09:59.965040 20013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:09:59.988747 20013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:09:59.993852 20013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:09:59.994131 20013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:09:59.996892 20013 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:09:59.996982 20013 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:09:59.997113 20013 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:09:59.997169 20013 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 19:10:00 dist-test-slave-4tdj krb5kdc[19607](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302599, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM
I20260809 19:10:00.021266 19836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:59.998537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:33211 (local address 127.7.39.62:33279)
0809 19:09:59.998732 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 19:09:59.998738 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:09:59.999010 (+ 272us) server_negotiation.cc:407] Connection header received
0809 19:10:00.000985 (+ 1975us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:00.001000 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:00.001086 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:00.001177 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:00.003283 (+ 2106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.004358 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.007397 (+ 3039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.008052 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.008198 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:00.013826 (+ 5628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:00.013833 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:00.013838 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:10:00.013882 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:00.017426 (+ 3544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:00.018525 (+ 1099us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:00.018531 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:00.018534 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:00.018687 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:00.019403 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:00.019409 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:00.019412 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:00.019733 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:00.019884 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:00.020672 (+ 788us) server_negotiation.cc:299] Negotiation successful
0809 19:10:00.020922 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 19:10:00.022360 20048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:09:59.997989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33279 (local address 127.7.39.2:33211)
0809 19:09:59.998837 (+ 848us) negotiation.cc:107] Waiting for socket to connect
0809 19:09:59.998892 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:00.000724 (+ 1832us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:00.001467 (+ 743us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:00.001478 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:00.002193 (+ 715us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:00.003101 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:00.003122 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.004564 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.004573 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:00.007148 (+ 2575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:00.007167 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.008577 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.008586 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:00.008950 (+ 364us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:00.009860 (+ 910us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:00.009899 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:00.013438 (+ 3539us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:10:00.017638 (+ 4200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:10:00.017648 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:10:00.017669 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:10:00.018401 (+ 732us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:10:00.018839 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:10:00.018844 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:10:00.018848 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:10:00.019163 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:10:00.019879 (+ 716us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:10:00.019888 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:10:00.020301 (+ 413us) client_negotiation.cc:769] Sending connection context
0809 19:10:00.020541 (+ 240us) client_negotiation.cc:240] Negotiation successful
0809 19:10:00.021082 (+ 541us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":574,"thread_start_us":334,"threads_started":1}
I20260809 19:10:00.042202 20013 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.2:35295
I20260809 19:10:00.042258 20220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.2:35295 every 8 connection(s)
I20260809 19:10:00.043462 20013 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
I20260809 19:10:00.044204 19836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:00.027989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:48161 (local address 127.7.39.62:33279)
0809 19:10:00.028147 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:00.028153 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:00.031230 (+ 3077us) server_negotiation.cc:407] Connection header received
0809 19:10:00.031494 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:00.031501 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:00.031580 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:00.031689 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:00.032521 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.033646 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.035109 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.035758 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.035890 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:00.038160 (+ 2270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:00.038166 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:00.038171 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:10:00.038210 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:00.041297 (+ 3087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:00.042211 (+ 914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:00.042217 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:00.042220 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:00.042405 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:00.042769 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:00.042775 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:00.042779 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:00.043095 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:00.043229 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:00.043640 (+ 411us) server_negotiation.cc:299] Negotiation successful
0809 19:10:00.043843 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 19:10:00.044305 20167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:00.028428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33279 (local address 127.7.39.2:48161)
0809 19:10:00.031098 (+ 2670us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:00.031118 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:00.031329 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:00.031722 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:00.031725 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:00.032121 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:00.032400 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:00.032408 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.033809 (+ 1401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.033814 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:00.034970 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:00.034983 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.035907 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.035911 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:00.036030 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:00.036659 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:00.036685 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:00.037968 (+ 1283us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:10:00.041441 (+ 3473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:10:00.041451 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:10:00.041455 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:10:00.042068 (+ 613us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:10:00.042515 (+ 447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:10:00.042520 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:10:00.042524 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:10:00.042664 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:10:00.043215 (+ 551us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:10:00.043220 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:10:00.043397 (+ 177us) client_negotiation.cc:769] Sending connection context
0809 19:10:00.043523 (+ 126us) client_negotiation.cc:240] Negotiation successful
0809 19:10:00.043843 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2533,"thread_start_us":2407,"threads_started":1}
I20260809 19:10:00.044464 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 20013
I20260809 19:10:00.044643 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance
I20260809 19:10:00.045176 7324 external_mini_cluster.cc:1428] Setting key 0849bf0e85ad033cbfb49c18b4d1561f
I20260809 19:10:00.046342 20222 heartbeater.cc:347] Connected to a master server at 127.7.39.62:33279
I20260809 19:10:00.048091 20222 heartbeater.cc:464] Registering TS with master...
I20260809 19:10:00.048854 20222 heartbeater.cc:511] Master 127.7.39.62:33279 requested a full tablet report, sending...
I20260809 19:10:00.050203 19685 ts_manager.cc:194] Registered new tserver with Master: b6f181c35b4f4302abb813ce7bf1907b (127.7.39.2:35295)
I20260809 19:10:00.050983 19685 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.39.2@KRBTEST.COM'} at 127.7.39.2:33211
WARNING: no policy specified for oryx/127.7.39.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.39.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.39.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.3.keytab.
Entry for principal oryx/127.7.39.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.3.keytab.
I20260809 19:10:00.093456 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.3:0
--local_ip_for_outbound_sockets=127.7.39.3
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:33279
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.3.keytab
--principal=oryx/127.7.39.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:33101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:10:00.408179 20227 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:10:00.408479 20227 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:10:00.408614 20227 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:10:00.416028 20227 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:10:00.416141 20227 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:10:00.416275 20227 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 19:10:00.416386 20227 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.3
I20260809 19:10:00.426090 20227 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:33101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.3.keytab
--principal=oryx/127.7.39.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.39.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.39.62:33279
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.3
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:10:00.427358 20227 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:10:00.428645 20227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:10:00.440995 20232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:00.441061 20233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:00.441097 20237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:10:00.442054 20227 server_base.cc:1034] running on GCE node
I20260809 19:10:00.442621 20227 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:10:00.443428 20227 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:10:00.444629 20227 hybrid_clock.cc:648] HybridClock initialized: now 1786302600444568 us; error 39 us; skew 500 ppm
I20260809 19:10:00.444898 20227 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:10:00 dist-test-slave-4tdj krb5kdc[19607](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302600, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:10:00.447849 20227 init.cc:377] Logged in from keytab as oryx/127.7.39.3@KRBTEST.COM (short username oryx)
I20260809 19:10:00.449115 20227 webserver.cc:460] Webserver started at http://127.7.39.3:43487/ using document root <none> and password file <none>
I20260809 19:10:00.449723 20227 fs_manager.cc:359] Metadata directory not provided
I20260809 19:10:00.449802 20227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:10:00.450057 20227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:10:00.452804 20227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-2/data/instance:
uuid: "a755e075e490411390dd20c2549e53e3"
format_stamp: "Formatted at 2026-08-09 19:10:00 on dist-test-slave-4tdj"
server_key: "76b38f5544d18d53581e4bd5f42be32f"
server_key_iv: "af89f3bcab92f34ec5cc50fd7558ed08"
server_key_version: "encryptionkey@0"
I20260809 19:10:00.453493 20227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance:
uuid: "a755e075e490411390dd20c2549e53e3"
format_stamp: "Formatted at 2026-08-09 19:10:00 on dist-test-slave-4tdj"
server_key: "76b38f5544d18d53581e4bd5f42be32f"
server_key_iv: "af89f3bcab92f34ec5cc50fd7558ed08"
server_key_version: "encryptionkey@0"
I20260809 19:10:00.458202 20227 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 19:10:00.461421 20244 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:00.462641 20227 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20260809 19:10:00.462788 20227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-2/wal
uuid: "a755e075e490411390dd20c2549e53e3"
format_stamp: "Formatted at 2026-08-09 19:10:00 on dist-test-slave-4tdj"
server_key: "76b38f5544d18d53581e4bd5f42be32f"
server_key_iv: "af89f3bcab92f34ec5cc50fd7558ed08"
server_key_version: "encryptionkey@0"
I20260809 19:10:00.462975 20227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:10:00.477399 20227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:10:00.480826 20227 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:10:00.481050 20227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:10:00.483561 20227 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:10:00.483711 20227 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260809 19:10:00.483871 20227 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:10:00.483959 20227 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 19:10:00 dist-test-slave-4tdj krb5kdc[19607](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302600, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM
I20260809 19:10:00.506368 20257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:00.484290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33279 (local address 127.7.39.3:34219)
0809 19:10:00.485172 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:00.485240 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:00.487315 (+ 2075us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:00.487976 (+ 661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:00.487983 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:00.488432 (+ 449us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:00.488940 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:00.488956 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.490330 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.490339 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:00.492748 (+ 2409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:00.492767 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.493715 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.493723 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:00.494024 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:00.494807 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:00.494842 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:00.497980 (+ 3138us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:10:00.501521 (+ 3541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:10:00.501533 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:10:00.501547 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:10:00.502188 (+ 641us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:10:00.502672 (+ 484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:10:00.502676 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:10:00.502680 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:10:00.502963 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:10:00.503730 (+ 767us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:10:00.503741 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:10:00.504083 (+ 342us) client_negotiation.cc:769] Sending connection context
0809 19:10:00.504352 (+ 269us) client_negotiation.cc:240] Negotiation successful
0809 19:10:00.504879 (+ 527us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":597,"thread_start_us":359,"threads_started":1}
I20260809 19:10:00.507143 19836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:00.483834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:34219 (local address 127.7.39.62:33279)
0809 19:10:00.484026 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:00.484032 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:00.485380 (+ 1348us) server_negotiation.cc:407] Connection header received
0809 19:10:00.487566 (+ 2186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:00.487572 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:00.487655 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:00.487749 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:00.489115 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.490128 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.492912 (+ 2784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.493433 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.493565 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:00.498221 (+ 4656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:00.498228 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:00.498234 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:10:00.498278 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:00.501404 (+ 3126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:00.502349 (+ 945us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:00.502355 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:00.502358 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:00.502527 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:00.503130 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:00.503136 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:00.503139 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:00.503493 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:00.503641 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:00.506486 (+ 2845us) server_negotiation.cc:299] Negotiation successful
0809 19:10:00.506749 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 19:10:00.526338 20376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:00.512661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33279 (local address 127.7.39.3:42425)
0809 19:10:00.513317 (+ 656us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:00.513335 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:00.513461 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:00.513758 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:00.513762 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:00.514387 (+ 625us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:00.514825 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:00.514841 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.516097 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.516102 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:00.517404 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:00.517416 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.518464 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.518469 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:00.518698 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:00.519399 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:00.519423 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:00.520495 (+ 1072us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:10:00.523451 (+ 2956us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:10:00.523457 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:10:00.523462 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:10:00.524086 (+ 624us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:10:00.524495 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:10:00.524504 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:10:00.524510 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:10:00.524683 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:10:00.525356 (+ 673us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:10:00.525361 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:10:00.525535 (+ 174us) client_negotiation.cc:769] Sending connection context
0809 19:10:00.525646 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 19:10:00.525874 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":385,"threads_started":1}
I20260809 19:10:00.526389 19836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:00.512259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:42425 (local address 127.7.39.62:33279)
0809 19:10:00.512405 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:00.512409 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:00.513416 (+ 1007us) server_negotiation.cc:407] Connection header received
0809 19:10:00.513570 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:00.513575 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:00.513641 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:00.513723 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:00.514963 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.515953 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.517594 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.518106 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.518238 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:00.520662 (+ 2424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:00.520667 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:00.520670 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:10:00.520703 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:00.523326 (+ 2623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:00.524212 (+ 886us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:00.524217 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:00.524220 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:00.524383 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:00.524837 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:00.524843 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:00.524845 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:00.525191 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:00.525346 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:00.525791 (+ 445us) server_negotiation.cc:299] Negotiation successful
0809 19:10:00.526016 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 19:10:00.531064 20227 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.3:34615
I20260809 19:10:00.531134 20429 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.3:34615 every 8 connection(s)
I20260809 19:10:00.532194 20227 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
I20260809 19:10:00.534022 20431 heartbeater.cc:347] Connected to a master server at 127.7.39.62:33279
I20260809 19:10:00.534236 20431 heartbeater.cc:464] Registering TS with master...
I20260809 19:10:00.534865 20431 heartbeater.cc:511] Master 127.7.39.62:33279 requested a full tablet report, sending...
I20260809 19:10:00.536051 19685 ts_manager.cc:194] Registered new tserver with Master: a755e075e490411390dd20c2549e53e3 (127.7.39.3:34615)
I20260809 19:10:00.536808 19685 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.39.3@KRBTEST.COM'} at 127.7.39.3:34219
I20260809 19:10:00.540483 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 20227
I20260809 19:10:00.540618 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance
I20260809 19:10:00.541002 7324 external_mini_cluster.cc:1428] Setting key 5c99a57f6efba779723461ffde01c905
I20260809 19:10:00.543769 7324 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 19:10:00.554431 20008 heartbeater.cc:503] Master 127.7.39.62:33279 was elected leader, sending a full tablet report...
Aug 09 19:10:00 dist-test-slave-4tdj krb5kdc[19607](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302600, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 19:10:00 dist-test-slave-4tdj krb5kdc[19607](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:00 dist-test-slave-4tdj krb5kdc[19607](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
W20260809 19:10:00.592067 19836 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:00.582559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52710 (local address 127.7.39.62:33279)
0809 19:10:00.582789 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:00.582795 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:00.582974 (+ 179us) server_negotiation.cc:407] Connection header received
0809 19:10:00.583136 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:00.583140 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:00.583205 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:00.583292 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:00.584592 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.585294 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.586474 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.586897 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.586986 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:00.591758 (+ 4772us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52710: BlockingRecv error: recv got EOF from 127.0.0.1:52710 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 09 19:10:00 dist-test-slave-4tdj krb5kdc[19607](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302600, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM
I20260809 19:10:00.607050 19836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:00.595157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52716 (local address 127.7.39.62:33279)
0809 19:10:00.595327 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:00.595332 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:00.595623 (+ 291us) server_negotiation.cc:407] Connection header received
0809 19:10:00.595769 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:00.595773 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:00.595828 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:00.595904 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:00.596957 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.597626 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.598800 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.599181 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.599285 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:00.602515 (+ 3230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:00.602520 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:00.602523 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:10:00.602561 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:00.604727 (+ 2166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:00.605307 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:00.605311 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:00.605313 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:00.605439 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:00.605782 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:00.605787 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:00.605790 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:00.606039 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:00.606326 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:00.606563 (+ 237us) server_negotiation.cc:299] Negotiation successful
0809 19:10:00.606776 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 19:10:00.614603 19685 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52716:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:10:00.621666 19685 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:10:00.655560 20467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:00.633325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:34615 (local address 127.0.0.1:55506)
0809 19:10:00.645715 (+ 12390us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:00.645733 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:00.645844 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:00.647314 (+ 1470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:00.647320 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:00.647346 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:10:00.647764 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:00.647776 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.649917 (+ 2141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.649924 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:00.652548 (+ 2624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:00.652559 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.654096 (+ 1537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.654103 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:00.654717 (+ 614us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:00.654780 (+ 63us) client_negotiation.cc:769] Sending connection context
0809 19:10:00.654935 (+ 155us) client_negotiation.cc:240] Negotiation successful
0809 19:10:00.655113 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12263,"mutex_wait_us":54,"thread_start_us":11353,"threads_started":1}
I20260809 19:10:00.655664 20464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:00.633375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60908 (local address 127.7.39.1:33051)
0809 19:10:00.644355 (+ 10980us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:00.644364 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:00.645585 (+ 1221us) server_negotiation.cc:407] Connection header received
0809 19:10:00.645693 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:00.645700 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:00.645956 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:00.646444 (+ 488us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:10:00.647423 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.650230 (+ 2807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.653446 (+ 3216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.654702 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.654823 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:00.655017 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:00.655238 (+ 221us) server_negotiation.cc:299] Negotiation successful
0809 19:10:00.655400 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10814,"thread_start_us":10998,"threads_started":1}
I20260809 19:10:00.656486 20468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:00.633996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55506 (local address 127.7.39.3:34615)
0809 19:10:00.646446 (+ 12450us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:00.646454 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:00.646487 (+ 33us) server_negotiation.cc:407] Connection header received
0809 19:10:00.646583 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:00.646591 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:00.646827 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:00.647002 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:10:00.648011 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.649748 (+ 1737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.652690 (+ 2942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.653905 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.654029 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:00.654260 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:00.656035 (+ 1775us) server_negotiation.cc:299] Negotiation successful
0809 19:10:00.656183 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12242,"thread_start_us":12085,"threads_started":1}
I20260809 19:10:00.655715 20465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:00.633119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:33051 (local address 127.0.0.1:60908)
0809 19:10:00.645087 (+ 11968us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:00.645133 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:00.645356 (+ 223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:00.646722 (+ 1366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:00.646731 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:00.646763 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:10:00.647218 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:00.647231 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.650417 (+ 3186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.650422 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:00.653284 (+ 2862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:00.653300 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.654915 (+ 1615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.654922 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:00.655079 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:00.655104 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 19:10:00.655181 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 19:10:00.655301 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11690,"mutex_wait_us":63,"thread_start_us":17511,"threads_started":1}
I20260809 19:10:00.658123 20463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:00.633730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:35295 (local address 127.0.0.1:32786)
0809 19:10:00.651058 (+ 17328us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:00.651076 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:00.651208 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:00.651811 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:00.651816 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:00.651842 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:10:00.652249 (+ 407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:00.652262 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.653880 (+ 1618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.653884 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:00.655899 (+ 2015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:00.655914 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.657424 (+ 1510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.657430 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:00.657599 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:00.657629 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 19:10:00.657716 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 19:10:00.657831 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17189,"mutex_wait_us":22,"thread_start_us":11719,"threads_started":1}
I20260809 19:10:00.658787 20469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:00.634250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32786 (local address 127.7.39.2:35295)
0809 19:10:00.650226 (+ 15976us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:00.650234 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:00.651186 (+ 952us) server_negotiation.cc:407] Connection header received
0809 19:10:00.651362 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:00.651370 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:00.651617 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:00.651796 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:10:00.652487 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.653738 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.656028 (+ 2290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.657252 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.657350 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:00.657489 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:00.658358 (+ 869us) server_negotiation.cc:299] Negotiation successful
0809 19:10:00.658512 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15816,"thread_start_us":15949,"threads_started":1}
I20260809 19:10:00.660352 20329 tablet_service.cc:1467] Processing CreateTablet for tablet c274fb8db24143e2ae085385cbf04a73 (DEFAULT_TABLE table=test-table [id=4673c7e9fa3b48a68522ae178c8641c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:10:00.660472 19898 tablet_service.cc:1467] Processing CreateTablet for tablet c274fb8db24143e2ae085385cbf04a73 (DEFAULT_TABLE table=test-table [id=4673c7e9fa3b48a68522ae178c8641c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:10:00.661588 20329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c274fb8db24143e2ae085385cbf04a73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:10:00.661660 19898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c274fb8db24143e2ae085385cbf04a73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:10:00.663579 20117 tablet_service.cc:1467] Processing CreateTablet for tablet c274fb8db24143e2ae085385cbf04a73 (DEFAULT_TABLE table=test-table [id=4673c7e9fa3b48a68522ae178c8641c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:10:00.664471 20117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c274fb8db24143e2ae085385cbf04a73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:10:00.675486 20471 tablet_bootstrap.cc:492] T c274fb8db24143e2ae085385cbf04a73 P b6f181c35b4f4302abb813ce7bf1907b: Bootstrap starting.
I20260809 19:10:00.678803 20471 tablet_bootstrap.cc:654] T c274fb8db24143e2ae085385cbf04a73 P b6f181c35b4f4302abb813ce7bf1907b: Neither blocks nor log segments found. Creating new log.
I20260809 19:10:00.680027 20471 log.cc:824] T c274fb8db24143e2ae085385cbf04a73 P b6f181c35b4f4302abb813ce7bf1907b: Log is configured to *not* fsync() on all Append() calls
I20260809 19:10:00.681422 20474 tablet_bootstrap.cc:492] T c274fb8db24143e2ae085385cbf04a73 P a755e075e490411390dd20c2549e53e3: Bootstrap starting.
I20260809 19:10:00.682595 20475 tablet_bootstrap.cc:492] T c274fb8db24143e2ae085385cbf04a73 P d11071d9f19b4dfa94163e5732641aaa: Bootstrap starting.
I20260809 19:10:00.683259 20471 tablet_bootstrap.cc:492] T c274fb8db24143e2ae085385cbf04a73 P b6f181c35b4f4302abb813ce7bf1907b: No bootstrap required, opened a new log
I20260809 19:10:00.683590 20471 ts_tablet_manager.cc:1397] T c274fb8db24143e2ae085385cbf04a73 P b6f181c35b4f4302abb813ce7bf1907b: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260809 19:10:00.686270 20475 tablet_bootstrap.cc:654] T c274fb8db24143e2ae085385cbf04a73 P d11071d9f19b4dfa94163e5732641aaa: Neither blocks nor log segments found. Creating new log.
I20260809 19:10:00.687601 20475 log.cc:824] T c274fb8db24143e2ae085385cbf04a73 P d11071d9f19b4dfa94163e5732641aaa: Log is configured to *not* fsync() on all Append() calls
I20260809 19:10:00.689313 20474 tablet_bootstrap.cc:654] T c274fb8db24143e2ae085385cbf04a73 P a755e075e490411390dd20c2549e53e3: Neither blocks nor log segments found. Creating new log.
I20260809 19:10:00.690182 20474 log.cc:824] T c274fb8db24143e2ae085385cbf04a73 P a755e075e490411390dd20c2549e53e3: Log is configured to *not* fsync() on all Append() calls
I20260809 19:10:00.690845 20475 tablet_bootstrap.cc:492] T c274fb8db24143e2ae085385cbf04a73 P d11071d9f19b4dfa94163e5732641aaa: No bootstrap required, opened a new log
I20260809 19:10:00.691161 20475 ts_tablet_manager.cc:1397] T c274fb8db24143e2ae085385cbf04a73 P d11071d9f19b4dfa94163e5732641aaa: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260809 19:10:00.692441 20474 tablet_bootstrap.cc:492] T c274fb8db24143e2ae085385cbf04a73 P a755e075e490411390dd20c2549e53e3: No bootstrap required, opened a new log
I20260809 19:10:00.692677 20474 ts_tablet_manager.cc:1397] T c274fb8db24143e2ae085385cbf04a73 P a755e075e490411390dd20c2549e53e3: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.000s
I20260809 19:10:00.693882 20471 raft_consensus.cc:348] T c274fb8db24143e2ae085385cbf04a73 P b6f181c35b4f4302abb813ce7bf1907b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } }
I20260809 19:10:00.694344 20471 raft_consensus.cc:374] T c274fb8db24143e2ae085385cbf04a73 P b6f181c35b4f4302abb813ce7bf1907b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:10:00.694453 20471 raft_consensus.cc:729] T c274fb8db24143e2ae085385cbf04a73 P b6f181c35b4f4302abb813ce7bf1907b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f181c35b4f4302abb813ce7bf1907b, State: Initialized, Role: FOLLOWER
I20260809 19:10:00.695073 20471 consensus_queue.cc:260] T c274fb8db24143e2ae085385cbf04a73 P b6f181c35b4f4302abb813ce7bf1907b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } }
I20260809 19:10:00.696146 20222 heartbeater.cc:503] Master 127.7.39.62:33279 was elected leader, sending a full tablet report...
I20260809 19:10:00.696906 20471 ts_tablet_manager.cc:1428] T c274fb8db24143e2ae085385cbf04a73 P b6f181c35b4f4302abb813ce7bf1907b: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260809 19:10:00.700699 20475 raft_consensus.cc:348] T c274fb8db24143e2ae085385cbf04a73 P d11071d9f19b4dfa94163e5732641aaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } }
I20260809 19:10:00.701133 20475 raft_consensus.cc:374] T c274fb8db24143e2ae085385cbf04a73 P d11071d9f19b4dfa94163e5732641aaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:10:00.701237 20475 raft_consensus.cc:729] T c274fb8db24143e2ae085385cbf04a73 P d11071d9f19b4dfa94163e5732641aaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d11071d9f19b4dfa94163e5732641aaa, State: Initialized, Role: FOLLOWER
I20260809 19:10:00.701813 20475 consensus_queue.cc:260] T c274fb8db24143e2ae085385cbf04a73 P d11071d9f19b4dfa94163e5732641aaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } }
I20260809 19:10:00.703197 20474 raft_consensus.cc:348] T c274fb8db24143e2ae085385cbf04a73 P a755e075e490411390dd20c2549e53e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } }
I20260809 19:10:00.703491 20474 raft_consensus.cc:374] T c274fb8db24143e2ae085385cbf04a73 P a755e075e490411390dd20c2549e53e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:10:00.703560 20475 ts_tablet_manager.cc:1428] T c274fb8db24143e2ae085385cbf04a73 P d11071d9f19b4dfa94163e5732641aaa: Time spent starting tablet: real 0.012s user 0.008s sys 0.003s
I20260809 19:10:00.703583 20474 raft_consensus.cc:729] T c274fb8db24143e2ae085385cbf04a73 P a755e075e490411390dd20c2549e53e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a755e075e490411390dd20c2549e53e3, State: Initialized, Role: FOLLOWER
I20260809 19:10:00.704144 20474 consensus_queue.cc:260] T c274fb8db24143e2ae085385cbf04a73 P a755e075e490411390dd20c2549e53e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } }
I20260809 19:10:00.705112 20431 heartbeater.cc:503] Master 127.7.39.62:33279 was elected leader, sending a full tablet report...
I20260809 19:10:00.705724 20474 ts_tablet_manager.cc:1428] T c274fb8db24143e2ae085385cbf04a73 P a755e075e490411390dd20c2549e53e3: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
W20260809 19:10:00.783785 20433 tablet.cc:2369] T c274fb8db24143e2ae085385cbf04a73 P a755e075e490411390dd20c2549e53e3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 19:10:00.796103 20223 tablet.cc:2369] T c274fb8db24143e2ae085385cbf04a73 P b6f181c35b4f4302abb813ce7bf1907b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 19:10:00.797006 20010 tablet.cc:2369] T c274fb8db24143e2ae085385cbf04a73 P d11071d9f19b4dfa94163e5732641aaa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:10:00.905807 20480 raft_consensus.cc:482] T c274fb8db24143e2ae085385cbf04a73 P b6f181c35b4f4302abb813ce7bf1907b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:10:00.906086 20480 raft_consensus.cc:504] T c274fb8db24143e2ae085385cbf04a73 P b6f181c35b4f4302abb813ce7bf1907b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } }
I20260809 19:10:00.907742 20480 leader_election.cc:288] T c274fb8db24143e2ae085385cbf04a73 P b6f181c35b4f4302abb813ce7bf1907b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d11071d9f19b4dfa94163e5732641aaa (127.7.39.1:33051), a755e075e490411390dd20c2549e53e3 (127.7.39.3:34615)
I20260809 19:10:00.914167 20468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:00.908218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:45989 (local address 127.7.39.3:34615)
0809 19:10:00.908398 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:00.908403 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:00.909008 (+ 605us) server_negotiation.cc:407] Connection header received
0809 19:10:00.909196 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:00.909200 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:00.909262 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:00.909335 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:10:00.910017 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.910768 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.912527 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.913278 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.913390 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:00.913494 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:00.913796 (+ 302us) server_negotiation.cc:299] Negotiation successful
0809 19:10:00.913915 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 19:10:00.914191 20464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:00.908187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:43221 (local address 127.7.39.1:33051)
0809 19:10:00.908381 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:00.908387 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:00.909087 (+ 700us) server_negotiation.cc:407] Connection header received
0809 19:10:00.909279 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:00.909282 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:00.909349 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:00.909424 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:10:00.910092 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.910836 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.912596 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.913342 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.913458 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:00.913557 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:00.913835 (+ 278us) server_negotiation.cc:299] Negotiation successful
0809 19:10:00.913955 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 19:10:00.914376 20488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:00.908030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:34615 (local address 127.7.39.2:45989)
0809 19:10:00.908903 (+ 873us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:00.908923 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:00.909065 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:00.909370 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:00.909374 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:00.909396 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:10:00.909877 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:00.909890 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.910897 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.910901 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:00.912378 (+ 1477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:00.912390 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.913494 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.913501 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:00.913652 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:00.913676 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 19:10:00.913756 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 19:10:00.913874 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":715,"mutex_wait_us":18,"thread_start_us":348,"threads_started":1}
I20260809 19:10:00.914474 20490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:00.908128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:33051 (local address 127.7.39.2:43221)
0809 19:10:00.908995 (+ 867us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:00.909014 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:00.909145 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:00.909455 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:00.909459 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:00.909498 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:10:00.909938 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:00.909947 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.910965 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.910970 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:00.912450 (+ 1480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:00.912462 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.913565 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.913575 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:00.913698 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:00.913720 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 19:10:00.913796 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 19:10:00.913911 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":725,"mutex_wait_us":2,"thread_start_us":493,"threads_started":1}
I20260809 19:10:00.915318 20355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c274fb8db24143e2ae085385cbf04a73" candidate_uuid: "b6f181c35b4f4302abb813ce7bf1907b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a755e075e490411390dd20c2549e53e3" is_pre_election: true
I20260809 19:10:00.915385 19931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c274fb8db24143e2ae085385cbf04a73" candidate_uuid: "b6f181c35b4f4302abb813ce7bf1907b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d11071d9f19b4dfa94163e5732641aaa" is_pre_election: true
I20260809 19:10:00.915827 20355 raft_consensus.cc:2454] T c274fb8db24143e2ae085385cbf04a73 P a755e075e490411390dd20c2549e53e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f181c35b4f4302abb813ce7bf1907b in term 0.
I20260809 19:10:00.915818 19931 raft_consensus.cc:2454] T c274fb8db24143e2ae085385cbf04a73 P d11071d9f19b4dfa94163e5732641aaa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f181c35b4f4302abb813ce7bf1907b in term 0.
I20260809 19:10:00.916450 20040 leader_election.cc:302] T c274fb8db24143e2ae085385cbf04a73 P b6f181c35b4f4302abb813ce7bf1907b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: a755e075e490411390dd20c2549e53e3, b6f181c35b4f4302abb813ce7bf1907b, d11071d9f19b4dfa94163e5732641aaa; no voters:
I20260809 19:10:00.916821 20480 raft_consensus.cc:2781] T c274fb8db24143e2ae085385cbf04a73 P b6f181c35b4f4302abb813ce7bf1907b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:10:00.916947 20480 raft_consensus.cc:482] T c274fb8db24143e2ae085385cbf04a73 P b6f181c35b4f4302abb813ce7bf1907b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:10:00.917044 20480 raft_consensus.cc:3037] T c274fb8db24143e2ae085385cbf04a73 P b6f181c35b4f4302abb813ce7bf1907b [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:10:00.919180 20480 raft_consensus.cc:504] T c274fb8db24143e2ae085385cbf04a73 P b6f181c35b4f4302abb813ce7bf1907b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } }
I20260809 19:10:00.919744 20480 leader_election.cc:288] T c274fb8db24143e2ae085385cbf04a73 P b6f181c35b4f4302abb813ce7bf1907b [CANDIDATE]: Term 1 election: Requested vote from peers d11071d9f19b4dfa94163e5732641aaa (127.7.39.1:33051), a755e075e490411390dd20c2549e53e3 (127.7.39.3:34615)
I20260809 19:10:00.920140 19931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c274fb8db24143e2ae085385cbf04a73" candidate_uuid: "b6f181c35b4f4302abb813ce7bf1907b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d11071d9f19b4dfa94163e5732641aaa"
I20260809 19:10:00.920140 20355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c274fb8db24143e2ae085385cbf04a73" candidate_uuid: "b6f181c35b4f4302abb813ce7bf1907b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a755e075e490411390dd20c2549e53e3"
I20260809 19:10:00.920332 20355 raft_consensus.cc:3037] T c274fb8db24143e2ae085385cbf04a73 P a755e075e490411390dd20c2549e53e3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:10:00.920332 19931 raft_consensus.cc:3037] T c274fb8db24143e2ae085385cbf04a73 P d11071d9f19b4dfa94163e5732641aaa [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:10:00.923360 19931 raft_consensus.cc:2454] T c274fb8db24143e2ae085385cbf04a73 P d11071d9f19b4dfa94163e5732641aaa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f181c35b4f4302abb813ce7bf1907b in term 1.
I20260809 19:10:00.923367 20355 raft_consensus.cc:2454] T c274fb8db24143e2ae085385cbf04a73 P a755e075e490411390dd20c2549e53e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f181c35b4f4302abb813ce7bf1907b in term 1.
I20260809 19:10:00.923754 20040 leader_election.cc:302] T c274fb8db24143e2ae085385cbf04a73 P b6f181c35b4f4302abb813ce7bf1907b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: a755e075e490411390dd20c2549e53e3, b6f181c35b4f4302abb813ce7bf1907b, d11071d9f19b4dfa94163e5732641aaa; no voters:
I20260809 19:10:00.924022 20480 raft_consensus.cc:2781] T c274fb8db24143e2ae085385cbf04a73 P b6f181c35b4f4302abb813ce7bf1907b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:10:00.924407 20480 raft_consensus.cc:686] T c274fb8db24143e2ae085385cbf04a73 P b6f181c35b4f4302abb813ce7bf1907b [term 1 LEADER]: Becoming Leader. State: Replica: b6f181c35b4f4302abb813ce7bf1907b, State: Running, Role: LEADER
I20260809 19:10:00.924932 20480 consensus_queue.cc:237] T c274fb8db24143e2ae085385cbf04a73 P b6f181c35b4f4302abb813ce7bf1907b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } }
I20260809 19:10:00.929142 19684 catalog_manager.cc:5495] T c274fb8db24143e2ae085385cbf04a73 P b6f181c35b4f4302abb813ce7bf1907b reported cstate change: term changed from 0 to 1, leader changed from <none> to b6f181c35b4f4302abb813ce7bf1907b (127.7.39.2). New cstate: current_term: 1 leader_uuid: "b6f181c35b4f4302abb813ce7bf1907b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } health_report { overall_health: HEALTHY } } }
I20260809 19:10:00.953454 20469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:00.948783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32790 (local address 127.7.39.2:35295)
0809 19:10:00.948936 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:00.948940 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:00.949030 (+ 90us) server_negotiation.cc:407] Connection header received
0809 19:10:00.949231 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:00.949234 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:00.949307 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:00.949422 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:10:00.949668 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.950398 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.951599 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:00.951998 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:00.952090 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:00.952551 (+ 461us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:10:00.953027 (+ 476us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:10:00.953135 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:00.953199 (+ 64us) server_negotiation.cc:299] Negotiation successful
0809 19:10:00.953260 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 19:10:00.961229 19931 raft_consensus.cc:1261] T c274fb8db24143e2ae085385cbf04a73 P d11071d9f19b4dfa94163e5732641aaa [term 1 FOLLOWER]: Refusing update from remote peer b6f181c35b4f4302abb813ce7bf1907b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:10:00.961231 20355 raft_consensus.cc:1261] T c274fb8db24143e2ae085385cbf04a73 P a755e075e490411390dd20c2549e53e3 [term 1 FOLLOWER]: Refusing update from remote peer b6f181c35b4f4302abb813ce7bf1907b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:10:00.962224 20491 consensus_queue.cc:1035] T c274fb8db24143e2ae085385cbf04a73 P b6f181c35b4f4302abb813ce7bf1907b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:10:00.962602 20480 consensus_queue.cc:1035] T c274fb8db24143e2ae085385cbf04a73 P b6f181c35b4f4302abb813ce7bf1907b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:10:00.973722 20500 mvcc.cc:205] Tried to move back new op lower bound from 7316695453527814144 to 7316695453392039936. Current Snapshot: MvccSnapshot[applied={T|T < 7316695453527814144}]
I20260809 19:10:00.991696 19685 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52716:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:10:00.991992 19685 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52716:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:10:00.995935 19685 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7d4db9fc530c4e6fb2db0907fabb09d1: Sending DeleteTablet for 3 replicas of tablet c274fb8db24143e2ae085385cbf04a73
I20260809 19:10:00.997074 19898 tablet_service.cc:1514] Processing DeleteTablet for tablet c274fb8db24143e2ae085385cbf04a73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:10:00 UTC) from {username='oryx', principal='oryx/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:60908
I20260809 19:10:00.997094 20329 tablet_service.cc:1514] Processing DeleteTablet for tablet c274fb8db24143e2ae085385cbf04a73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:10:00 UTC) from {username='oryx', principal='oryx/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:55506
I20260809 19:10:00.998091 20117 tablet_service.cc:1514] Processing DeleteTablet for tablet c274fb8db24143e2ae085385cbf04a73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:10:00 UTC) from {username='oryx', principal='oryx/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:32786
I20260809 19:10:00.998416 19684 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52716:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:10:00.999110 19684 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:10:01.007861 19897 tablet_service.cc:1467] Processing CreateTablet for tablet 51bc1f2086b0425f9bc2369ed89cd6cd (DEFAULT_TABLE table=test-table [id=dbd3ff4c2cb54bf0ac7f5a7c70c6323a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:10:01.007913 20326 tablet_service.cc:1467] Processing CreateTablet for tablet 51bc1f2086b0425f9bc2369ed89cd6cd (DEFAULT_TABLE table=test-table [id=dbd3ff4c2cb54bf0ac7f5a7c70c6323a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:10:01.008358 20326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51bc1f2086b0425f9bc2369ed89cd6cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:10:01.008432 19897 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51bc1f2086b0425f9bc2369ed89cd6cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:10:01.011240 20114 tablet_service.cc:1467] Processing CreateTablet for tablet 51bc1f2086b0425f9bc2369ed89cd6cd (DEFAULT_TABLE table=test-table [id=dbd3ff4c2cb54bf0ac7f5a7c70c6323a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:10:01.011855 20114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51bc1f2086b0425f9bc2369ed89cd6cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:10:01.015175 20475 tablet_bootstrap.cc:492] T 51bc1f2086b0425f9bc2369ed89cd6cd P d11071d9f19b4dfa94163e5732641aaa: Bootstrap starting.
I20260809 19:10:01.016762 20475 tablet_bootstrap.cc:654] T 51bc1f2086b0425f9bc2369ed89cd6cd P d11071d9f19b4dfa94163e5732641aaa: Neither blocks nor log segments found. Creating new log.
I20260809 19:10:01.018642 20474 tablet_bootstrap.cc:492] T 51bc1f2086b0425f9bc2369ed89cd6cd P a755e075e490411390dd20c2549e53e3: Bootstrap starting.
I20260809 19:10:01.020318 20474 tablet_bootstrap.cc:654] T 51bc1f2086b0425f9bc2369ed89cd6cd P a755e075e490411390dd20c2549e53e3: Neither blocks nor log segments found. Creating new log.
I20260809 19:10:01.021391 20471 tablet_bootstrap.cc:492] T 51bc1f2086b0425f9bc2369ed89cd6cd P b6f181c35b4f4302abb813ce7bf1907b: Bootstrap starting.
I20260809 19:10:01.023046 20471 tablet_bootstrap.cc:654] T 51bc1f2086b0425f9bc2369ed89cd6cd P b6f181c35b4f4302abb813ce7bf1907b: Neither blocks nor log segments found. Creating new log.
I20260809 19:10:01.028007 20471 tablet_bootstrap.cc:492] T 51bc1f2086b0425f9bc2369ed89cd6cd P b6f181c35b4f4302abb813ce7bf1907b: No bootstrap required, opened a new log
I20260809 19:10:01.028165 20471 ts_tablet_manager.cc:1397] T 51bc1f2086b0425f9bc2369ed89cd6cd P b6f181c35b4f4302abb813ce7bf1907b: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.003s
I20260809 19:10:01.029191 20475 tablet_bootstrap.cc:492] T 51bc1f2086b0425f9bc2369ed89cd6cd P d11071d9f19b4dfa94163e5732641aaa: No bootstrap required, opened a new log
I20260809 19:10:01.029042 20471 raft_consensus.cc:348] T 51bc1f2086b0425f9bc2369ed89cd6cd P b6f181c35b4f4302abb813ce7bf1907b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } }
I20260809 19:10:01.029278 20471 raft_consensus.cc:374] T 51bc1f2086b0425f9bc2369ed89cd6cd P b6f181c35b4f4302abb813ce7bf1907b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:10:01.029392 20475 ts_tablet_manager.cc:1397] T 51bc1f2086b0425f9bc2369ed89cd6cd P d11071d9f19b4dfa94163e5732641aaa: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.008s
I20260809 19:10:01.029383 20471 raft_consensus.cc:729] T 51bc1f2086b0425f9bc2369ed89cd6cd P b6f181c35b4f4302abb813ce7bf1907b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f181c35b4f4302abb813ce7bf1907b, State: Initialized, Role: FOLLOWER
I20260809 19:10:01.029711 20471 consensus_queue.cc:260] T 51bc1f2086b0425f9bc2369ed89cd6cd P b6f181c35b4f4302abb813ce7bf1907b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } }
I20260809 19:10:01.030769 20475 raft_consensus.cc:348] T 51bc1f2086b0425f9bc2369ed89cd6cd P d11071d9f19b4dfa94163e5732641aaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } }
I20260809 19:10:01.031085 20471 ts_tablet_manager.cc:1428] T 51bc1f2086b0425f9bc2369ed89cd6cd P b6f181c35b4f4302abb813ce7bf1907b: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260809 19:10:01.031101 20475 raft_consensus.cc:374] T 51bc1f2086b0425f9bc2369ed89cd6cd P d11071d9f19b4dfa94163e5732641aaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:10:01.031293 20475 raft_consensus.cc:729] T 51bc1f2086b0425f9bc2369ed89cd6cd P d11071d9f19b4dfa94163e5732641aaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d11071d9f19b4dfa94163e5732641aaa, State: Initialized, Role: FOLLOWER
I20260809 19:10:01.031649 20475 consensus_queue.cc:260] T 51bc1f2086b0425f9bc2369ed89cd6cd P d11071d9f19b4dfa94163e5732641aaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } }
I20260809 19:10:01.032348 20475 ts_tablet_manager.cc:1428] T 51bc1f2086b0425f9bc2369ed89cd6cd P d11071d9f19b4dfa94163e5732641aaa: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260809 19:10:01.033059 20513 tablet_replica.cc:330] T c274fb8db24143e2ae085385cbf04a73 P d11071d9f19b4dfa94163e5732641aaa: stopping tablet replica
I20260809 19:10:01.033566 20513 raft_consensus.cc:2229] T c274fb8db24143e2ae085385cbf04a73 P d11071d9f19b4dfa94163e5732641aaa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:10:01.034122 20513 raft_consensus.cc:2258] T c274fb8db24143e2ae085385cbf04a73 P d11071d9f19b4dfa94163e5732641aaa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:10:01.034958 20511 tablet_replica.cc:330] T c274fb8db24143e2ae085385cbf04a73 P a755e075e490411390dd20c2549e53e3: stopping tablet replica
I20260809 19:10:01.035658 20511 raft_consensus.cc:2229] T c274fb8db24143e2ae085385cbf04a73 P a755e075e490411390dd20c2549e53e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:10:01.036132 20511 raft_consensus.cc:2258] T c274fb8db24143e2ae085385cbf04a73 P a755e075e490411390dd20c2549e53e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:10:01.038312 20511 ts_tablet_manager.cc:1905] T c274fb8db24143e2ae085385cbf04a73 P a755e075e490411390dd20c2549e53e3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:10:01.041055 20513 ts_tablet_manager.cc:1905] T c274fb8db24143e2ae085385cbf04a73 P d11071d9f19b4dfa94163e5732641aaa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:10:01.045166 20474 tablet_bootstrap.cc:492] T 51bc1f2086b0425f9bc2369ed89cd6cd P a755e075e490411390dd20c2549e53e3: No bootstrap required, opened a new log
I20260809 19:10:01.045342 20474 ts_tablet_manager.cc:1397] T 51bc1f2086b0425f9bc2369ed89cd6cd P a755e075e490411390dd20c2549e53e3: Time spent bootstrapping tablet: real 0.027s user 0.009s sys 0.000s
I20260809 19:10:01.045382 20511 ts_tablet_manager.cc:1918] T c274fb8db24143e2ae085385cbf04a73 P a755e075e490411390dd20c2549e53e3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:10:01.045631 20511 log.cc:1196] T c274fb8db24143e2ae085385cbf04a73 P a755e075e490411390dd20c2549e53e3: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-2/wal/wals/c274fb8db24143e2ae085385cbf04a73
I20260809 19:10:01.046236 20511 ts_tablet_manager.cc:1939] T c274fb8db24143e2ae085385cbf04a73 P a755e075e490411390dd20c2549e53e3: Deleting consensus metadata
I20260809 19:10:01.046185 20474 raft_consensus.cc:348] T 51bc1f2086b0425f9bc2369ed89cd6cd P a755e075e490411390dd20c2549e53e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } }
I20260809 19:10:01.046417 20474 raft_consensus.cc:374] T 51bc1f2086b0425f9bc2369ed89cd6cd P a755e075e490411390dd20c2549e53e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:10:01.046517 20474 raft_consensus.cc:729] T 51bc1f2086b0425f9bc2369ed89cd6cd P a755e075e490411390dd20c2549e53e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a755e075e490411390dd20c2549e53e3, State: Initialized, Role: FOLLOWER
I20260809 19:10:01.046801 20474 consensus_queue.cc:260] T 51bc1f2086b0425f9bc2369ed89cd6cd P a755e075e490411390dd20c2549e53e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } }
I20260809 19:10:01.047325 20474 ts_tablet_manager.cc:1428] T 51bc1f2086b0425f9bc2369ed89cd6cd P a755e075e490411390dd20c2549e53e3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 19:10:01.047890 20515 tablet_replica.cc:330] T c274fb8db24143e2ae085385cbf04a73 P b6f181c35b4f4302abb813ce7bf1907b: stopping tablet replica
I20260809 19:10:01.048285 20515 raft_consensus.cc:2229] T c274fb8db24143e2ae085385cbf04a73 P b6f181c35b4f4302abb813ce7bf1907b [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:10:01.048964 20515 raft_consensus.cc:2258] T c274fb8db24143e2ae085385cbf04a73 P b6f181c35b4f4302abb813ce7bf1907b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:10:01.049054 20513 ts_tablet_manager.cc:1918] T c274fb8db24143e2ae085385cbf04a73 P d11071d9f19b4dfa94163e5732641aaa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:10:01.049197 20513 log.cc:1196] T c274fb8db24143e2ae085385cbf04a73 P d11071d9f19b4dfa94163e5732641aaa: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-0/wal/wals/c274fb8db24143e2ae085385cbf04a73
I20260809 19:10:01.049949 20513 ts_tablet_manager.cc:1939] T c274fb8db24143e2ae085385cbf04a73 P d11071d9f19b4dfa94163e5732641aaa: Deleting consensus metadata
I20260809 19:10:01.050611 19655 catalog_manager.cc:4841] TS a755e075e490411390dd20c2549e53e3 (127.7.39.3:34615): tablet c274fb8db24143e2ae085385cbf04a73 (table test-table [id=4673c7e9fa3b48a68522ae178c8641c3]) successfully deleted
I20260809 19:10:01.051544 19658 catalog_manager.cc:4841] TS d11071d9f19b4dfa94163e5732641aaa (127.7.39.1:33051): tablet c274fb8db24143e2ae085385cbf04a73 (table test-table [id=4673c7e9fa3b48a68522ae178c8641c3]) successfully deleted
I20260809 19:10:01.053013 20515 ts_tablet_manager.cc:1905] T c274fb8db24143e2ae085385cbf04a73 P b6f181c35b4f4302abb813ce7bf1907b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:10:01.060590 20515 ts_tablet_manager.cc:1918] T c274fb8db24143e2ae085385cbf04a73 P b6f181c35b4f4302abb813ce7bf1907b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:10:01.060765 20515 log.cc:1196] T c274fb8db24143e2ae085385cbf04a73 P b6f181c35b4f4302abb813ce7bf1907b: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-1/wal/wals/c274fb8db24143e2ae085385cbf04a73
I20260809 19:10:01.061304 20515 ts_tablet_manager.cc:1939] T c274fb8db24143e2ae085385cbf04a73 P b6f181c35b4f4302abb813ce7bf1907b: Deleting consensus metadata
I20260809 19:10:01.062984 19660 catalog_manager.cc:4841] TS b6f181c35b4f4302abb813ce7bf1907b (127.7.39.2:35295): tablet c274fb8db24143e2ae085385cbf04a73 (table test-table [id=4673c7e9fa3b48a68522ae178c8641c3]) successfully deleted
I20260809 19:10:01.079991 20481 raft_consensus.cc:482] T 51bc1f2086b0425f9bc2369ed89cd6cd P d11071d9f19b4dfa94163e5732641aaa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:10:01.080184 20481 raft_consensus.cc:504] T 51bc1f2086b0425f9bc2369ed89cd6cd P d11071d9f19b4dfa94163e5732641aaa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } }
I20260809 19:10:01.081635 20481 leader_election.cc:288] T 51bc1f2086b0425f9bc2369ed89cd6cd P d11071d9f19b4dfa94163e5732641aaa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6f181c35b4f4302abb813ce7bf1907b (127.7.39.2:35295), a755e075e490411390dd20c2549e53e3 (127.7.39.3:34615)
I20260809 19:10:01.089598 20469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:01.082416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:48099 (local address 127.7.39.2:35295)
0809 19:10:01.082577 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:01.082582 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:01.083069 (+ 487us) server_negotiation.cc:407] Connection header received
0809 19:10:01.083174 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:01.083178 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:01.083243 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:01.083327 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:10:01.084328 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:01.085534 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:01.087777 (+ 2243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:01.088578 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:01.088706 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:01.088801 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:01.089150 (+ 349us) server_negotiation.cc:299] Negotiation successful
0809 19:10:01.089302 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 19:10:01.089641 20521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:01.081954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:35295 (local address 127.7.39.1:48099)
0809 19:10:01.082956 (+ 1002us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:01.082971 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:01.083071 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:01.083452 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:01.083457 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:01.083492 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:10:01.084148 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:01.084163 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:01.085684 (+ 1521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:01.085689 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:01.087638 (+ 1949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:01.087649 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:01.088790 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:01.088796 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:01.088976 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:01.089010 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 19:10:01.089107 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 19:10:01.089237 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":879,"mutex_wait_us":26,"thread_start_us":676,"threads_started":1}
I20260809 19:10:01.089679 20468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:01.081996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:56011 (local address 127.7.39.3:34615)
0809 19:10:01.082201 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:01.082208 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:01.082753 (+ 545us) server_negotiation.cc:407] Connection header received
0809 19:10:01.083044 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:01.083050 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:01.083142 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:01.083238 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:10:01.083896 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:01.084919 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:01.087437 (+ 2518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:01.088643 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:01.088767 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:01.088861 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:01.089315 (+ 454us) server_negotiation.cc:299] Negotiation successful
0809 19:10:01.089452 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 19:10:01.090348 20520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:01.081925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:34615 (local address 127.7.39.1:56011)
0809 19:10:01.082635 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:01.082656 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:01.082870 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:01.083260 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:01.083264 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:01.083289 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:10:01.083725 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:01.083737 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:01.085172 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:01.085194 (+ 22us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:01.087263 (+ 2069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:01.087279 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:01.088963 (+ 1684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:01.088969 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:01.089148 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:01.089178 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 19:10:01.089882 (+ 704us) client_negotiation.cc:240] Negotiation successful
0809 19:10:01.089994 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":581,"mutex_wait_us":2,"thread_start_us":427,"threads_started":1}
I20260809 19:10:01.090783 20144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51bc1f2086b0425f9bc2369ed89cd6cd" candidate_uuid: "d11071d9f19b4dfa94163e5732641aaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f181c35b4f4302abb813ce7bf1907b" is_pre_election: true
I20260809 19:10:01.091045 20355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51bc1f2086b0425f9bc2369ed89cd6cd" candidate_uuid: "d11071d9f19b4dfa94163e5732641aaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a755e075e490411390dd20c2549e53e3" is_pre_election: true
I20260809 19:10:01.091266 20355 raft_consensus.cc:2454] T 51bc1f2086b0425f9bc2369ed89cd6cd P a755e075e490411390dd20c2549e53e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d11071d9f19b4dfa94163e5732641aaa in term 0.
I20260809 19:10:01.091275 20144 raft_consensus.cc:2454] T 51bc1f2086b0425f9bc2369ed89cd6cd P b6f181c35b4f4302abb813ce7bf1907b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d11071d9f19b4dfa94163e5732641aaa in term 0.
I20260809 19:10:01.091758 19822 leader_election.cc:302] T 51bc1f2086b0425f9bc2369ed89cd6cd P d11071d9f19b4dfa94163e5732641aaa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a755e075e490411390dd20c2549e53e3, d11071d9f19b4dfa94163e5732641aaa; no voters:
I20260809 19:10:01.092128 20481 raft_consensus.cc:2781] T 51bc1f2086b0425f9bc2369ed89cd6cd P d11071d9f19b4dfa94163e5732641aaa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:10:01.092252 20481 raft_consensus.cc:482] T 51bc1f2086b0425f9bc2369ed89cd6cd P d11071d9f19b4dfa94163e5732641aaa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:10:01.092344 20481 raft_consensus.cc:3037] T 51bc1f2086b0425f9bc2369ed89cd6cd P d11071d9f19b4dfa94163e5732641aaa [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:10:01.094502 20481 raft_consensus.cc:504] T 51bc1f2086b0425f9bc2369ed89cd6cd P d11071d9f19b4dfa94163e5732641aaa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } }
I20260809 19:10:01.095075 20481 leader_election.cc:288] T 51bc1f2086b0425f9bc2369ed89cd6cd P d11071d9f19b4dfa94163e5732641aaa [CANDIDATE]: Term 1 election: Requested vote from peers b6f181c35b4f4302abb813ce7bf1907b (127.7.39.2:35295), a755e075e490411390dd20c2549e53e3 (127.7.39.3:34615)
I20260809 19:10:01.095526 20355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51bc1f2086b0425f9bc2369ed89cd6cd" candidate_uuid: "d11071d9f19b4dfa94163e5732641aaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a755e075e490411390dd20c2549e53e3"
I20260809 19:10:01.095527 20144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51bc1f2086b0425f9bc2369ed89cd6cd" candidate_uuid: "d11071d9f19b4dfa94163e5732641aaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f181c35b4f4302abb813ce7bf1907b"
I20260809 19:10:01.095723 20355 raft_consensus.cc:3037] T 51bc1f2086b0425f9bc2369ed89cd6cd P a755e075e490411390dd20c2549e53e3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:10:01.095731 20144 raft_consensus.cc:3037] T 51bc1f2086b0425f9bc2369ed89cd6cd P b6f181c35b4f4302abb813ce7bf1907b [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:10:01.098515 20355 raft_consensus.cc:2454] T 51bc1f2086b0425f9bc2369ed89cd6cd P a755e075e490411390dd20c2549e53e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d11071d9f19b4dfa94163e5732641aaa in term 1.
I20260809 19:10:01.098822 20144 raft_consensus.cc:2454] T 51bc1f2086b0425f9bc2369ed89cd6cd P b6f181c35b4f4302abb813ce7bf1907b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d11071d9f19b4dfa94163e5732641aaa in term 1.
I20260809 19:10:01.098933 19822 leader_election.cc:302] T 51bc1f2086b0425f9bc2369ed89cd6cd P d11071d9f19b4dfa94163e5732641aaa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a755e075e490411390dd20c2549e53e3, d11071d9f19b4dfa94163e5732641aaa; no voters:
I20260809 19:10:01.099233 20481 raft_consensus.cc:2781] T 51bc1f2086b0425f9bc2369ed89cd6cd P d11071d9f19b4dfa94163e5732641aaa [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:10:01.099689 20481 raft_consensus.cc:686] T 51bc1f2086b0425f9bc2369ed89cd6cd P d11071d9f19b4dfa94163e5732641aaa [term 1 LEADER]: Becoming Leader. State: Replica: d11071d9f19b4dfa94163e5732641aaa, State: Running, Role: LEADER
I20260809 19:10:01.100296 20481 consensus_queue.cc:237] T 51bc1f2086b0425f9bc2369ed89cd6cd P d11071d9f19b4dfa94163e5732641aaa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } }
I20260809 19:10:01.103760 19685 catalog_manager.cc:5495] T 51bc1f2086b0425f9bc2369ed89cd6cd P d11071d9f19b4dfa94163e5732641aaa reported cstate change: term changed from 0 to 1, leader changed from <none> to d11071d9f19b4dfa94163e5732641aaa (127.7.39.1). New cstate: current_term: 1 leader_uuid: "d11071d9f19b4dfa94163e5732641aaa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } health_report { overall_health: UNKNOWN } } }
Aug 09 19:10:01 dist-test-slave-4tdj krb5kdc[19607](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302598, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.62@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM
I20260809 19:10:01.155952 20530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:01.140506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:33279 (local address 127.0.0.1:52724)
0809 19:10:01.141376 (+ 870us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:01.141397 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:01.141545 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:01.141857 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:01.141862 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:01.142833 (+ 971us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:01.143209 (+ 376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:01.143222 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:01.144256 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:01.144262 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:01.145816 (+ 1554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:01.145832 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:01.146565 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:01.146572 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:01.146740 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:01.147436 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:01.147467 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:01.149981 (+ 2514us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:10:01.153649 (+ 3668us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:10:01.153660 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:10:01.153666 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:10:01.154068 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:10:01.154468 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:10:01.154472 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:10:01.154474 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:10:01.154607 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:10:01.155204 (+ 597us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:10:01.155210 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:10:01.155360 (+ 150us) client_negotiation.cc:769] Sending connection context
0809 19:10:01.155485 (+ 125us) client_negotiation.cc:240] Negotiation successful
0809 19:10:01.155670 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":728,"thread_start_us":567,"threads_started":1}
I20260809 19:10:01.156281 20529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:01.140503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52724 (local address 127.7.39.62:33279)
0809 19:10:01.141222 (+ 719us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:01.141231 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:01.141479 (+ 248us) server_negotiation.cc:407] Connection header received
0809 19:10:01.141645 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:01.141648 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:01.141715 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:01.141799 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:01.143358 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:01.144136 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:01.145943 (+ 1807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:01.146390 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:01.146480 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:01.150184 (+ 3704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:01.150191 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:01.150196 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:10:01.150233 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:01.153531 (+ 3298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:01.154175 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:01.154181 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:01.154185 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:01.154366 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:01.154706 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:01.154711 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:01.154715 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:01.155082 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:01.155219 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:01.155613 (+ 394us) server_negotiation.cc:299] Negotiation successful
0809 19:10:01.155831 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":285,"threads_started":1}
I20260809 19:10:01.161422 19685 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:52724:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 19:10:01.162470 19685 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:10:01.169517 20329 tablet_service.cc:1467] Processing CreateTablet for tablet 5e705a7f8e4f46f599d86b826349caa6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e95409b1ac314347906ec4823ef782ab]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 19:10:01.169466 19898 tablet_service.cc:1467] Processing CreateTablet for tablet 5e705a7f8e4f46f599d86b826349caa6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e95409b1ac314347906ec4823ef782ab]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 19:10:01.169513 20117 tablet_service.cc:1467] Processing CreateTablet for tablet 5e705a7f8e4f46f599d86b826349caa6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e95409b1ac314347906ec4823ef782ab]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 19:10:01.170028 20329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e705a7f8e4f46f599d86b826349caa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:10:01.170042 20117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e705a7f8e4f46f599d86b826349caa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:10:01.170054 19898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e705a7f8e4f46f599d86b826349caa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:10:01.177035 20471 tablet_bootstrap.cc:492] T 5e705a7f8e4f46f599d86b826349caa6 P b6f181c35b4f4302abb813ce7bf1907b: Bootstrap starting.
I20260809 19:10:01.177027 20474 tablet_bootstrap.cc:492] T 5e705a7f8e4f46f599d86b826349caa6 P a755e075e490411390dd20c2549e53e3: Bootstrap starting.
I20260809 19:10:01.178692 20474 tablet_bootstrap.cc:654] T 5e705a7f8e4f46f599d86b826349caa6 P a755e075e490411390dd20c2549e53e3: Neither blocks nor log segments found. Creating new log.
I20260809 19:10:01.178799 20471 tablet_bootstrap.cc:654] T 5e705a7f8e4f46f599d86b826349caa6 P b6f181c35b4f4302abb813ce7bf1907b: Neither blocks nor log segments found. Creating new log.
I20260809 19:10:01.178877 20475 tablet_bootstrap.cc:492] T 5e705a7f8e4f46f599d86b826349caa6 P d11071d9f19b4dfa94163e5732641aaa: Bootstrap starting.
I20260809 19:10:01.180564 20475 tablet_bootstrap.cc:654] T 5e705a7f8e4f46f599d86b826349caa6 P d11071d9f19b4dfa94163e5732641aaa: Neither blocks nor log segments found. Creating new log.
I20260809 19:10:01.189173 20471 tablet_bootstrap.cc:492] T 5e705a7f8e4f46f599d86b826349caa6 P b6f181c35b4f4302abb813ce7bf1907b: No bootstrap required, opened a new log
I20260809 19:10:01.189361 20471 ts_tablet_manager.cc:1397] T 5e705a7f8e4f46f599d86b826349caa6 P b6f181c35b4f4302abb813ce7bf1907b: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.004s
I20260809 19:10:01.190246 20471 raft_consensus.cc:348] T 5e705a7f8e4f46f599d86b826349caa6 P b6f181c35b4f4302abb813ce7bf1907b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } }
I20260809 19:10:01.190569 20471 raft_consensus.cc:374] T 5e705a7f8e4f46f599d86b826349caa6 P b6f181c35b4f4302abb813ce7bf1907b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:10:01.190650 20471 raft_consensus.cc:729] T 5e705a7f8e4f46f599d86b826349caa6 P b6f181c35b4f4302abb813ce7bf1907b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f181c35b4f4302abb813ce7bf1907b, State: Initialized, Role: FOLLOWER
I20260809 19:10:01.190923 20471 consensus_queue.cc:260] T 5e705a7f8e4f46f599d86b826349caa6 P b6f181c35b4f4302abb813ce7bf1907b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } }
I20260809 19:10:01.191391 20480 tablet_replica.cc:439] T 5e705a7f8e4f46f599d86b826349caa6 P b6f181c35b4f4302abb813ce7bf1907b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } }
I20260809 19:10:01.191684 20480 tablet_replica.cc:442] T 5e705a7f8e4f46f599d86b826349caa6 P b6f181c35b4f4302abb813ce7bf1907b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 19:10:01.192860 20471 ts_tablet_manager.cc:1428] T 5e705a7f8e4f46f599d86b826349caa6 P b6f181c35b4f4302abb813ce7bf1907b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 19:10:01.193925 20475 tablet_bootstrap.cc:492] T 5e705a7f8e4f46f599d86b826349caa6 P d11071d9f19b4dfa94163e5732641aaa: No bootstrap required, opened a new log
I20260809 19:10:01.194114 20475 ts_tablet_manager.cc:1397] T 5e705a7f8e4f46f599d86b826349caa6 P d11071d9f19b4dfa94163e5732641aaa: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.005s
I20260809 19:10:01.194881 20474 tablet_bootstrap.cc:492] T 5e705a7f8e4f46f599d86b826349caa6 P a755e075e490411390dd20c2549e53e3: No bootstrap required, opened a new log
I20260809 19:10:01.194880 20475 raft_consensus.cc:348] T 5e705a7f8e4f46f599d86b826349caa6 P d11071d9f19b4dfa94163e5732641aaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } }
I20260809 19:10:01.195065 20474 ts_tablet_manager.cc:1397] T 5e705a7f8e4f46f599d86b826349caa6 P a755e075e490411390dd20c2549e53e3: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.013s
I20260809 19:10:01.195128 20475 raft_consensus.cc:374] T 5e705a7f8e4f46f599d86b826349caa6 P d11071d9f19b4dfa94163e5732641aaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:10:01.195222 20475 raft_consensus.cc:729] T 5e705a7f8e4f46f599d86b826349caa6 P d11071d9f19b4dfa94163e5732641aaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d11071d9f19b4dfa94163e5732641aaa, State: Initialized, Role: FOLLOWER
I20260809 19:10:01.195499 20475 consensus_queue.cc:260] T 5e705a7f8e4f46f599d86b826349caa6 P d11071d9f19b4dfa94163e5732641aaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } }
I20260809 19:10:01.195794 20474 raft_consensus.cc:348] T 5e705a7f8e4f46f599d86b826349caa6 P a755e075e490411390dd20c2549e53e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } }
I20260809 19:10:01.196034 20474 raft_consensus.cc:374] T 5e705a7f8e4f46f599d86b826349caa6 P a755e075e490411390dd20c2549e53e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:10:01.195946 20481 tablet_replica.cc:439] T 5e705a7f8e4f46f599d86b826349caa6 P d11071d9f19b4dfa94163e5732641aaa: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } }
I20260809 19:10:01.196130 20474 raft_consensus.cc:729] T 5e705a7f8e4f46f599d86b826349caa6 P a755e075e490411390dd20c2549e53e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a755e075e490411390dd20c2549e53e3, State: Initialized, Role: FOLLOWER
I20260809 19:10:01.196238 20481 tablet_replica.cc:442] T 5e705a7f8e4f46f599d86b826349caa6 P d11071d9f19b4dfa94163e5732641aaa: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 19:10:01.196388 20474 consensus_queue.cc:260] T 5e705a7f8e4f46f599d86b826349caa6 P a755e075e490411390dd20c2549e53e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } }
I20260809 19:10:01.196943 20474 ts_tablet_manager.cc:1428] T 5e705a7f8e4f46f599d86b826349caa6 P a755e075e490411390dd20c2549e53e3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260809 19:10:01.196861 20482 tablet_replica.cc:439] T 5e705a7f8e4f46f599d86b826349caa6 P a755e075e490411390dd20c2549e53e3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } }
I20260809 19:10:01.197263 20482 tablet_replica.cc:442] T 5e705a7f8e4f46f599d86b826349caa6 P a755e075e490411390dd20c2549e53e3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 19:10:01.197863 20475 ts_tablet_manager.cc:1428] T 5e705a7f8e4f46f599d86b826349caa6 P d11071d9f19b4dfa94163e5732641aaa: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260809 19:10:01.321619 20480 raft_consensus.cc:482] T 5e705a7f8e4f46f599d86b826349caa6 P b6f181c35b4f4302abb813ce7bf1907b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:10:01.321820 20480 raft_consensus.cc:504] T 5e705a7f8e4f46f599d86b826349caa6 P b6f181c35b4f4302abb813ce7bf1907b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } }
I20260809 19:10:01.322598 20480 leader_election.cc:288] T 5e705a7f8e4f46f599d86b826349caa6 P b6f181c35b4f4302abb813ce7bf1907b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d11071d9f19b4dfa94163e5732641aaa (127.7.39.1:33051), a755e075e490411390dd20c2549e53e3 (127.7.39.3:34615)
I20260809 19:10:01.323233 19931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e705a7f8e4f46f599d86b826349caa6" candidate_uuid: "b6f181c35b4f4302abb813ce7bf1907b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d11071d9f19b4dfa94163e5732641aaa" is_pre_election: true
I20260809 19:10:01.323254 20355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e705a7f8e4f46f599d86b826349caa6" candidate_uuid: "b6f181c35b4f4302abb813ce7bf1907b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a755e075e490411390dd20c2549e53e3" is_pre_election: true
I20260809 19:10:01.323480 19931 raft_consensus.cc:2454] T 5e705a7f8e4f46f599d86b826349caa6 P d11071d9f19b4dfa94163e5732641aaa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f181c35b4f4302abb813ce7bf1907b in term 0.
I20260809 19:10:01.323560 20355 raft_consensus.cc:2454] T 5e705a7f8e4f46f599d86b826349caa6 P a755e075e490411390dd20c2549e53e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f181c35b4f4302abb813ce7bf1907b in term 0.
I20260809 19:10:01.323962 20041 leader_election.cc:302] T 5e705a7f8e4f46f599d86b826349caa6 P b6f181c35b4f4302abb813ce7bf1907b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6f181c35b4f4302abb813ce7bf1907b, d11071d9f19b4dfa94163e5732641aaa; no voters:
I20260809 19:10:01.324313 20480 raft_consensus.cc:2781] T 5e705a7f8e4f46f599d86b826349caa6 P b6f181c35b4f4302abb813ce7bf1907b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:10:01.324476 20480 raft_consensus.cc:482] T 5e705a7f8e4f46f599d86b826349caa6 P b6f181c35b4f4302abb813ce7bf1907b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:10:01.324590 20480 raft_consensus.cc:3037] T 5e705a7f8e4f46f599d86b826349caa6 P b6f181c35b4f4302abb813ce7bf1907b [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:10:01.328047 20480 raft_consensus.cc:504] T 5e705a7f8e4f46f599d86b826349caa6 P b6f181c35b4f4302abb813ce7bf1907b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } }
I20260809 19:10:01.328800 20480 leader_election.cc:288] T 5e705a7f8e4f46f599d86b826349caa6 P b6f181c35b4f4302abb813ce7bf1907b [CANDIDATE]: Term 1 election: Requested vote from peers d11071d9f19b4dfa94163e5732641aaa (127.7.39.1:33051), a755e075e490411390dd20c2549e53e3 (127.7.39.3:34615)
I20260809 19:10:01.329321 20355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e705a7f8e4f46f599d86b826349caa6" candidate_uuid: "b6f181c35b4f4302abb813ce7bf1907b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a755e075e490411390dd20c2549e53e3"
I20260809 19:10:01.329322 19931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e705a7f8e4f46f599d86b826349caa6" candidate_uuid: "b6f181c35b4f4302abb813ce7bf1907b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d11071d9f19b4dfa94163e5732641aaa"
I20260809 19:10:01.329537 19931 raft_consensus.cc:3037] T 5e705a7f8e4f46f599d86b826349caa6 P d11071d9f19b4dfa94163e5732641aaa [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:10:01.329551 20355 raft_consensus.cc:3037] T 5e705a7f8e4f46f599d86b826349caa6 P a755e075e490411390dd20c2549e53e3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:10:01.332093 20355 raft_consensus.cc:2454] T 5e705a7f8e4f46f599d86b826349caa6 P a755e075e490411390dd20c2549e53e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f181c35b4f4302abb813ce7bf1907b in term 1.
I20260809 19:10:01.332631 20040 leader_election.cc:302] T 5e705a7f8e4f46f599d86b826349caa6 P b6f181c35b4f4302abb813ce7bf1907b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a755e075e490411390dd20c2549e53e3, b6f181c35b4f4302abb813ce7bf1907b; no voters:
I20260809 19:10:01.332726 19931 raft_consensus.cc:2454] T 5e705a7f8e4f46f599d86b826349caa6 P d11071d9f19b4dfa94163e5732641aaa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f181c35b4f4302abb813ce7bf1907b in term 1.
I20260809 19:10:01.332980 20480 raft_consensus.cc:2781] T 5e705a7f8e4f46f599d86b826349caa6 P b6f181c35b4f4302abb813ce7bf1907b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:10:01.333199 20480 raft_consensus.cc:686] T 5e705a7f8e4f46f599d86b826349caa6 P b6f181c35b4f4302abb813ce7bf1907b [term 1 LEADER]: Becoming Leader. State: Replica: b6f181c35b4f4302abb813ce7bf1907b, State: Running, Role: LEADER
I20260809 19:10:01.333532 20480 consensus_queue.cc:237] T 5e705a7f8e4f46f599d86b826349caa6 P b6f181c35b4f4302abb813ce7bf1907b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } }
I20260809 19:10:01.335237 20491 tablet_replica.cc:439] T 5e705a7f8e4f46f599d86b826349caa6 P b6f181c35b4f4302abb813ce7bf1907b: TxnStatusTablet state changed. Reason: New leader b6f181c35b4f4302abb813ce7bf1907b. Latest consensus state: current_term: 1 leader_uuid: "b6f181c35b4f4302abb813ce7bf1907b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } }
I20260809 19:10:01.335575 20491 tablet_replica.cc:442] T 5e705a7f8e4f46f599d86b826349caa6 P b6f181c35b4f4302abb813ce7bf1907b: This TxnStatusTablet replica's current role is: LEADER
I20260809 19:10:01.336264 20537 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 19:10:01.336462 20537 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 19:10:01.337725 19683 catalog_manager.cc:5495] T 5e705a7f8e4f46f599d86b826349caa6 P b6f181c35b4f4302abb813ce7bf1907b reported cstate change: term changed from 0 to 1, leader changed from <none> to b6f181c35b4f4302abb813ce7bf1907b (127.7.39.2). New cstate: current_term: 1 leader_uuid: "b6f181c35b4f4302abb813ce7bf1907b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } health_report { overall_health: HEALTHY } } }
I20260809 19:10:01.383198 20530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:01.377524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:35295 (local address 127.0.0.1:32800)
0809 19:10:01.377779 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:01.377800 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:01.377921 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:01.378436 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:01.378439 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:01.378449 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 19:10:01.378619 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:01.378627 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:01.380073 (+ 1446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:01.380077 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:01.381108 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:01.381119 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:01.382065 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:01.382069 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:01.382229 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:01.382317 (+ 88us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 19:10:01.382760 (+ 443us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 19:10:01.382771 (+ 11us) client_negotiation.cc:769] Sending connection context
0809 19:10:01.382824 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 19:10:01.382939 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260809 19:10:01.383235 20469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:01.377607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32800 (local address 127.7.39.2:35295)
0809 19:10:01.377808 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:01.377814 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:01.377838 (+ 24us) server_negotiation.cc:407] Connection header received
0809 19:10:01.378183 (+ 345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:01.378189 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:01.378282 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:01.378425 (+ 143us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:10:01.378758 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:01.379930 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:01.381263 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:01.381920 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:01.382064 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:01.382533 (+ 469us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:10:01.382665 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:10:01.382768 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:01.382856 (+ 88us) server_negotiation.cc:299] Negotiation successful
0809 19:10:01.382940 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260809 19:10:01.387244 19931 raft_consensus.cc:1261] T 5e705a7f8e4f46f599d86b826349caa6 P d11071d9f19b4dfa94163e5732641aaa [term 1 FOLLOWER]: Refusing update from remote peer b6f181c35b4f4302abb813ce7bf1907b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:10:01.387367 20355 raft_consensus.cc:1261] T 5e705a7f8e4f46f599d86b826349caa6 P a755e075e490411390dd20c2549e53e3 [term 1 FOLLOWER]: Refusing update from remote peer b6f181c35b4f4302abb813ce7bf1907b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:10:01.387917 20491 consensus_queue.cc:1035] T 5e705a7f8e4f46f599d86b826349caa6 P b6f181c35b4f4302abb813ce7bf1907b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:10:01.388278 20480 consensus_queue.cc:1035] T 5e705a7f8e4f46f599d86b826349caa6 P b6f181c35b4f4302abb813ce7bf1907b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:10:01.390669 20481 tablet_replica.cc:439] T 5e705a7f8e4f46f599d86b826349caa6 P d11071d9f19b4dfa94163e5732641aaa: TxnStatusTablet state changed. Reason: New leader b6f181c35b4f4302abb813ce7bf1907b. Latest consensus state: current_term: 1 leader_uuid: "b6f181c35b4f4302abb813ce7bf1907b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } }
I20260809 19:10:01.390978 20481 tablet_replica.cc:442] T 5e705a7f8e4f46f599d86b826349caa6 P d11071d9f19b4dfa94163e5732641aaa: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 19:10:01.392771 20480 tablet_replica.cc:439] T 5e705a7f8e4f46f599d86b826349caa6 P b6f181c35b4f4302abb813ce7bf1907b: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b6f181c35b4f4302abb813ce7bf1907b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } }
I20260809 19:10:01.393092 20480 tablet_replica.cc:442] T 5e705a7f8e4f46f599d86b826349caa6 P b6f181c35b4f4302abb813ce7bf1907b: This TxnStatusTablet replica's current role is: LEADER
I20260809 19:10:01.394824 20495 mvcc.cc:205] Tried to move back new op lower bound from 7316695455275806720 to 7316695455064567808. Current Snapshot: MvccSnapshot[applied={T|T < 7316695455275806720 or (T in {7316695455275806720})}]
I20260809 19:10:01.394873 20481 tablet_replica.cc:439] T 5e705a7f8e4f46f599d86b826349caa6 P d11071d9f19b4dfa94163e5732641aaa: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b6f181c35b4f4302abb813ce7bf1907b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } }
I20260809 19:10:01.395139 20481 tablet_replica.cc:442] T 5e705a7f8e4f46f599d86b826349caa6 P d11071d9f19b4dfa94163e5732641aaa: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 19:10:01.404428 20491 tablet_replica.cc:439] T 5e705a7f8e4f46f599d86b826349caa6 P b6f181c35b4f4302abb813ce7bf1907b: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b6f181c35b4f4302abb813ce7bf1907b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } }
I20260809 19:10:01.404690 20491 tablet_replica.cc:442] T 5e705a7f8e4f46f599d86b826349caa6 P b6f181c35b4f4302abb813ce7bf1907b: This TxnStatusTablet replica's current role is: LEADER
I20260809 19:10:01.404523 20482 tablet_replica.cc:439] T 5e705a7f8e4f46f599d86b826349caa6 P a755e075e490411390dd20c2549e53e3: TxnStatusTablet state changed. Reason: New leader b6f181c35b4f4302abb813ce7bf1907b. Latest consensus state: current_term: 1 leader_uuid: "b6f181c35b4f4302abb813ce7bf1907b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } }
I20260809 19:10:01.404771 20482 tablet_replica.cc:442] T 5e705a7f8e4f46f599d86b826349caa6 P a755e075e490411390dd20c2549e53e3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 19:10:01.406005 20464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:01.399884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60918 (local address 127.7.39.1:33051)
0809 19:10:01.400058 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:01.400064 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:01.400289 (+ 225us) server_negotiation.cc:407] Connection header received
0809 19:10:01.400507 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:01.400511 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:01.400605 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:01.400730 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:10:01.401108 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:01.401833 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:01.403179 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:01.403611 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:01.403728 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:01.404370 (+ 642us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:10:01.405098 (+ 728us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:10:01.405244 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:01.405615 (+ 371us) server_negotiation.cc:299] Negotiation successful
0809 19:10:01.405700 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 19:10:01.407764 20499 mvcc.cc:205] Tried to move back new op lower bound from 7316695455275806720 to 7316695455064567808. Current Snapshot: MvccSnapshot[applied={T|T < 7316695455275806720}]
I20260809 19:10:01.408229 20482 tablet_replica.cc:439] T 5e705a7f8e4f46f599d86b826349caa6 P a755e075e490411390dd20c2549e53e3: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b6f181c35b4f4302abb813ce7bf1907b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } }
I20260809 19:10:01.408408 20482 tablet_replica.cc:442] T 5e705a7f8e4f46f599d86b826349caa6 P a755e075e490411390dd20c2549e53e3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 19:10:01.424062 20469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:01.416907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:60141 (local address 127.7.39.2:35295)
0809 19:10:01.417096 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:01.417103 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:01.418936 (+ 1833us) server_negotiation.cc:407] Connection header received
0809 19:10:01.419096 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:01.419108 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:01.419209 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:01.419300 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:10:01.419715 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:01.420769 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:01.422170 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:01.422832 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:01.422953 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:01.423402 (+ 449us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:10:01.423524 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:10:01.423602 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:01.423698 (+ 96us) server_negotiation.cc:299] Negotiation successful
0809 19:10:01.423776 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 19:10:01.424144 20544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:01.416881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:35295 (local address 127.7.39.1:60141)
0809 19:10:01.418816 (+ 1935us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:01.418837 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:01.418978 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:01.419305 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:01.419308 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:01.419317 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 19:10:01.419578 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:01.419587 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:01.420907 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:01.420912 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:01.422005 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:01.422017 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:01.423038 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:01.423043 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:01.423175 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:01.423231 (+ 56us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 19:10:01.423609 (+ 378us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 19:10:01.423617 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 19:10:01.423666 (+ 49us) client_negotiation.cc:240] Negotiation successful
0809 19:10:01.423773 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1753,"thread_start_us":1598,"threads_started":1}
I20260809 19:10:01.434470 20354 raft_consensus.cc:1261] T 51bc1f2086b0425f9bc2369ed89cd6cd P a755e075e490411390dd20c2549e53e3 [term 1 FOLLOWER]: Refusing update from remote peer d11071d9f19b4dfa94163e5732641aaa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:10:01.434886 20144 raft_consensus.cc:1261] T 51bc1f2086b0425f9bc2369ed89cd6cd P b6f181c35b4f4302abb813ce7bf1907b [term 1 FOLLOWER]: Refusing update from remote peer d11071d9f19b4dfa94163e5732641aaa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:10:01.435143 20481 consensus_queue.cc:1035] T 51bc1f2086b0425f9bc2369ed89cd6cd P d11071d9f19b4dfa94163e5732641aaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:10:01.435642 20522 consensus_queue.cc:1035] T 51bc1f2086b0425f9bc2369ed89cd6cd P d11071d9f19b4dfa94163e5732641aaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:10:01.479044 20464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:01.472552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:46323 (local address 127.7.39.1:33051)
0809 19:10:01.472700 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:01.472704 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:01.473351 (+ 647us) server_negotiation.cc:407] Connection header received
0809 19:10:01.473553 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:01.473578 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:01.473664 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:01.473748 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:10:01.474624 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:01.475611 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:01.477201 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:01.477613 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:01.477718 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:01.478235 (+ 517us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:10:01.478386 (+ 151us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:10:01.478467 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:01.478694 (+ 227us) server_negotiation.cc:299] Negotiation successful
0809 19:10:01.478779 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 19:10:01.479805 20552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:01.472581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:33051 (local address 127.7.39.2:46323)
0809 19:10:01.473249 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:01.473269 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:01.473414 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:01.474069 (+ 655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:01.474073 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:01.474083 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 19:10:01.474411 (+ 328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:01.474426 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:01.475769 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:01.475773 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:01.477069 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:01.477083 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:01.477766 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:01.477773 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:01.477946 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:01.478022 (+ 76us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 19:10:01.478524 (+ 502us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 19:10:01.478547 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 19:10:01.479288 (+ 741us) client_negotiation.cc:240] Negotiation successful
0809 19:10:01.479419 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":310,"threads_started":1}
I20260809 19:10:01.517196 19685 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52716:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:10:01.517441 19685 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52716:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:10:01.520494 19685 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7d4db9fc530c4e6fb2db0907fabb09d1: Sending DeleteTablet for 3 replicas of tablet 51bc1f2086b0425f9bc2369ed89cd6cd
I20260809 19:10:01.521350 19898 tablet_service.cc:1514] Processing DeleteTablet for tablet 51bc1f2086b0425f9bc2369ed89cd6cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:10:01 UTC) from {username='oryx', principal='oryx/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:60908
I20260809 19:10:01.521553 20329 tablet_service.cc:1514] Processing DeleteTablet for tablet 51bc1f2086b0425f9bc2369ed89cd6cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:10:01 UTC) from {username='oryx', principal='oryx/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:55506
I20260809 19:10:01.521865 20513 tablet_replica.cc:330] T 51bc1f2086b0425f9bc2369ed89cd6cd P d11071d9f19b4dfa94163e5732641aaa: stopping tablet replica
I20260809 19:10:01.521831 20117 tablet_service.cc:1514] Processing DeleteTablet for tablet 51bc1f2086b0425f9bc2369ed89cd6cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:10:01 UTC) from {username='oryx', principal='oryx/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:32786
I20260809 19:10:01.522075 20513 raft_consensus.cc:2229] T 51bc1f2086b0425f9bc2369ed89cd6cd P d11071d9f19b4dfa94163e5732641aaa [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:10:01.522156 20511 tablet_replica.cc:330] T 51bc1f2086b0425f9bc2369ed89cd6cd P a755e075e490411390dd20c2549e53e3: stopping tablet replica
I20260809 19:10:01.522390 20511 raft_consensus.cc:2229] T 51bc1f2086b0425f9bc2369ed89cd6cd P a755e075e490411390dd20c2549e53e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:10:01.522584 20511 raft_consensus.cc:2258] T 51bc1f2086b0425f9bc2369ed89cd6cd P a755e075e490411390dd20c2549e53e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:10:01.522624 20513 raft_consensus.cc:2258] T 51bc1f2086b0425f9bc2369ed89cd6cd P d11071d9f19b4dfa94163e5732641aaa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:10:01.522931 20515 tablet_replica.cc:330] T 51bc1f2086b0425f9bc2369ed89cd6cd P b6f181c35b4f4302abb813ce7bf1907b: stopping tablet replica
I20260809 19:10:01.523155 20515 raft_consensus.cc:2229] T 51bc1f2086b0425f9bc2369ed89cd6cd P b6f181c35b4f4302abb813ce7bf1907b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:10:01.523356 20515 raft_consensus.cc:2258] T 51bc1f2086b0425f9bc2369ed89cd6cd P b6f181c35b4f4302abb813ce7bf1907b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:10:01.523907 20511 ts_tablet_manager.cc:1905] T 51bc1f2086b0425f9bc2369ed89cd6cd P a755e075e490411390dd20c2549e53e3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:10:01.523914 20513 ts_tablet_manager.cc:1905] T 51bc1f2086b0425f9bc2369ed89cd6cd P d11071d9f19b4dfa94163e5732641aaa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:10:01.530606 20515 ts_tablet_manager.cc:1905] T 51bc1f2086b0425f9bc2369ed89cd6cd P b6f181c35b4f4302abb813ce7bf1907b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:10:01.545786 20511 ts_tablet_manager.cc:1918] T 51bc1f2086b0425f9bc2369ed89cd6cd P a755e075e490411390dd20c2549e53e3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 19:10:01.546049 20511 log.cc:1196] T 51bc1f2086b0425f9bc2369ed89cd6cd P a755e075e490411390dd20c2549e53e3: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-2/wal/wals/51bc1f2086b0425f9bc2369ed89cd6cd
I20260809 19:10:01.546609 20511 ts_tablet_manager.cc:1939] T 51bc1f2086b0425f9bc2369ed89cd6cd P a755e075e490411390dd20c2549e53e3: Deleting consensus metadata
I20260809 19:10:01.547847 19655 catalog_manager.cc:4841] TS a755e075e490411390dd20c2549e53e3 (127.7.39.3:34615): tablet 51bc1f2086b0425f9bc2369ed89cd6cd (table test-table [id=dbd3ff4c2cb54bf0ac7f5a7c70c6323a]) successfully deleted
I20260809 19:10:01.549373 20515 ts_tablet_manager.cc:1918] T 51bc1f2086b0425f9bc2369ed89cd6cd P b6f181c35b4f4302abb813ce7bf1907b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 19:10:01.549525 20515 log.cc:1196] T 51bc1f2086b0425f9bc2369ed89cd6cd P b6f181c35b4f4302abb813ce7bf1907b: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-1/wal/wals/51bc1f2086b0425f9bc2369ed89cd6cd
I20260809 19:10:01.549849 20515 ts_tablet_manager.cc:1939] T 51bc1f2086b0425f9bc2369ed89cd6cd P b6f181c35b4f4302abb813ce7bf1907b: Deleting consensus metadata
I20260809 19:10:01.550890 19660 catalog_manager.cc:4841] TS b6f181c35b4f4302abb813ce7bf1907b (127.7.39.2:35295): tablet 51bc1f2086b0425f9bc2369ed89cd6cd (table test-table [id=dbd3ff4c2cb54bf0ac7f5a7c70c6323a]) successfully deleted
I20260809 19:10:01.552906 20513 ts_tablet_manager.cc:1918] T 51bc1f2086b0425f9bc2369ed89cd6cd P d11071d9f19b4dfa94163e5732641aaa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 19:10:01.553062 20513 log.cc:1196] T 51bc1f2086b0425f9bc2369ed89cd6cd P d11071d9f19b4dfa94163e5732641aaa: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-0/wal/wals/51bc1f2086b0425f9bc2369ed89cd6cd
I20260809 19:10:01.553417 20513 ts_tablet_manager.cc:1939] T 51bc1f2086b0425f9bc2369ed89cd6cd P d11071d9f19b4dfa94163e5732641aaa: Deleting consensus metadata
I20260809 19:10:01.554414 19658 catalog_manager.cc:4841] TS d11071d9f19b4dfa94163e5732641aaa (127.7.39.1:33051): tablet 51bc1f2086b0425f9bc2369ed89cd6cd (table test-table [id=dbd3ff4c2cb54bf0ac7f5a7c70c6323a]) successfully deleted
Aug 09 19:10:01 dist-test-slave-4tdj krb5kdc[19607](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302601, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 19:10:01 dist-test-slave-4tdj krb5kdc[19607](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:01 dist-test-slave-4tdj krb5kdc[19607](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
W20260809 19:10:01.616544 20529 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:01.603379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52734 (local address 127.7.39.62:33279)
0809 19:10:01.603594 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:01.603602 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:01.604090 (+ 488us) server_negotiation.cc:407] Connection header received
0809 19:10:01.604266 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:01.604270 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:01.604353 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:01.604440 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:01.605705 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:01.606497 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:01.607767 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:01.608266 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:01.608400 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:01.616244 (+ 7844us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52734: BlockingRecv error: recv got EOF from 127.0.0.1:52734 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 09 19:10:01 dist-test-slave-4tdj krb5kdc[19607](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302601, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM
I20260809 19:10:01.633863 20529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:01.620280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52736 (local address 127.7.39.62:33279)
0809 19:10:01.620464 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:01.620470 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:01.620626 (+ 156us) server_negotiation.cc:407] Connection header received
0809 19:10:01.620786 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:01.620791 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:01.620861 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:01.620943 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:01.622131 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:01.622905 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:01.624176 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:01.624675 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:01.624786 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:01.628515 (+ 3729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:01.628521 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:01.628526 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:10:01.628568 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:01.631151 (+ 2583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:01.631818 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:01.631824 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:01.631828 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:01.631952 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:01.632328 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:01.632334 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:01.632337 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:01.632664 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:01.632920 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:01.633290 (+ 370us) server_negotiation.cc:299] Negotiation successful
0809 19:10:01.633518 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 19:10:01.637209 19685 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52736:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:10:01.637809 19685 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:10:01.644507 19898 tablet_service.cc:1467] Processing CreateTablet for tablet f3583babbada407bad3ed9ee5a442eea (DEFAULT_TABLE table=test-table [id=b49872766b044fcfae98135124ad7478]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:10:01.644719 20117 tablet_service.cc:1467] Processing CreateTablet for tablet f3583babbada407bad3ed9ee5a442eea (DEFAULT_TABLE table=test-table [id=b49872766b044fcfae98135124ad7478]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:10:01.645006 19898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3583babbada407bad3ed9ee5a442eea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:10:01.645293 20117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3583babbada407bad3ed9ee5a442eea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:10:01.651119 20329 tablet_service.cc:1467] Processing CreateTablet for tablet f3583babbada407bad3ed9ee5a442eea (DEFAULT_TABLE table=test-table [id=b49872766b044fcfae98135124ad7478]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:10:01.651582 20329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3583babbada407bad3ed9ee5a442eea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:10:01.654536 20471 tablet_bootstrap.cc:492] T f3583babbada407bad3ed9ee5a442eea P b6f181c35b4f4302abb813ce7bf1907b: Bootstrap starting.
I20260809 19:10:01.655774 20471 tablet_bootstrap.cc:654] T f3583babbada407bad3ed9ee5a442eea P b6f181c35b4f4302abb813ce7bf1907b: Neither blocks nor log segments found. Creating new log.
I20260809 19:10:01.659955 20474 tablet_bootstrap.cc:492] T f3583babbada407bad3ed9ee5a442eea P a755e075e490411390dd20c2549e53e3: Bootstrap starting.
I20260809 19:10:01.661576 20474 tablet_bootstrap.cc:654] T f3583babbada407bad3ed9ee5a442eea P a755e075e490411390dd20c2549e53e3: Neither blocks nor log segments found. Creating new log.
I20260809 19:10:01.661751 20475 tablet_bootstrap.cc:492] T f3583babbada407bad3ed9ee5a442eea P d11071d9f19b4dfa94163e5732641aaa: Bootstrap starting.
I20260809 19:10:01.663301 20475 tablet_bootstrap.cc:654] T f3583babbada407bad3ed9ee5a442eea P d11071d9f19b4dfa94163e5732641aaa: Neither blocks nor log segments found. Creating new log.
I20260809 19:10:01.663741 20471 tablet_bootstrap.cc:492] T f3583babbada407bad3ed9ee5a442eea P b6f181c35b4f4302abb813ce7bf1907b: No bootstrap required, opened a new log
I20260809 19:10:01.663955 20471 ts_tablet_manager.cc:1397] T f3583babbada407bad3ed9ee5a442eea P b6f181c35b4f4302abb813ce7bf1907b: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.004s
I20260809 19:10:01.664837 20471 raft_consensus.cc:348] T f3583babbada407bad3ed9ee5a442eea P b6f181c35b4f4302abb813ce7bf1907b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } }
I20260809 19:10:01.665292 20471 raft_consensus.cc:374] T f3583babbada407bad3ed9ee5a442eea P b6f181c35b4f4302abb813ce7bf1907b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:10:01.665457 20471 raft_consensus.cc:729] T f3583babbada407bad3ed9ee5a442eea P b6f181c35b4f4302abb813ce7bf1907b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f181c35b4f4302abb813ce7bf1907b, State: Initialized, Role: FOLLOWER
I20260809 19:10:01.665822 20471 consensus_queue.cc:260] T f3583babbada407bad3ed9ee5a442eea P b6f181c35b4f4302abb813ce7bf1907b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } }
I20260809 19:10:01.666553 20471 ts_tablet_manager.cc:1428] T f3583babbada407bad3ed9ee5a442eea P b6f181c35b4f4302abb813ce7bf1907b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260809 19:10:01.677924 20475 tablet_bootstrap.cc:492] T f3583babbada407bad3ed9ee5a442eea P d11071d9f19b4dfa94163e5732641aaa: No bootstrap required, opened a new log
I20260809 19:10:01.678110 20475 ts_tablet_manager.cc:1397] T f3583babbada407bad3ed9ee5a442eea P d11071d9f19b4dfa94163e5732641aaa: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.012s
I20260809 19:10:01.678989 20474 tablet_bootstrap.cc:492] T f3583babbada407bad3ed9ee5a442eea P a755e075e490411390dd20c2549e53e3: No bootstrap required, opened a new log
I20260809 19:10:01.678989 20475 raft_consensus.cc:348] T f3583babbada407bad3ed9ee5a442eea P d11071d9f19b4dfa94163e5732641aaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } }
I20260809 19:10:01.679271 20475 raft_consensus.cc:374] T f3583babbada407bad3ed9ee5a442eea P d11071d9f19b4dfa94163e5732641aaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:10:01.679288 20474 ts_tablet_manager.cc:1397] T f3583babbada407bad3ed9ee5a442eea P a755e075e490411390dd20c2549e53e3: Time spent bootstrapping tablet: real 0.019s user 0.007s sys 0.006s
I20260809 19:10:01.679386 20475 raft_consensus.cc:729] T f3583babbada407bad3ed9ee5a442eea P d11071d9f19b4dfa94163e5732641aaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d11071d9f19b4dfa94163e5732641aaa, State: Initialized, Role: FOLLOWER
I20260809 19:10:01.679683 20475 consensus_queue.cc:260] T f3583babbada407bad3ed9ee5a442eea P d11071d9f19b4dfa94163e5732641aaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } }
I20260809 19:10:01.680271 20475 ts_tablet_manager.cc:1428] T f3583babbada407bad3ed9ee5a442eea P d11071d9f19b4dfa94163e5732641aaa: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260809 19:10:01.680227 20474 raft_consensus.cc:348] T f3583babbada407bad3ed9ee5a442eea P a755e075e490411390dd20c2549e53e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } }
I20260809 19:10:01.680562 20474 raft_consensus.cc:374] T f3583babbada407bad3ed9ee5a442eea P a755e075e490411390dd20c2549e53e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:10:01.680707 20474 raft_consensus.cc:729] T f3583babbada407bad3ed9ee5a442eea P a755e075e490411390dd20c2549e53e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a755e075e490411390dd20c2549e53e3, State: Initialized, Role: FOLLOWER
I20260809 19:10:01.681013 20474 consensus_queue.cc:260] T f3583babbada407bad3ed9ee5a442eea P a755e075e490411390dd20c2549e53e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } }
I20260809 19:10:01.681638 20474 ts_tablet_manager.cc:1428] T f3583babbada407bad3ed9ee5a442eea P a755e075e490411390dd20c2549e53e3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260809 19:10:01.722322 20556 raft_consensus.cc:482] T f3583babbada407bad3ed9ee5a442eea P d11071d9f19b4dfa94163e5732641aaa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:10:01.722610 20556 raft_consensus.cc:504] T f3583babbada407bad3ed9ee5a442eea P d11071d9f19b4dfa94163e5732641aaa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } }
I20260809 19:10:01.723424 20556 leader_election.cc:288] T f3583babbada407bad3ed9ee5a442eea P d11071d9f19b4dfa94163e5732641aaa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6f181c35b4f4302abb813ce7bf1907b (127.7.39.2:35295), a755e075e490411390dd20c2549e53e3 (127.7.39.3:34615)
I20260809 19:10:01.724207 20354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3583babbada407bad3ed9ee5a442eea" candidate_uuid: "d11071d9f19b4dfa94163e5732641aaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a755e075e490411390dd20c2549e53e3" is_pre_election: true
I20260809 19:10:01.724236 20144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3583babbada407bad3ed9ee5a442eea" candidate_uuid: "d11071d9f19b4dfa94163e5732641aaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f181c35b4f4302abb813ce7bf1907b" is_pre_election: true
I20260809 19:10:01.724485 20144 raft_consensus.cc:2454] T f3583babbada407bad3ed9ee5a442eea P b6f181c35b4f4302abb813ce7bf1907b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d11071d9f19b4dfa94163e5732641aaa in term 0.
I20260809 19:10:01.724484 20354 raft_consensus.cc:2454] T f3583babbada407bad3ed9ee5a442eea P a755e075e490411390dd20c2549e53e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d11071d9f19b4dfa94163e5732641aaa in term 0.
I20260809 19:10:01.725106 19828 leader_election.cc:302] T f3583babbada407bad3ed9ee5a442eea P d11071d9f19b4dfa94163e5732641aaa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6f181c35b4f4302abb813ce7bf1907b, d11071d9f19b4dfa94163e5732641aaa; no voters:
I20260809 19:10:01.725595 20556 raft_consensus.cc:2781] T f3583babbada407bad3ed9ee5a442eea P d11071d9f19b4dfa94163e5732641aaa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:10:01.725732 20556 raft_consensus.cc:482] T f3583babbada407bad3ed9ee5a442eea P d11071d9f19b4dfa94163e5732641aaa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:10:01.725831 20556 raft_consensus.cc:3037] T f3583babbada407bad3ed9ee5a442eea P d11071d9f19b4dfa94163e5732641aaa [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:10:01.729041 20556 raft_consensus.cc:504] T f3583babbada407bad3ed9ee5a442eea P d11071d9f19b4dfa94163e5732641aaa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } }
I20260809 19:10:01.730221 20354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3583babbada407bad3ed9ee5a442eea" candidate_uuid: "d11071d9f19b4dfa94163e5732641aaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a755e075e490411390dd20c2549e53e3"
I20260809 19:10:01.730470 20354 raft_consensus.cc:3037] T f3583babbada407bad3ed9ee5a442eea P a755e075e490411390dd20c2549e53e3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:10:01.730567 20144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3583babbada407bad3ed9ee5a442eea" candidate_uuid: "d11071d9f19b4dfa94163e5732641aaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f181c35b4f4302abb813ce7bf1907b"
I20260809 19:10:01.730778 20144 raft_consensus.cc:3037] T f3583babbada407bad3ed9ee5a442eea P b6f181c35b4f4302abb813ce7bf1907b [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:10:01.733397 20354 raft_consensus.cc:2454] T f3583babbada407bad3ed9ee5a442eea P a755e075e490411390dd20c2549e53e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d11071d9f19b4dfa94163e5732641aaa in term 1.
I20260809 19:10:01.733953 19822 leader_election.cc:302] T f3583babbada407bad3ed9ee5a442eea P d11071d9f19b4dfa94163e5732641aaa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a755e075e490411390dd20c2549e53e3, d11071d9f19b4dfa94163e5732641aaa; no voters:
I20260809 19:10:01.734259 20549 raft_consensus.cc:2781] T f3583babbada407bad3ed9ee5a442eea P d11071d9f19b4dfa94163e5732641aaa [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:10:01.734462 20549 raft_consensus.cc:686] T f3583babbada407bad3ed9ee5a442eea P d11071d9f19b4dfa94163e5732641aaa [term 1 LEADER]: Becoming Leader. State: Replica: d11071d9f19b4dfa94163e5732641aaa, State: Running, Role: LEADER
I20260809 19:10:01.734786 20549 consensus_queue.cc:237] T f3583babbada407bad3ed9ee5a442eea P d11071d9f19b4dfa94163e5732641aaa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } }
I20260809 19:10:01.736300 20144 raft_consensus.cc:2454] T f3583babbada407bad3ed9ee5a442eea P b6f181c35b4f4302abb813ce7bf1907b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d11071d9f19b4dfa94163e5732641aaa in term 1.
I20260809 19:10:01.737664 20556 leader_election.cc:288] T f3583babbada407bad3ed9ee5a442eea P d11071d9f19b4dfa94163e5732641aaa [CANDIDATE]: Term 1 election: Requested vote from peers b6f181c35b4f4302abb813ce7bf1907b (127.7.39.2:35295), a755e075e490411390dd20c2549e53e3 (127.7.39.3:34615)
I20260809 19:10:01.743417 19683 catalog_manager.cc:5495] T f3583babbada407bad3ed9ee5a442eea P d11071d9f19b4dfa94163e5732641aaa reported cstate change: term changed from 0 to 1, leader changed from <none> to d11071d9f19b4dfa94163e5732641aaa (127.7.39.1). New cstate: current_term: 1 leader_uuid: "d11071d9f19b4dfa94163e5732641aaa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } health_report { overall_health: UNKNOWN } } }
I20260809 19:10:01.765794 20464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:01.759451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60928 (local address 127.7.39.1:33051)
0809 19:10:01.759658 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:01.759665 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:01.759833 (+ 168us) server_negotiation.cc:407] Connection header received
0809 19:10:01.760006 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:01.760011 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:01.760103 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:01.760195 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:10:01.760602 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:01.761758 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:01.763696 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:01.764417 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:01.764548 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:01.765002 (+ 454us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:10:01.765147 (+ 145us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:10:01.765254 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:01.765396 (+ 142us) server_negotiation.cc:299] Negotiation successful
0809 19:10:01.765479 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 19:10:01.768756 20354 raft_consensus.cc:1261] T f3583babbada407bad3ed9ee5a442eea P a755e075e490411390dd20c2549e53e3 [term 1 FOLLOWER]: Refusing update from remote peer d11071d9f19b4dfa94163e5732641aaa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:10:01.769371 20549 consensus_queue.cc:1035] T f3583babbada407bad3ed9ee5a442eea P d11071d9f19b4dfa94163e5732641aaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:10:01.770704 20144 raft_consensus.cc:1261] T f3583babbada407bad3ed9ee5a442eea P b6f181c35b4f4302abb813ce7bf1907b [term 1 FOLLOWER]: Refusing update from remote peer d11071d9f19b4dfa94163e5732641aaa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:10:01.772260 20549 consensus_queue.cc:1035] T f3583babbada407bad3ed9ee5a442eea P d11071d9f19b4dfa94163e5732641aaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:10:01.780546 19685 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52736:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:10:01.780764 19685 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52736:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:10:01.784665 19685 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7d4db9fc530c4e6fb2db0907fabb09d1: Sending DeleteTablet for 3 replicas of tablet f3583babbada407bad3ed9ee5a442eea
I20260809 19:10:01.785768 19898 tablet_service.cc:1514] Processing DeleteTablet for tablet f3583babbada407bad3ed9ee5a442eea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:10:01 UTC) from {username='oryx', principal='oryx/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:60908
I20260809 19:10:01.786082 20513 tablet_replica.cc:330] T f3583babbada407bad3ed9ee5a442eea P d11071d9f19b4dfa94163e5732641aaa: stopping tablet replica
I20260809 19:10:01.786263 20513 raft_consensus.cc:2229] T f3583babbada407bad3ed9ee5a442eea P d11071d9f19b4dfa94163e5732641aaa [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:10:01.786427 20117 tablet_service.cc:1514] Processing DeleteTablet for tablet f3583babbada407bad3ed9ee5a442eea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:10:01 UTC) from {username='oryx', principal='oryx/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:32786
I20260809 19:10:01.786615 20513 raft_consensus.cc:2258] T f3583babbada407bad3ed9ee5a442eea P d11071d9f19b4dfa94163e5732641aaa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:10:01.786743 20515 tablet_replica.cc:330] T f3583babbada407bad3ed9ee5a442eea P b6f181c35b4f4302abb813ce7bf1907b: stopping tablet replica
I20260809 19:10:01.786929 20515 raft_consensus.cc:2229] T f3583babbada407bad3ed9ee5a442eea P b6f181c35b4f4302abb813ce7bf1907b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:10:01.787117 20515 pending_rounds.cc:62] T f3583babbada407bad3ed9ee5a442eea P b6f181c35b4f4302abb813ce7bf1907b: Trying to abort 2 pending ops.
I20260809 19:10:01.787320 20515 pending_rounds.cc:68] T f3583babbada407bad3ed9ee5a442eea P b6f181c35b4f4302abb813ce7bf1907b: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7316695456838131712 op_type: WRITE_OP write_request { tablet_id: "f3583babbada407bad3ed9ee5a442eea" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "val" type: INT32 is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\003\00090\000\0001\324\000\000" indirect_data: "<redacted>""" } external_consistency_mode: CLIENT_PROPAGATED authz_token { token_data: "\010\265\243\343\323\006\"8\n\ntest-admin\022*\n b49872766b044fcfae98135124ad7478\020\001\030\001 \001(\001" signature: "<redacted>""\237O\373\232\t\214\372l\357\353?\360\217\212\243&SaEQ\3139\226qW\013p\017\3729\312\253-N\334`0ED\264\246\027\272\257 1\003q\211W\220\227\277\212F\227\341\257\333\367\316\207Q\336" signing_key_seq_num: 0 } } request_id { client_id: "1370397a14d34e879f932febb067a837" seq_no: 0 first_incomplete_seq_no: 0 attempt_no: 0 }
I20260809 19:10:01.787730 20513 ts_tablet_manager.cc:1905] T f3583babbada407bad3ed9ee5a442eea P d11071d9f19b4dfa94163e5732641aaa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:10:01.787817 20329 tablet_service.cc:1514] Processing DeleteTablet for tablet f3583babbada407bad3ed9ee5a442eea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:10:01 UTC) from {username='oryx', principal='oryx/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:55506
I20260809 19:10:01.788224 20511 tablet_replica.cc:330] T f3583babbada407bad3ed9ee5a442eea P a755e075e490411390dd20c2549e53e3: stopping tablet replica
I20260809 19:10:01.788154 20515 pending_rounds.cc:68] T f3583babbada407bad3ed9ee5a442eea P b6f181c35b4f4302abb813ce7bf1907b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316695456708419584 op_type: NO_OP noop_request { }
I20260809 19:10:01.788311 20515 raft_consensus.cc:2866] T f3583babbada407bad3ed9ee5a442eea P b6f181c35b4f4302abb813ce7bf1907b [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260809 19:10:01.788383 20511 raft_consensus.cc:2229] T f3583babbada407bad3ed9ee5a442eea P a755e075e490411390dd20c2549e53e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:10:01.788465 20515 raft_consensus.cc:2258] T f3583babbada407bad3ed9ee5a442eea P b6f181c35b4f4302abb813ce7bf1907b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:10:01.788604 20511 raft_consensus.cc:2258] T f3583babbada407bad3ed9ee5a442eea P a755e075e490411390dd20c2549e53e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:10:01.789654 20329 tablet_service.cc:1514] Processing DeleteTablet for tablet f3583babbada407bad3ed9ee5a442eea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:10:01 UTC) from {username='oryx', principal='oryx/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:55506
I20260809 19:10:01.791378 19685 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52736:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 19:10:01.792547 20511 ts_tablet_manager.cc:1905] T f3583babbada407bad3ed9ee5a442eea P a755e075e490411390dd20c2549e53e3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:10:01.794139 20513 ts_tablet_manager.cc:1918] T f3583babbada407bad3ed9ee5a442eea P d11071d9f19b4dfa94163e5732641aaa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:10:01.794250 20513 log.cc:1196] T f3583babbada407bad3ed9ee5a442eea P d11071d9f19b4dfa94163e5732641aaa: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-0/wal/wals/f3583babbada407bad3ed9ee5a442eea
I20260809 19:10:01.794679 20513 ts_tablet_manager.cc:1939] T f3583babbada407bad3ed9ee5a442eea P d11071d9f19b4dfa94163e5732641aaa: Deleting consensus metadata
I20260809 19:10:01.795603 19658 catalog_manager.cc:4841] TS d11071d9f19b4dfa94163e5732641aaa (127.7.39.1:33051): tablet f3583babbada407bad3ed9ee5a442eea (table test-table [id=b49872766b044fcfae98135124ad7478]) successfully deleted
W20260809 19:10:01.798839 20594 consensus_queue.cc:1159] T f3583babbada407bad3ed9ee5a442eea P b6f181c35b4f4302abb813ce7bf1907b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b6f181c35b4f4302abb813ce7bf1907b" status { last_received { term: 1 index: 2 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 2 } }
I20260809 19:10:01.799929 20515 ts_tablet_manager.cc:1905] T f3583babbada407bad3ed9ee5a442eea P b6f181c35b4f4302abb813ce7bf1907b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260809 19:10:01.800097 19685 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:10:01.806723 20515 ts_tablet_manager.cc:1918] T f3583babbada407bad3ed9ee5a442eea P b6f181c35b4f4302abb813ce7bf1907b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:10:01.806864 20515 log.cc:1196] T f3583babbada407bad3ed9ee5a442eea P b6f181c35b4f4302abb813ce7bf1907b: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-1/wal/wals/f3583babbada407bad3ed9ee5a442eea
I20260809 19:10:01.807307 20515 ts_tablet_manager.cc:1939] T f3583babbada407bad3ed9ee5a442eea P b6f181c35b4f4302abb813ce7bf1907b: Deleting consensus metadata
I20260809 19:10:01.808193 20329 tablet_service.cc:1467] Processing CreateTablet for tablet 8bcd834513f74478a004528fd7ac06c5 (DEFAULT_TABLE table=test-table [id=294f0c293d1d4d049f611805fb5255d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:10:01.808688 20329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8bcd834513f74478a004528fd7ac06c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:10:01.811128 20511 ts_tablet_manager.cc:1918] T f3583babbada407bad3ed9ee5a442eea P a755e075e490411390dd20c2549e53e3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:10:01.811313 20511 log.cc:1196] T f3583babbada407bad3ed9ee5a442eea P a755e075e490411390dd20c2549e53e3: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-2/wal/wals/f3583babbada407bad3ed9ee5a442eea
I20260809 19:10:01.811781 20511 ts_tablet_manager.cc:1939] T f3583babbada407bad3ed9ee5a442eea P a755e075e490411390dd20c2549e53e3: Deleting consensus metadata
I20260809 19:10:01.812407 20117 tablet_service.cc:1467] Processing CreateTablet for tablet 8bcd834513f74478a004528fd7ac06c5 (DEFAULT_TABLE table=test-table [id=294f0c293d1d4d049f611805fb5255d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:10:01.812855 20117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8bcd834513f74478a004528fd7ac06c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:10:01.813758 19898 tablet_service.cc:1467] Processing CreateTablet for tablet 8bcd834513f74478a004528fd7ac06c5 (DEFAULT_TABLE table=test-table [id=294f0c293d1d4d049f611805fb5255d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:10:01.814203 19898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8bcd834513f74478a004528fd7ac06c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:10:01.814460 19655 catalog_manager.cc:4841] TS a755e075e490411390dd20c2549e53e3 (127.7.39.3:34615): tablet f3583babbada407bad3ed9ee5a442eea (table test-table [id=b49872766b044fcfae98135124ad7478]) successfully deleted
W20260809 19:10:01.814910 19655 catalog_manager.cc:4808] TS a755e075e490411390dd20c2549e53e3 (127.7.39.3:34615): delete failed for tablet f3583babbada407bad3ed9ee5a442eea because the tablet was not found. No further retry: Not found: Tablet not found: f3583babbada407bad3ed9ee5a442eea
I20260809 19:10:01.816712 19660 catalog_manager.cc:4841] TS b6f181c35b4f4302abb813ce7bf1907b (127.7.39.2:35295): tablet f3583babbada407bad3ed9ee5a442eea (table test-table [id=b49872766b044fcfae98135124ad7478]) successfully deleted
I20260809 19:10:01.823235 20471 tablet_bootstrap.cc:492] T 8bcd834513f74478a004528fd7ac06c5 P b6f181c35b4f4302abb813ce7bf1907b: Bootstrap starting.
I20260809 19:10:01.825066 20471 tablet_bootstrap.cc:654] T 8bcd834513f74478a004528fd7ac06c5 P b6f181c35b4f4302abb813ce7bf1907b: Neither blocks nor log segments found. Creating new log.
I20260809 19:10:01.827383 20471 tablet_bootstrap.cc:492] T 8bcd834513f74478a004528fd7ac06c5 P b6f181c35b4f4302abb813ce7bf1907b: No bootstrap required, opened a new log
I20260809 19:10:01.828121 20474 tablet_bootstrap.cc:492] T 8bcd834513f74478a004528fd7ac06c5 P a755e075e490411390dd20c2549e53e3: Bootstrap starting.
I20260809 19:10:01.827576 20471 ts_tablet_manager.cc:1397] T 8bcd834513f74478a004528fd7ac06c5 P b6f181c35b4f4302abb813ce7bf1907b: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260809 19:10:01.829437 20471 raft_consensus.cc:348] T 8bcd834513f74478a004528fd7ac06c5 P b6f181c35b4f4302abb813ce7bf1907b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } }
I20260809 19:10:01.829677 20474 tablet_bootstrap.cc:654] T 8bcd834513f74478a004528fd7ac06c5 P a755e075e490411390dd20c2549e53e3: Neither blocks nor log segments found. Creating new log.
I20260809 19:10:01.829723 20471 raft_consensus.cc:374] T 8bcd834513f74478a004528fd7ac06c5 P b6f181c35b4f4302abb813ce7bf1907b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:10:01.829807 20471 raft_consensus.cc:729] T 8bcd834513f74478a004528fd7ac06c5 P b6f181c35b4f4302abb813ce7bf1907b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f181c35b4f4302abb813ce7bf1907b, State: Initialized, Role: FOLLOWER
I20260809 19:10:01.830099 20471 consensus_queue.cc:260] T 8bcd834513f74478a004528fd7ac06c5 P b6f181c35b4f4302abb813ce7bf1907b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } }
I20260809 19:10:01.830662 20471 ts_tablet_manager.cc:1428] T 8bcd834513f74478a004528fd7ac06c5 P b6f181c35b4f4302abb813ce7bf1907b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 19:10:01.834942 20475 tablet_bootstrap.cc:492] T 8bcd834513f74478a004528fd7ac06c5 P d11071d9f19b4dfa94163e5732641aaa: Bootstrap starting.
I20260809 19:10:01.836714 20475 tablet_bootstrap.cc:654] T 8bcd834513f74478a004528fd7ac06c5 P d11071d9f19b4dfa94163e5732641aaa: Neither blocks nor log segments found. Creating new log.
I20260809 19:10:01.838860 20474 tablet_bootstrap.cc:492] T 8bcd834513f74478a004528fd7ac06c5 P a755e075e490411390dd20c2549e53e3: No bootstrap required, opened a new log
I20260809 19:10:01.839059 20474 ts_tablet_manager.cc:1397] T 8bcd834513f74478a004528fd7ac06c5 P a755e075e490411390dd20c2549e53e3: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.000s
I20260809 19:10:01.839862 20474 raft_consensus.cc:348] T 8bcd834513f74478a004528fd7ac06c5 P a755e075e490411390dd20c2549e53e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } }
I20260809 19:10:01.840147 20474 raft_consensus.cc:374] T 8bcd834513f74478a004528fd7ac06c5 P a755e075e490411390dd20c2549e53e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:10:01.840225 20474 raft_consensus.cc:729] T 8bcd834513f74478a004528fd7ac06c5 P a755e075e490411390dd20c2549e53e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a755e075e490411390dd20c2549e53e3, State: Initialized, Role: FOLLOWER
I20260809 19:10:01.840478 20474 consensus_queue.cc:260] T 8bcd834513f74478a004528fd7ac06c5 P a755e075e490411390dd20c2549e53e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } }
I20260809 19:10:01.841120 20474 ts_tablet_manager.cc:1428] T 8bcd834513f74478a004528fd7ac06c5 P a755e075e490411390dd20c2549e53e3: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260809 19:10:01.845824 20475 tablet_bootstrap.cc:492] T 8bcd834513f74478a004528fd7ac06c5 P d11071d9f19b4dfa94163e5732641aaa: No bootstrap required, opened a new log
I20260809 19:10:01.846045 20475 ts_tablet_manager.cc:1397] T 8bcd834513f74478a004528fd7ac06c5 P d11071d9f19b4dfa94163e5732641aaa: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.002s
I20260809 19:10:01.846956 20475 raft_consensus.cc:348] T 8bcd834513f74478a004528fd7ac06c5 P d11071d9f19b4dfa94163e5732641aaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } }
I20260809 19:10:01.847268 20475 raft_consensus.cc:374] T 8bcd834513f74478a004528fd7ac06c5 P d11071d9f19b4dfa94163e5732641aaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:10:01.847362 20475 raft_consensus.cc:729] T 8bcd834513f74478a004528fd7ac06c5 P d11071d9f19b4dfa94163e5732641aaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d11071d9f19b4dfa94163e5732641aaa, State: Initialized, Role: FOLLOWER
I20260809 19:10:01.847632 20475 consensus_queue.cc:260] T 8bcd834513f74478a004528fd7ac06c5 P d11071d9f19b4dfa94163e5732641aaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } }
I20260809 19:10:01.849218 20475 ts_tablet_manager.cc:1428] T 8bcd834513f74478a004528fd7ac06c5 P d11071d9f19b4dfa94163e5732641aaa: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 19:10:01.936817 20560 raft_consensus.cc:482] T 8bcd834513f74478a004528fd7ac06c5 P b6f181c35b4f4302abb813ce7bf1907b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:10:01.937064 20560 raft_consensus.cc:504] T 8bcd834513f74478a004528fd7ac06c5 P b6f181c35b4f4302abb813ce7bf1907b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } }
I20260809 19:10:01.937943 20560 leader_election.cc:288] T 8bcd834513f74478a004528fd7ac06c5 P b6f181c35b4f4302abb813ce7bf1907b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d11071d9f19b4dfa94163e5732641aaa (127.7.39.1:33051), a755e075e490411390dd20c2549e53e3 (127.7.39.3:34615)
I20260809 19:10:01.938618 19931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bcd834513f74478a004528fd7ac06c5" candidate_uuid: "b6f181c35b4f4302abb813ce7bf1907b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d11071d9f19b4dfa94163e5732641aaa" is_pre_election: true
I20260809 19:10:01.938714 20354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bcd834513f74478a004528fd7ac06c5" candidate_uuid: "b6f181c35b4f4302abb813ce7bf1907b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a755e075e490411390dd20c2549e53e3" is_pre_election: true
I20260809 19:10:01.938879 19931 raft_consensus.cc:2454] T 8bcd834513f74478a004528fd7ac06c5 P d11071d9f19b4dfa94163e5732641aaa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f181c35b4f4302abb813ce7bf1907b in term 0.
I20260809 19:10:01.938974 20354 raft_consensus.cc:2454] T 8bcd834513f74478a004528fd7ac06c5 P a755e075e490411390dd20c2549e53e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6f181c35b4f4302abb813ce7bf1907b in term 0.
I20260809 19:10:01.939488 20040 leader_election.cc:302] T 8bcd834513f74478a004528fd7ac06c5 P b6f181c35b4f4302abb813ce7bf1907b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a755e075e490411390dd20c2549e53e3, b6f181c35b4f4302abb813ce7bf1907b; no voters:
I20260809 19:10:01.939823 20560 raft_consensus.cc:2781] T 8bcd834513f74478a004528fd7ac06c5 P b6f181c35b4f4302abb813ce7bf1907b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:10:01.939953 20560 raft_consensus.cc:482] T 8bcd834513f74478a004528fd7ac06c5 P b6f181c35b4f4302abb813ce7bf1907b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:10:01.940061 20560 raft_consensus.cc:3037] T 8bcd834513f74478a004528fd7ac06c5 P b6f181c35b4f4302abb813ce7bf1907b [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:10:01.943364 20560 raft_consensus.cc:504] T 8bcd834513f74478a004528fd7ac06c5 P b6f181c35b4f4302abb813ce7bf1907b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } }
I20260809 19:10:01.944512 19931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bcd834513f74478a004528fd7ac06c5" candidate_uuid: "b6f181c35b4f4302abb813ce7bf1907b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d11071d9f19b4dfa94163e5732641aaa"
I20260809 19:10:01.944587 20354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bcd834513f74478a004528fd7ac06c5" candidate_uuid: "b6f181c35b4f4302abb813ce7bf1907b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a755e075e490411390dd20c2549e53e3"
I20260809 19:10:01.944729 19931 raft_consensus.cc:3037] T 8bcd834513f74478a004528fd7ac06c5 P d11071d9f19b4dfa94163e5732641aaa [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:10:01.944820 20354 raft_consensus.cc:3037] T 8bcd834513f74478a004528fd7ac06c5 P a755e075e490411390dd20c2549e53e3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:10:01.947780 20354 raft_consensus.cc:2454] T 8bcd834513f74478a004528fd7ac06c5 P a755e075e490411390dd20c2549e53e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f181c35b4f4302abb813ce7bf1907b in term 1.
I20260809 19:10:01.947969 19931 raft_consensus.cc:2454] T 8bcd834513f74478a004528fd7ac06c5 P d11071d9f19b4dfa94163e5732641aaa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f181c35b4f4302abb813ce7bf1907b in term 1.
I20260809 19:10:01.948275 20040 leader_election.cc:302] T 8bcd834513f74478a004528fd7ac06c5 P b6f181c35b4f4302abb813ce7bf1907b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a755e075e490411390dd20c2549e53e3, b6f181c35b4f4302abb813ce7bf1907b; no voters:
I20260809 19:10:01.948611 20491 raft_consensus.cc:2781] T 8bcd834513f74478a004528fd7ac06c5 P b6f181c35b4f4302abb813ce7bf1907b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:10:01.948758 20491 raft_consensus.cc:686] T 8bcd834513f74478a004528fd7ac06c5 P b6f181c35b4f4302abb813ce7bf1907b [term 1 LEADER]: Becoming Leader. State: Replica: b6f181c35b4f4302abb813ce7bf1907b, State: Running, Role: LEADER
I20260809 19:10:01.949151 20560 leader_election.cc:288] T 8bcd834513f74478a004528fd7ac06c5 P b6f181c35b4f4302abb813ce7bf1907b [CANDIDATE]: Term 1 election: Requested vote from peers d11071d9f19b4dfa94163e5732641aaa (127.7.39.1:33051), a755e075e490411390dd20c2549e53e3 (127.7.39.3:34615)
I20260809 19:10:01.949062 20491 consensus_queue.cc:237] T 8bcd834513f74478a004528fd7ac06c5 P b6f181c35b4f4302abb813ce7bf1907b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } }
I20260809 19:10:01.952600 19685 catalog_manager.cc:5495] T 8bcd834513f74478a004528fd7ac06c5 P b6f181c35b4f4302abb813ce7bf1907b reported cstate change: term changed from 0 to 1, leader changed from <none> to b6f181c35b4f4302abb813ce7bf1907b (127.7.39.2). New cstate: current_term: 1 leader_uuid: "b6f181c35b4f4302abb813ce7bf1907b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6f181c35b4f4302abb813ce7bf1907b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 } health_report { overall_health: UNKNOWN } } }
I20260809 19:10:01.999850 20601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:01.995121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32812 (local address 127.7.39.2:35295)
0809 19:10:01.995508 (+ 387us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:01.995512 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:01.995526 (+ 14us) server_negotiation.cc:407] Connection header received
0809 19:10:01.995571 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:01.995574 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:01.995658 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:01.995797 (+ 139us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:10:01.996166 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:01.996861 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:01.998138 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:01.998593 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:01.998715 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:01.999133 (+ 418us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:10:01.999240 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:10:01.999316 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:01.999461 (+ 145us) server_negotiation.cc:299] Negotiation successful
0809 19:10:01.999535 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":195,"threads_started":1}
I20260809 19:10:02.015678 20601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:02.007049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:51385 (local address 127.7.39.2:35295)
0809 19:10:02.007208 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:02.007214 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:02.010678 (+ 3464us) server_negotiation.cc:407] Connection header received
0809 19:10:02.010844 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:02.010848 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:02.010905 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:02.010972 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:10:02.011447 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:02.012135 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:02.013980 (+ 1845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:02.014491 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:02.014615 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:02.015047 (+ 432us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:10:02.015152 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:10:02.015221 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:02.015360 (+ 139us) server_negotiation.cc:299] Negotiation successful
0809 19:10:02.015418 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 19:10:02.015978 20604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:02.007039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:35295 (local address 127.7.39.2:51385)
0809 19:10:02.010575 (+ 3536us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:02.010595 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:02.010727 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:02.011028 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:02.011033 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:02.011046 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 19:10:02.011294 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:02.011306 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:02.012280 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:02.012285 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:02.013854 (+ 1569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:02.013869 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:02.014693 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:02.014699 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:02.014845 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:02.014891 (+ 46us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 19:10:02.015251 (+ 360us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 19:10:02.015263 (+ 12us) client_negotiation.cc:769] Sending connection context
0809 19:10:02.015336 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 19:10:02.015482 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3385,"thread_start_us":3291,"threads_started":1}
I20260809 19:10:02.023880 20354 raft_consensus.cc:1261] T 8bcd834513f74478a004528fd7ac06c5 P a755e075e490411390dd20c2549e53e3 [term 1 FOLLOWER]: Refusing update from remote peer b6f181c35b4f4302abb813ce7bf1907b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:10:02.024271 19931 raft_consensus.cc:1261] T 8bcd834513f74478a004528fd7ac06c5 P d11071d9f19b4dfa94163e5732641aaa [term 1 FOLLOWER]: Refusing update from remote peer b6f181c35b4f4302abb813ce7bf1907b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:10:02.024420 20560 consensus_queue.cc:1035] T 8bcd834513f74478a004528fd7ac06c5 P b6f181c35b4f4302abb813ce7bf1907b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a755e075e490411390dd20c2549e53e3" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:10:02.024892 20491 consensus_queue.cc:1035] T 8bcd834513f74478a004528fd7ac06c5 P b6f181c35b4f4302abb813ce7bf1907b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d11071d9f19b4dfa94163e5732641aaa" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 33051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:10:02.075001 19685 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52736:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:10:02.075233 19685 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52736:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:10:02.078151 19685 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7d4db9fc530c4e6fb2db0907fabb09d1: Sending DeleteTablet for 3 replicas of tablet 8bcd834513f74478a004528fd7ac06c5
I20260809 19:10:02.078941 19898 tablet_service.cc:1514] Processing DeleteTablet for tablet 8bcd834513f74478a004528fd7ac06c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:10:02 UTC) from {username='oryx', principal='oryx/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:60908
I20260809 19:10:02.078946 20117 tablet_service.cc:1514] Processing DeleteTablet for tablet 8bcd834513f74478a004528fd7ac06c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:10:02 UTC) from {username='oryx', principal='oryx/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:32786
I20260809 19:10:02.079255 20513 tablet_replica.cc:330] T 8bcd834513f74478a004528fd7ac06c5 P d11071d9f19b4dfa94163e5732641aaa: stopping tablet replica
I20260809 19:10:02.079349 20329 tablet_service.cc:1514] Processing DeleteTablet for tablet 8bcd834513f74478a004528fd7ac06c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:10:02 UTC) from {username='oryx', principal='oryx/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:55506
I20260809 19:10:02.079488 20513 raft_consensus.cc:2229] T 8bcd834513f74478a004528fd7ac06c5 P d11071d9f19b4dfa94163e5732641aaa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:10:02.079692 20513 raft_consensus.cc:2258] T 8bcd834513f74478a004528fd7ac06c5 P d11071d9f19b4dfa94163e5732641aaa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:10:02.079941 20515 tablet_replica.cc:330] T 8bcd834513f74478a004528fd7ac06c5 P b6f181c35b4f4302abb813ce7bf1907b: stopping tablet replica
I20260809 19:10:02.080139 20515 raft_consensus.cc:2229] T 8bcd834513f74478a004528fd7ac06c5 P b6f181c35b4f4302abb813ce7bf1907b [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:10:02.080386 20515 raft_consensus.cc:2258] T 8bcd834513f74478a004528fd7ac06c5 P b6f181c35b4f4302abb813ce7bf1907b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:10:02.080631 20511 tablet_replica.cc:330] T 8bcd834513f74478a004528fd7ac06c5 P a755e075e490411390dd20c2549e53e3: stopping tablet replica
I20260809 19:10:02.080649 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 19795
I20260809 19:10:02.080827 20511 raft_consensus.cc:2229] T 8bcd834513f74478a004528fd7ac06c5 P a755e075e490411390dd20c2549e53e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:10:02.081020 20511 raft_consensus.cc:2258] T 8bcd834513f74478a004528fd7ac06c5 P a755e075e490411390dd20c2549e53e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:10:02.081966 20511 ts_tablet_manager.cc:1905] T 8bcd834513f74478a004528fd7ac06c5 P a755e075e490411390dd20c2549e53e3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:10:02.083956 20515 ts_tablet_manager.cc:1905] T 8bcd834513f74478a004528fd7ac06c5 P b6f181c35b4f4302abb813ce7bf1907b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:10:02.088469 20511 ts_tablet_manager.cc:1918] T 8bcd834513f74478a004528fd7ac06c5 P a755e075e490411390dd20c2549e53e3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 19:10:02.088629 20511 log.cc:1196] T 8bcd834513f74478a004528fd7ac06c5 P a755e075e490411390dd20c2549e53e3: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-2/wal/wals/8bcd834513f74478a004528fd7ac06c5
I20260809 19:10:02.089046 20511 ts_tablet_manager.cc:1939] T 8bcd834513f74478a004528fd7ac06c5 P a755e075e490411390dd20c2549e53e3: Deleting consensus metadata
I20260809 19:10:02.090106 19655 catalog_manager.cc:4841] TS a755e075e490411390dd20c2549e53e3 (127.7.39.3:34615): tablet 8bcd834513f74478a004528fd7ac06c5 (table test-table [id=294f0c293d1d4d049f611805fb5255d7]) successfully deleted
I20260809 19:10:02.091135 20515 ts_tablet_manager.cc:1918] T 8bcd834513f74478a004528fd7ac06c5 P b6f181c35b4f4302abb813ce7bf1907b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 19:10:02.091284 20515 log.cc:1196] T 8bcd834513f74478a004528fd7ac06c5 P b6f181c35b4f4302abb813ce7bf1907b: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-1/wal/wals/8bcd834513f74478a004528fd7ac06c5
I20260809 19:10:02.091740 20515 ts_tablet_manager.cc:1939] T 8bcd834513f74478a004528fd7ac06c5 P b6f181c35b4f4302abb813ce7bf1907b: Deleting consensus metadata
Aug 09 19:10:02 dist-test-slave-4tdj krb5kdc[19607](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302601, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.39.1@KRBTEST.COM
I20260809 19:10:02.092844 19660 catalog_manager.cc:4841] TS b6f181c35b4f4302abb813ce7bf1907b (127.7.39.2:35295): tablet 8bcd834513f74478a004528fd7ac06c5 (table test-table [id=294f0c293d1d4d049f611805fb5255d7]) successfully deleted
I20260809 19:10:02.093425 20513 ts_tablet_manager.cc:1905] T 8bcd834513f74478a004528fd7ac06c5 P d11071d9f19b4dfa94163e5732641aaa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:10:02.099486 20464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:02.082062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60938 (local address 127.7.39.1:33051)
0809 19:10:02.082224 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:02.082229 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:02.082250 (+ 21us) server_negotiation.cc:407] Connection header received
0809 19:10:02.082477 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:02.082483 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:02.082567 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:02.082647 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:02.084331 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:02.085410 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:02.087228 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:02.087862 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:02.087954 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:02.092912 (+ 4958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:02.092929 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:02.092951 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:10:02.092994 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:02.096700 (+ 3706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:02.097354 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:02.097364 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:02.097368 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:02.097529 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:02.097853 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:02.097858 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:02.097861 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:02.098372 (+ 511us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:02.098717 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:02.098883 (+ 166us) server_negotiation.cc:299] Negotiation successful
0809 19:10:02.099128 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 19:10:02.099828 20513 ts_tablet_manager.cc:1918] T 8bcd834513f74478a004528fd7ac06c5 P d11071d9f19b4dfa94163e5732641aaa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 19:10:02.099996 20513 log.cc:1196] T 8bcd834513f74478a004528fd7ac06c5 P d11071d9f19b4dfa94163e5732641aaa: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786302538618573-7324-0/minicluster-data/ts-0/wal/wals/8bcd834513f74478a004528fd7ac06c5
I20260809 19:10:02.100169 20001 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:10:02.221402 20513 ts_tablet_manager.cc:1939] T 8bcd834513f74478a004528fd7ac06c5 P d11071d9f19b4dfa94163e5732641aaa: Deleting consensus metadata
I20260809 19:10:02.221901 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 19795
W20260809 19:10:02.250219 19658 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.39.1:33051 (error 108)
I20260809 19:10:02.250550 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 20013
I20260809 19:10:02.252351 20612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:02.251513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:33051 (local address 127.0.0.1:60942)
0809 19:10:02.251987 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:02.252133 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:33051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":202,"threads_started":1}
W20260809 19:10:02.252622 19658 catalog_manager.cc:4584] TS d11071d9f19b4dfa94163e5732641aaa (127.7.39.1:33051): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8bcd834513f74478a004528fd7ac06c5: Network error: Client connection negotiation failed: client connection to 127.7.39.1:33051: connect: Connection refused (error 111)
Aug 09 19:10:02 dist-test-slave-4tdj krb5kdc[19607](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302601, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.39.2@KRBTEST.COM
I20260809 19:10:02.265550 20601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:02.251462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32820 (local address 127.7.39.2:35295)
0809 19:10:02.251654 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:02.251662 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:02.251813 (+ 151us) server_negotiation.cc:407] Connection header received
0809 19:10:02.252032 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:02.252038 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:02.252132 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:02.252245 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:02.253466 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:02.254178 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:02.255574 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:02.255978 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:02.256076 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:02.259824 (+ 3748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:02.259837 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:02.259852 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:10:02.259885 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:02.262819 (+ 2934us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:02.263461 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:02.263469 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:02.263472 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:02.263647 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:02.264027 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:02.264032 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:02.264034 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:02.264392 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:02.264664 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:02.265025 (+ 361us) server_negotiation.cc:299] Negotiation successful
0809 19:10:02.265253 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 19:10:02.266182 20214 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:10:02.306056 20612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:02.305595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:33051 (local address 127.0.0.1:60950)
0809 19:10:02.305799 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:02.305887 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:33051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260809 19:10:02.307175 20612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:02.306787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:33051 (local address 127.0.0.1:60952)
0809 19:10:02.306904 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:02.306976 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:33051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 19:10:02.367939 20612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:02.367467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:33051 (local address 127.0.0.1:60956)
0809 19:10:02.367690 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:02.367787 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:33051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260809 19:10:02.368960 20612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:02.368597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:33051 (local address 127.0.0.1:60968)
0809 19:10:02.368745 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:02.368818 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:33051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260809 19:10:02.410796 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 20013
I20260809 19:10:02.443557 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 20227
I20260809 19:10:02.449412 20612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:02.448953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:33051 (local address 127.0.0.1:60972)
0809 19:10:02.449140 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:02.449244 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:33051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260809 19:10:02.450507 20612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:02.450076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:33051 (local address 127.0.0.1:60978)
0809 19:10:02.450214 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:02.450283 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:33051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
Aug 09 19:10:02 dist-test-slave-4tdj krb5kdc[19607](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302601, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.39.3@KRBTEST.COM
I20260809 19:10:02.458352 20615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:02.444306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55514 (local address 127.7.39.3:34615)
0809 19:10:02.444817 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:02.444821 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:02.444836 (+ 15us) server_negotiation.cc:407] Connection header received
0809 19:10:02.444890 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:02.444894 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:02.444951 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:02.445043 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:02.446283 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:02.447004 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:02.448249 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:02.448698 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:02.448813 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:02.453190 (+ 4377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:02.453206 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:02.453223 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:10:02.453256 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:02.455806 (+ 2550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:02.456416 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:02.456423 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:02.456425 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:02.456552 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:02.456889 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:02.456893 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:02.456895 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:02.457223 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:02.457513 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:02.457803 (+ 290us) server_negotiation.cc:299] Negotiation successful
0809 19:10:02.458017 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":267,"threads_started":1}
I20260809 19:10:02.458949 20424 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:10:02.552690 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 20227
I20260809 19:10:02.573418 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 19632
I20260809 19:10:02.574599 19746 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:10:02.688786 20612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:02.688081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:33051 (local address 127.0.0.1:60980)
0809 19:10:02.688418 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:02.688597 (+ 179us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:33051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260809 19:10:02.689047 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 19632
2026-08-09T19:10:02Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (5575 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:10:02 dist-test-slave-4tdj krb5kdc[20622](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:10:02 dist-test-slave-4tdj krb5kdc[20622](info): set up 2 sockets
Aug 09 19:10:02 dist-test-slave-4tdj krb5kdc[20622](info): commencing operation
krb5kdc: starting...
W20260809 19:10:03.921785 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.183s user 0.000s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:10:04 dist-test-slave-4tdj krb5kdc[20622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302604, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:10:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:10:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.39.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
I20260809 19:10:04.129520 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:34687
--webserver_interface=127.7.39.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:36923
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:34687
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:10:04.441380 20641 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:10:04.441653 20641 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:10:04.441781 20641 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:10:04.448624 20641 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:10:04.448727 20641 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:10:04.448804 20641 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:10:04.448879 20641 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:10:04.448944 20641 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:10:04.458087 20641 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:36923
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:34687
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:34687
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:10:04.459263 20641 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:10:04.460492 20641 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:10:04.471256 20653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:04.471225 20654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:04.471421 20657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:10:04.472280 20641 server_base.cc:1034] running on GCE node
I20260809 19:10:04.473042 20641 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:10:04.474366 20641 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:10:04.475574 20641 hybrid_clock.cc:648] HybridClock initialized: now 1786302604475521 us; error 40 us; skew 500 ppm
I20260809 19:10:04.475888 20641 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-09T19:10:04Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1849 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:10:04 dist-test-slave-4tdj krb5kdc[20664](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:10:04 dist-test-slave-4tdj krb5kdc[20664](info): set up 2 sockets
Aug 09 19:10:04 dist-test-slave-4tdj krb5kdc[20664](info): commencing operation
krb5kdc: starting...
W20260809 19:10:05.742056 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.153s user 0.000s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:10:05 dist-test-slave-4tdj krb5kdc[20664](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302605, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:10:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:10:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.39.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
I20260809 19:10:05.953560 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:34587
--webserver_interface=127.7.39.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:33353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:34587
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:10:06.268862 20685 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:10:06.269132 20685 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:10:06.269266 20685 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:10:06.276216 20685 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:10:06.276330 20685 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:10:06.276407 20685 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:10:06.276496 20685 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:10:06.276556 20685 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:10:06.285903 20685 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:33353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:34587
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:34587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:10:06.287139 20685 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:10:06.288488 20685 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:10:06.299760 20693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:06.299711 20700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:06.299788 20696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:10:06.300870 20685 server_base.cc:1034] running on GCE node
I20260809 19:10:06.301607 20685 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:10:06.302990 20685 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:10:06.304196 20685 hybrid_clock.cc:648] HybridClock initialized: now 1786302606304149 us; error 33 us; skew 500 ppm
I20260809 19:10:06.304522 20685 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:10:06 dist-test-slave-4tdj krb5kdc[20664](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302606, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:10:06.307534 20685 init.cc:377] Logged in from keytab as kudu/127.7.39.62@KRBTEST.COM (short username kudu)
I20260809 19:10:06.308889 20685 webserver.cc:460] Webserver started at http://127.7.39.62:40373/ using document root <none> and password file <none>
I20260809 19:10:06.309525 20685 fs_manager.cc:359] Metadata directory not provided
I20260809 19:10:06.309643 20685 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:10:06.309929 20685 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:10:06.312749 20685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "383deb0a3901488480a2fce986ba5783"
format_stamp: "Formatted at 2026-08-09 19:10:06 on dist-test-slave-4tdj"
server_key: "290249fa0d99deaa1c5e2e85ad92d119"
server_key_iv: "ccad2ee4f439fca4c164c22b46a70f9c"
server_key_version: "encryptionkey@0"
I20260809 19:10:06.313496 20685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "383deb0a3901488480a2fce986ba5783"
format_stamp: "Formatted at 2026-08-09 19:10:06 on dist-test-slave-4tdj"
server_key: "290249fa0d99deaa1c5e2e85ad92d119"
server_key_iv: "ccad2ee4f439fca4c164c22b46a70f9c"
server_key_version: "encryptionkey@0"
I20260809 19:10:06.318392 20685 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 19:10:06.321586 20709 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:06.322849 20685 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260809 19:10:06.323022 20685 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "383deb0a3901488480a2fce986ba5783"
format_stamp: "Formatted at 2026-08-09 19:10:06 on dist-test-slave-4tdj"
server_key: "290249fa0d99deaa1c5e2e85ad92d119"
server_key_iv: "ccad2ee4f439fca4c164c22b46a70f9c"
server_key_version: "encryptionkey@0"
I20260809 19:10:06.323190 20685 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:10:06.335148 20685 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:10:06.338817 20685 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:10:06.339072 20685 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:10:06.354959 20685 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:34587
I20260809 19:10:06.354998 20793 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:34587 every 8 connection(s)
I20260809 19:10:06.356274 20685 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:10:06.359727 20794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:10:06.361516 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 20685
I20260809 19:10:06.361721 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:10:06.362564 7324 external_mini_cluster.cc:1428] Setting key 032863d027b3f480367404af87b8fb33
I20260809 19:10:06.371819 20794 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783: Bootstrap starting.
I20260809 19:10:06.375450 20794 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783: Neither blocks nor log segments found. Creating new log.
Aug 09 19:10:06 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302605, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:10:06.376575 20794 log.cc:824] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783: Log is configured to *not* fsync() on all Append() calls
I20260809 19:10:06.379400 20794 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783: No bootstrap required, opened a new log
I20260809 19:10:06.384212 20801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:06.364548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39614 (local address 127.7.39.62:34587)
0809 19:10:06.365305 (+ 757us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:06.365316 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:06.365357 (+ 41us) server_negotiation.cc:407] Connection header received
0809 19:10:06.367048 (+ 1691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:06.367071 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:06.367419 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:06.367710 (+ 291us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:06.369445 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:06.370837 (+ 1392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:06.372447 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:06.373076 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:06.373204 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:06.377534 (+ 4330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:06.377555 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:06.377572 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:10:06.377615 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:06.380502 (+ 2887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:06.381259 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:06.381265 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:06.381270 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:06.381433 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:06.381804 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:06.381807 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:06.381809 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:06.382283 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:06.382520 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:06.382927 (+ 407us) server_negotiation.cc:299] Negotiation successful
0809 19:10:06.383224 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":543,"thread_start_us":325,"threads_started":1}
I20260809 19:10:06.387504 20794 raft_consensus.cc:348] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "383deb0a3901488480a2fce986ba5783" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34587 } }
I20260809 19:10:06.387814 20794 raft_consensus.cc:374] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:10:06.387903 20794 raft_consensus.cc:729] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 383deb0a3901488480a2fce986ba5783, State: Initialized, Role: FOLLOWER
I20260809 19:10:06.388378 20794 consensus_queue.cc:260] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "383deb0a3901488480a2fce986ba5783" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34587 } }
I20260809 19:10:06.388590 20794 raft_consensus.cc:388] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:10:06.388708 20794 raft_consensus.cc:482] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:10:06.388864 20794 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:10:06.390893 20794 raft_consensus.cc:504] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "383deb0a3901488480a2fce986ba5783" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34587 } }
I20260809 19:10:06.391327 20794 leader_election.cc:302] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 383deb0a3901488480a2fce986ba5783; no voters:
I20260809 19:10:06.391825 20794 leader_election.cc:288] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:10:06.391918 20803 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:10:06.392940 20803 raft_consensus.cc:686] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783 [term 1 LEADER]: Becoming Leader. State: Replica: 383deb0a3901488480a2fce986ba5783, State: Running, Role: LEADER
I20260809 19:10:06.393471 20803 consensus_queue.cc:237] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "383deb0a3901488480a2fce986ba5783" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34587 } }
I20260809 19:10:06.393800 20794 sys_catalog.cc:564] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:10:06.396045 20811 sys_catalog.cc:455] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 383deb0a3901488480a2fce986ba5783. Latest consensus state: current_term: 1 leader_uuid: "383deb0a3901488480a2fce986ba5783" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "383deb0a3901488480a2fce986ba5783" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34587 } } }
I20260809 19:10:06.396448 20811 sys_catalog.cc:458] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783 [sys.catalog]: This master's current role is: LEADER
I20260809 19:10:06.397302 20804 sys_catalog.cc:455] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "383deb0a3901488480a2fce986ba5783" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "383deb0a3901488480a2fce986ba5783" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34587 } } }
I20260809 19:10:06.397596 20804 sys_catalog.cc:458] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783 [sys.catalog]: This master's current role is: LEADER
I20260809 19:10:06.399571 20826 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:10:06.404064 20826 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:10:06.412701 20826 catalog_manager.cc:1347] Generated new cluster ID: 198d47e1812e47788e1bc9c792d77440
I20260809 19:10:06.412799 20826 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:10:06.440240 20826 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:10:06.441504 20826 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:10:06.451871 20826 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783: Generated new TSK 0
I20260809 19:10:06.452610 20826 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.39.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
I20260809 19:10:06.521514 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.1:0
--local_ip_for_outbound_sockets=127.7.39.1
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:34587
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:33353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:10:06.839845 20842 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:10:06.840082 20842 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:10:06.840178 20842 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:10:06.846989 20842 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:10:06.847079 20842 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:10:06.847189 20842 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.1
I20260809 19:10:06.856186 20842 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:33353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:34587
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.1
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:10:06.857277 20842 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:10:06.858497 20842 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:10:06.870575 20849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:06.870669 20848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:06.870646 20852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:10:06.871431 20842 server_base.cc:1034] running on GCE node
I20260809 19:10:06.871989 20842 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:10:06.872830 20842 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:10:06.874009 20842 hybrid_clock.cc:648] HybridClock initialized: now 1786302606873961 us; error 44 us; skew 500 ppm
I20260809 19:10:06.874310 20842 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:10:06 dist-test-slave-4tdj krb5kdc[20664](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302606, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:10:06.880291 20842 init.cc:377] Logged in from keytab as kudu/127.7.39.1@KRBTEST.COM (short username kudu)
I20260809 19:10:06.881582 20842 webserver.cc:460] Webserver started at http://127.7.39.1:38587/ using document root <none> and password file <none>
I20260809 19:10:06.882200 20842 fs_manager.cc:359] Metadata directory not provided
I20260809 19:10:06.882326 20842 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:10:06.882614 20842 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:10:06.885396 20842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-0/data/instance:
uuid: "0467f74dd73d4516a1139c8f48d6a117"
format_stamp: "Formatted at 2026-08-09 19:10:06 on dist-test-slave-4tdj"
server_key: "f53c4745091bbd032636d5659dc59d6e"
server_key_iv: "9148129d583301c7cda7f213a4d06708"
server_key_version: "encryptionkey@0"
I20260809 19:10:06.886122 20842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance:
uuid: "0467f74dd73d4516a1139c8f48d6a117"
format_stamp: "Formatted at 2026-08-09 19:10:06 on dist-test-slave-4tdj"
server_key: "f53c4745091bbd032636d5659dc59d6e"
server_key_iv: "9148129d583301c7cda7f213a4d06708"
server_key_version: "encryptionkey@0"
I20260809 19:10:06.890966 20842 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260809 19:10:06.894151 20861 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:06.895620 20842 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260809 19:10:06.895763 20842 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-0/wal
uuid: "0467f74dd73d4516a1139c8f48d6a117"
format_stamp: "Formatted at 2026-08-09 19:10:06 on dist-test-slave-4tdj"
server_key: "f53c4745091bbd032636d5659dc59d6e"
server_key_iv: "9148129d583301c7cda7f213a4d06708"
server_key_version: "encryptionkey@0"
I20260809 19:10:06.895928 20842 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:10:06.922794 20842 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:10:06.926949 20842 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:10:06.927201 20842 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:10:06.928092 20842 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:10:06.929323 20842 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:10:06.929391 20842 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:06.929478 20842 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:10:06.929520 20842 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:06.961582 20842 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.1:45717
I20260809 19:10:06.961616 21030 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.1:45717 every 8 connection(s)
I20260809 19:10:06.962922 20842 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
I20260809 19:10:06.963495 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 20842
I20260809 19:10:06.963708 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance
I20260809 19:10:06.964548 7324 external_mini_cluster.cc:1428] Setting key df166d6f233197290c1cff4fb7efb744
Aug 09 19:10:06 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302606, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:10:06.983865 21036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:06.965716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:42009 (local address 127.7.39.62:34587)
0809 19:10:06.966185 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:06.966190 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:06.967375 (+ 1185us) server_negotiation.cc:407] Connection header received
0809 19:10:06.969764 (+ 2389us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:06.969768 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:06.969845 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:06.969938 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:06.971843 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:06.972571 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:06.974622 (+ 2051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:06.975007 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:06.975116 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:06.978682 (+ 3566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:06.978686 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:06.978689 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:10:06.978721 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:06.980975 (+ 2254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:06.981800 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:06.981803 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:06.981805 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:06.981909 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:06.982347 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:06.982350 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:06.982352 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:06.982595 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:06.982699 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:06.983458 (+ 759us) server_negotiation.cc:299] Negotiation successful
0809 19:10:06.983620 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":239,"threads_started":1}
I20260809 19:10:06.985138 21037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:06.966326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.1:42009)
0809 19:10:06.967186 (+ 860us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:06.967248 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:06.969462 (+ 2214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:06.970187 (+ 725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:06.970197 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:06.970901 (+ 704us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:06.971651 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:06.971676 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:06.972727 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:06.972732 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:06.974491 (+ 1759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:06.974512 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:06.975239 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:06.975245 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:06.975500 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:06.976153 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:06.976182 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:06.978479 (+ 2297us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:10:06.981115 (+ 2636us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:10:06.981124 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:10:06.981142 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:10:06.981703 (+ 561us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:10:06.981998 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:10:06.982002 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:10:06.982006 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:10:06.982228 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:10:06.982725 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:10:06.982732 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:10:06.983094 (+ 362us) client_negotiation.cc:769] Sending connection context
0809 19:10:06.983379 (+ 285us) client_negotiation.cc:240] Negotiation successful
0809 19:10:06.983876 (+ 497us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":350,"threads_started":1}
I20260809 19:10:06.986691 21031 heartbeater.cc:347] Connected to a master server at 127.7.39.62:34587
I20260809 19:10:06.987010 21031 heartbeater.cc:464] Registering TS with master...
I20260809 19:10:06.987843 21031 heartbeater.cc:511] Master 127.7.39.62:34587 requested a full tablet report, sending...
I20260809 19:10:06.990321 20738 ts_manager.cc:194] Registered new tserver with Master: 0467f74dd73d4516a1139c8f48d6a117 (127.7.39.1:45717)
WARNING: no policy specified for kudu/127.7.39.2@KRBTEST.COM; defaulting to no policy
I20260809 19:10:06.992369 20738 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.1@KRBTEST.COM'} at 127.7.39.1:42009
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
I20260809 19:10:07.018397 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.2:0
--local_ip_for_outbound_sockets=127.7.39.2
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:34587
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:33353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:10:07.330683 21044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:10:07.330916 21044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:10:07.331012 21044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:10:07.337914 21044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:10:07.338008 21044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:10:07.338119 21044 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.2
I20260809 19:10:07.347430 21044 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:33353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:34587
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.2
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:10:07.348553 21044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:10:07.349777 21044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:10:07.362663 21051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:07.362705 21052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:07.363185 21054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:10:07.364107 21044 server_base.cc:1034] running on GCE node
I20260809 19:10:07.364828 21044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:10:07.365818 21044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:10:07.367030 21044 hybrid_clock.cc:648] HybridClock initialized: now 1786302607366979 us; error 43 us; skew 500 ppm
I20260809 19:10:07.367329 21044 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:10:07 dist-test-slave-4tdj krb5kdc[20664](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302607, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:10:07.370837 21044 init.cc:377] Logged in from keytab as kudu/127.7.39.2@KRBTEST.COM (short username kudu)
I20260809 19:10:07.372397 21044 webserver.cc:460] Webserver started at http://127.7.39.2:45815/ using document root <none> and password file <none>
I20260809 19:10:07.373014 21044 fs_manager.cc:359] Metadata directory not provided
I20260809 19:10:07.373113 21044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:10:07.373370 21044 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:10:07.376111 21044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-1/data/instance:
uuid: "a1101b892066428bb81d992e4071b8e0"
format_stamp: "Formatted at 2026-08-09 19:10:07 on dist-test-slave-4tdj"
server_key: "8a3f1bceb6086315430eaed8c82a10a9"
server_key_iv: "46cd14bed3d7d9b26429c6df9fe4aa9d"
server_key_version: "encryptionkey@0"
I20260809 19:10:07.376854 21044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance:
uuid: "a1101b892066428bb81d992e4071b8e0"
format_stamp: "Formatted at 2026-08-09 19:10:07 on dist-test-slave-4tdj"
server_key: "8a3f1bceb6086315430eaed8c82a10a9"
server_key_iv: "46cd14bed3d7d9b26429c6df9fe4aa9d"
server_key_version: "encryptionkey@0"
I20260809 19:10:07.381609 21044 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260809 19:10:07.384909 21073 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:07.386173 21044 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 19:10:07.386396 21044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-1/wal
uuid: "a1101b892066428bb81d992e4071b8e0"
format_stamp: "Formatted at 2026-08-09 19:10:07 on dist-test-slave-4tdj"
server_key: "8a3f1bceb6086315430eaed8c82a10a9"
server_key_iv: "46cd14bed3d7d9b26429c6df9fe4aa9d"
server_key_version: "encryptionkey@0"
I20260809 19:10:07.386595 21044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:10:07.405963 21044 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:10:07.409929 21044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:10:07.410185 21044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:10:07.411085 21044 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:10:07.412303 21044 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:10:07.412379 21044 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:07.412506 21044 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:10:07.412560 21044 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:07.441468 21044 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.2:45175
I20260809 19:10:07.441510 21242 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.2:45175 every 8 connection(s)
I20260809 19:10:07.442669 21044 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
I20260809 19:10:07.447856 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 21044
I20260809 19:10:07.448010 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance
I20260809 19:10:07.448436 7324 external_mini_cluster.cc:1428] Setting key a01531e49c22493f692484f2e2003a83
Aug 09 19:10:07 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302607, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:10:07.461186 21036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:07.444992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:48455 (local address 127.7.39.62:34587)
0809 19:10:07.445167 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:07.445171 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:07.446236 (+ 1065us) server_negotiation.cc:407] Connection header received
0809 19:10:07.448023 (+ 1787us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:07.448029 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:07.448120 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:07.448209 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:07.449789 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:07.450650 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:07.452105 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:07.452549 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:07.452657 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:07.455895 (+ 3238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:07.455900 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:07.455903 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:10:07.455934 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:07.458347 (+ 2413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:07.458989 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:07.458995 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:07.458999 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:07.459127 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:07.459526 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:07.459531 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:07.459535 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:07.459806 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:07.459937 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:07.460616 (+ 679us) server_negotiation.cc:299] Negotiation successful
0809 19:10:07.460854 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 19:10:07.462149 21247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:07.445385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.2:48455)
0809 19:10:07.446085 (+ 700us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:07.446121 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:07.447761 (+ 1640us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:07.448457 (+ 696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:07.448465 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:07.449029 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:07.449624 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:07.449642 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:07.450788 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:07.450792 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:07.451961 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:07.451973 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:07.452764 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:07.452771 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:07.453044 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:07.453638 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:07.453665 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:07.455686 (+ 2021us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:10:07.458464 (+ 2778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:10:07.458473 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:10:07.458490 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:10:07.458879 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:10:07.459229 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:10:07.459234 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:10:07.459238 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:10:07.459413 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:10:07.459925 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:10:07.459932 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:10:07.460259 (+ 327us) client_negotiation.cc:769] Sending connection context
0809 19:10:07.460502 (+ 243us) client_negotiation.cc:240] Negotiation successful
0809 19:10:07.461028 (+ 526us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":273,"threads_started":1}
I20260809 19:10:07.463568 21244 heartbeater.cc:347] Connected to a master server at 127.7.39.62:34587
I20260809 19:10:07.463884 21244 heartbeater.cc:464] Registering TS with master...
I20260809 19:10:07.464763 21244 heartbeater.cc:511] Master 127.7.39.62:34587 requested a full tablet report, sending...
I20260809 19:10:07.466356 20738 ts_manager.cc:194] Registered new tserver with Master: a1101b892066428bb81d992e4071b8e0 (127.7.39.2:45175)
I20260809 19:10:07.467423 20738 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.2@KRBTEST.COM'} at 127.7.39.2:48455
WARNING: no policy specified for kudu/127.7.39.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
I20260809 19:10:07.499183 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.3:0
--local_ip_for_outbound_sockets=127.7.39.3
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:34587
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:33353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:10:07.817028 21253 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:10:07.817294 21253 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:10:07.817445 21253 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:10:07.824273 21253 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:10:07.824376 21253 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:10:07.824513 21253 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.3
I20260809 19:10:07.833633 21253 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:33353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:34587
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.3
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:10:07.835005 21253 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:10:07.836578 21253 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:10:07.848946 21262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:07.848984 21265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:07.849009 21263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:10:07.849983 21253 server_base.cc:1034] running on GCE node
I20260809 19:10:07.850569 21253 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:10:07.851392 21253 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:10:07.852582 21253 hybrid_clock.cc:648] HybridClock initialized: now 1786302607852536 us; error 34 us; skew 500 ppm
I20260809 19:10:07.852857 21253 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:10:07 dist-test-slave-4tdj krb5kdc[20664](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302607, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:10:07.855734 21253 init.cc:377] Logged in from keytab as kudu/127.7.39.3@KRBTEST.COM (short username kudu)
I20260809 19:10:07.856974 21253 webserver.cc:460] Webserver started at http://127.7.39.3:34889/ using document root <none> and password file <none>
I20260809 19:10:07.857573 21253 fs_manager.cc:359] Metadata directory not provided
I20260809 19:10:07.857685 21253 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:10:07.857965 21253 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:10:07.860628 21253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-2/data/instance:
uuid: "792b5a4187ac471a8cde4b7a343c150d"
format_stamp: "Formatted at 2026-08-09 19:10:07 on dist-test-slave-4tdj"
server_key: "c8088dc40081d7efe8e630cb143d884d"
server_key_iv: "c17cb601d5163e898265d320660ee4bb"
server_key_version: "encryptionkey@0"
I20260809 19:10:07.861341 21253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance:
uuid: "792b5a4187ac471a8cde4b7a343c150d"
format_stamp: "Formatted at 2026-08-09 19:10:07 on dist-test-slave-4tdj"
server_key: "c8088dc40081d7efe8e630cb143d884d"
server_key_iv: "c17cb601d5163e898265d320660ee4bb"
server_key_version: "encryptionkey@0"
I20260809 19:10:07.865964 21253 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260809 19:10:07.869163 21274 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:07.870357 21253 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260809 19:10:07.870504 21253 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-2/wal
uuid: "792b5a4187ac471a8cde4b7a343c150d"
format_stamp: "Formatted at 2026-08-09 19:10:07 on dist-test-slave-4tdj"
server_key: "c8088dc40081d7efe8e630cb143d884d"
server_key_iv: "c17cb601d5163e898265d320660ee4bb"
server_key_version: "encryptionkey@0"
I20260809 19:10:07.870673 21253 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:10:07.901770 21253 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:10:07.905730 21253 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:10:07.905987 21253 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:10:07.906931 21253 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:10:07.908206 21253 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:10:07.908278 21253 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:07.908391 21253 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:10:07.908448 21253 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:07.937353 21253 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.3:38455
I20260809 19:10:07.937414 21447 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.3:38455 every 8 connection(s)
I20260809 19:10:07.938577 21253 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
I20260809 19:10:07.946798 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 21253
I20260809 19:10:07.946945 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance
I20260809 19:10:07.947363 7324 external_mini_cluster.cc:1428] Setting key e222a7ee2aabfdc5c2cc1ae13e17a267
Aug 09 19:10:07 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302607, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:10:07.956692 21036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:07.940877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:43769 (local address 127.7.39.62:34587)
0809 19:10:07.941043 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:07.941047 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:07.942175 (+ 1128us) server_negotiation.cc:407] Connection header received
0809 19:10:07.943941 (+ 1766us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:07.943947 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:07.944025 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:07.944134 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:07.945538 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:07.946276 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:07.947958 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:07.948429 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:07.948550 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:07.951789 (+ 3239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:07.951794 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:07.951797 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:10:07.951834 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:07.954210 (+ 2376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:07.954876 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:07.954879 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:07.954881 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:07.955005 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:07.955369 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:07.955372 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:07.955374 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:07.955613 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:07.955715 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:07.956302 (+ 587us) server_negotiation.cc:299] Negotiation successful
0809 19:10:07.956459 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 19:10:07.957592 21453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:07.941342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.3:43769)
0809 19:10:07.942020 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:07.942058 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:07.943679 (+ 1621us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:07.944354 (+ 675us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:07.944362 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:07.944853 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:07.945401 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:07.945418 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:07.946440 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:07.946444 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:07.947797 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:07.947815 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:07.948661 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:07.948668 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:07.948896 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:07.949481 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:07.949504 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:07.951617 (+ 2113us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:10:07.954366 (+ 2749us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:10:07.954372 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:10:07.954383 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:10:07.954782 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:10:07.955104 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:10:07.955107 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:10:07.955110 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:10:07.955289 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:10:07.955715 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:10:07.955720 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:10:07.955993 (+ 273us) client_negotiation.cc:769] Sending connection context
0809 19:10:07.956212 (+ 219us) client_negotiation.cc:240] Negotiation successful
0809 19:10:07.956561 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":279,"threads_started":1}
I20260809 19:10:07.958814 21450 heartbeater.cc:347] Connected to a master server at 127.7.39.62:34587
I20260809 19:10:07.959065 21450 heartbeater.cc:464] Registering TS with master...
I20260809 19:10:07.959697 21450 heartbeater.cc:511] Master 127.7.39.62:34587 requested a full tablet report, sending...
I20260809 19:10:07.961107 20738 ts_manager.cc:194] Registered new tserver with Master: 792b5a4187ac471a8cde4b7a343c150d (127.7.39.3:38455)
I20260809 19:10:07.962150 20738 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.3@KRBTEST.COM'} at 127.7.39.3:43769
I20260809 19:10:07.962370 7324 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.7.39.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.39.1@KRBTEST.COM" created.
I20260809 19:10:07.995393 21031 heartbeater.cc:503] Master 127.7.39.62:34587 was elected leader, sending a full tablet report...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.39.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.1.keytab.
Entry for principal oryx/127.7.39.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.1.keytab.
WARNING: no policy specified for oryx/127.7.39.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.39.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.39.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.2.keytab.
Entry for principal oryx/127.7.39.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.2.keytab.
WARNING: no policy specified for oryx/127.7.39.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.39.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.39.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.3.keytab.
Entry for principal oryx/127.7.39.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.3.keytab.
I20260809 19:10:08.088131 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 20842
Aug 09 19:10:08 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302605, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.1@KRBTEST.COM
I20260809 19:10:08.104491 21464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:08.089268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39592 (local address 127.7.39.1:45717)
0809 19:10:08.089899 (+ 631us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:08.089908 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:08.089944 (+ 36us) server_negotiation.cc:407] Connection header received
0809 19:10:08.090012 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:08.090019 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:08.090277 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:08.090479 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:08.091799 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:08.092900 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:08.094217 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:08.094887 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:08.095034 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:08.099136 (+ 4102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:08.099146 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:08.099160 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:10:08.099196 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:08.101919 (+ 2723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:08.102613 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:08.102621 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:08.102623 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:08.102778 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:08.103056 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:08.103059 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:08.103061 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:08.103426 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:08.103675 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:08.103904 (+ 229us) server_negotiation.cc:299] Negotiation successful
0809 19:10:08.104121 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":472,"thread_start_us":322,"threads_started":1}
I20260809 19:10:08.105825 21025 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:10:08.186558 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 20842
I20260809 19:10:08.208815 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 21044
Aug 09 19:10:08 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302605, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.2@KRBTEST.COM
I20260809 19:10:08.223417 21466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:08.209679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55706 (local address 127.7.39.2:45175)
0809 19:10:08.210235 (+ 556us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:08.210242 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:08.210268 (+ 26us) server_negotiation.cc:407] Connection header received
0809 19:10:08.210365 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:08.210372 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:08.210582 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:08.210707 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:08.211824 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:08.212800 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:08.214003 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:08.214569 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:08.214666 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:08.218409 (+ 3743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:08.218419 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:08.218432 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:10:08.218468 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:08.220914 (+ 2446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:08.221484 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:08.221490 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:08.221493 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:08.221614 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:08.221957 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:08.221960 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:08.221962 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:08.222272 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:08.222614 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:08.222872 (+ 258us) server_negotiation.cc:299] Negotiation successful
0809 19:10:08.223076 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":295,"threads_started":1}
I20260809 19:10:08.224624 21234 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:10:08.304193 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 21044
I20260809 19:10:08.328415 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 21253
Aug 09 19:10:08 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302605, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.3@KRBTEST.COM
I20260809 19:10:08.343134 21475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:08.329313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44862 (local address 127.7.39.3:38455)
0809 19:10:08.329886 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:08.329893 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:08.329924 (+ 31us) server_negotiation.cc:407] Connection header received
0809 19:10:08.329982 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:08.329988 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:08.330196 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:08.330349 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:08.331524 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:08.332537 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:08.333681 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:08.334202 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:08.334396 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:08.338369 (+ 3973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:08.338380 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:08.338394 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:10:08.338426 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:08.340883 (+ 2457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:08.341467 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:08.341473 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:08.341476 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:08.341603 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:08.341866 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:08.341868 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:08.341870 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:08.342191 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:08.342552 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:08.342672 (+ 120us) server_negotiation.cc:299] Negotiation successful
0809 19:10:08.342857 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":428,"thread_start_us":269,"threads_started":1}
I20260809 19:10:08.344362 21438 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:10:08.424173 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 21253
I20260809 19:10:08.443048 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 20685
I20260809 19:10:08.444231 20784 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:10:08.544289 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 20685
I20260809 19:10:08.571380 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:34587
--webserver_interface=127.7.39.62
--webserver_port=40373
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:33353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:34587
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:10:08.884292 21478 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:10:08.884598 21478 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:10:08.884735 21478 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:10:08.891934 21478 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:10:08.892045 21478 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:10:08.892127 21478 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:10:08.892205 21478 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:10:08.892266 21478 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:10:08.901973 21478 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:33353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:34587
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:34587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=40373
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:10:08.903272 21478 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:10:08.904578 21478 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:10:08.915720 21491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:08.915802 21492 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:08.915838 21495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:10:08.916601 21478 server_base.cc:1034] running on GCE node
I20260809 19:10:08.917361 21478 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:10:08.918766 21478 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:10:08.919961 21478 hybrid_clock.cc:648] HybridClock initialized: now 1786302608919910 us; error 40 us; skew 500 ppm
I20260809 19:10:08.920266 21478 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:10:08 dist-test-slave-4tdj krb5kdc[20664](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302608, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:10:08.923108 21478 init.cc:377] Logged in from keytab as kudu/127.7.39.62@KRBTEST.COM (short username kudu)
I20260809 19:10:08.924499 21478 webserver.cc:460] Webserver started at http://127.7.39.62:40373/ using document root <none> and password file <none>
I20260809 19:10:08.925151 21478 fs_manager.cc:359] Metadata directory not provided
I20260809 19:10:08.925293 21478 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:10:08.930764 21478 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.003s
I20260809 19:10:08.933465 21510 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:08.934742 21478 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:10:08.934898 21478 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "383deb0a3901488480a2fce986ba5783"
format_stamp: "Formatted at 2026-08-09 19:10:06 on dist-test-slave-4tdj"
server_key: "290249fa0d99deaa1c5e2e85ad92d119"
server_key_iv: "ccad2ee4f439fca4c164c22b46a70f9c"
server_key_version: "encryptionkey@0"
I20260809 19:10:08.935827 21478 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:10:08.974424 21478 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:10:08.978528 21478 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:10:08.978783 21478 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:10:08.996429 21478 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:34587
I20260809 19:10:08.996464 21574 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:34587 every 8 connection(s)
I20260809 19:10:08.997840 21478 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:10:09.001816 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 21478
I20260809 19:10:09.002823 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.1:45717
--local_ip_for_outbound_sockets=127.7.39.1
--tserver_master_addrs=127.7.39.62:34587
--webserver_port=38587
--webserver_interface=127.7.39.1
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:33353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.7.39.1
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.1.keytab with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 19:10:09.005776 21575 sys_catalog.cc:263] Verifying existing consensus state
I20260809 19:10:09.009991 21575 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783: Bootstrap starting.
I20260809 19:10:09.031910 21575 log.cc:824] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783: Log is configured to *not* fsync() on all Append() calls
I20260809 19:10:09.041479 21575 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 19:10:09.042083 21575 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783: Bootstrap complete.
I20260809 19:10:09.051230 21575 raft_consensus.cc:348] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "383deb0a3901488480a2fce986ba5783" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34587 } }
I20260809 19:10:09.052080 21575 raft_consensus.cc:729] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 383deb0a3901488480a2fce986ba5783, State: Initialized, Role: FOLLOWER
I20260809 19:10:09.052686 21575 consensus_queue.cc:260] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "383deb0a3901488480a2fce986ba5783" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34587 } }
I20260809 19:10:09.052924 21575 raft_consensus.cc:388] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:10:09.053063 21575 raft_consensus.cc:482] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:10:09.053251 21575 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783 [term 1 FOLLOWER]: Advancing to term 2
I20260809 19:10:09.057183 21575 raft_consensus.cc:504] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "383deb0a3901488480a2fce986ba5783" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34587 } }
I20260809 19:10:09.057649 21575 leader_election.cc:302] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 383deb0a3901488480a2fce986ba5783; no voters:
I20260809 19:10:09.058218 21575 leader_election.cc:288] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 19:10:09.058372 21580 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 19:10:09.059593 21580 raft_consensus.cc:686] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783 [term 2 LEADER]: Becoming Leader. State: Replica: 383deb0a3901488480a2fce986ba5783, State: Running, Role: LEADER
I20260809 19:10:09.060212 21580 consensus_queue.cc:237] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "383deb0a3901488480a2fce986ba5783" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34587 } }
I20260809 19:10:09.060447 21575 sys_catalog.cc:564] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:10:09.062636 21584 sys_catalog.cc:455] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 383deb0a3901488480a2fce986ba5783. Latest consensus state: current_term: 2 leader_uuid: "383deb0a3901488480a2fce986ba5783" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "383deb0a3901488480a2fce986ba5783" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34587 } } }
I20260809 19:10:09.063015 21584 sys_catalog.cc:458] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783 [sys.catalog]: This master's current role is: LEADER
I20260809 19:10:09.063566 21581 sys_catalog.cc:455] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "383deb0a3901488480a2fce986ba5783" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "383deb0a3901488480a2fce986ba5783" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34587 } } }
I20260809 19:10:09.063880 21581 sys_catalog.cc:458] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783 [sys.catalog]: This master's current role is: LEADER
I20260809 19:10:09.071388 21596 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:10:09.076942 21596 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:10:09.078325 21596 catalog_manager.cc:1259] Loaded cluster ID: 198d47e1812e47788e1bc9c792d77440
I20260809 19:10:09.078470 21596 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:10:09.082269 21596 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:10:09.083767 21596 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 383deb0a3901488480a2fce986ba5783: Loaded TSK: 0
I20260809 19:10:09.085315 21596 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 19:10:09.336912 21578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:10:09.337162 21578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:10:09.337278 21578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:10:09.344554 21578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:10:09.344652 21578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:10:09.344785 21578 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.1
I20260809 19:10:09.354151 21578 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:33353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.1.keytab
--principal=oryx/127.7.39.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.1:45717
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.39.1
--webserver_port=38587
--tserver_master_addrs=127.7.39.62:34587
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.1
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:10:09.355415 21578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:10:09.356705 21578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:10:09.369047 21618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:09.369114 21619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:09.369899 21622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:10:09.370514 21578 server_base.cc:1034] running on GCE node
I20260809 19:10:09.371236 21578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:10:09.372274 21578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:10:09.373507 21578 hybrid_clock.cc:648] HybridClock initialized: now 1786302609373437 us; error 46 us; skew 500 ppm
I20260809 19:10:09.373838 21578 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:10:09 dist-test-slave-4tdj krb5kdc[20664](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302609, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:10:09.377370 21578 init.cc:377] Logged in from keytab as oryx/127.7.39.1@KRBTEST.COM (short username oryx)
I20260809 19:10:09.378980 21578 webserver.cc:460] Webserver started at http://127.7.39.1:38587/ using document root <none> and password file <none>
I20260809 19:10:09.379776 21578 fs_manager.cc:359] Metadata directory not provided
I20260809 19:10:09.379911 21578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:10:09.386400 21578 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 19:10:09.389581 21630 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:09.391105 21578 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:10:09.391256 21578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-0/wal
uuid: "0467f74dd73d4516a1139c8f48d6a117"
format_stamp: "Formatted at 2026-08-09 19:10:06 on dist-test-slave-4tdj"
server_key: "f53c4745091bbd032636d5659dc59d6e"
server_key_iv: "9148129d583301c7cda7f213a4d06708"
server_key_version: "encryptionkey@0"
I20260809 19:10:09.392575 21578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:10:09.430238 21578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:10:09.433885 21578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:10:09.434105 21578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:10:09.435009 21578 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:10:09.436246 21578 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:10:09.436334 21578 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:09.436409 21578 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:10:09.436466 21578 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:09.465720 21578 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.1:45717
I20260809 19:10:09.465782 21805 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.1:45717 every 8 connection(s)
I20260809 19:10:09.467070 21578 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
I20260809 19:10:09.468407 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 21578
I20260809 19:10:09.469017 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.2:45175
--local_ip_for_outbound_sockets=127.7.39.2
--tserver_master_addrs=127.7.39.62:34587
--webserver_port=45815
--webserver_interface=127.7.39.2
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:33353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.7.39.2
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.2.keytab with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 19:10:09 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:09 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
W20260809 19:10:09.486100 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:09.470090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:55333 (local address 127.7.39.62:34587)
0809 19:10:09.470835 (+ 745us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:09.470850 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:09.471329 (+ 479us) server_negotiation.cc:407] Connection header received
0809 19:10:09.473418 (+ 2089us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:09.473431 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:09.473755 (+ 324us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:09.474087 (+ 332us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:09.475622 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:09.476844 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:09.479063 (+ 2219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:09.479713 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:09.479853 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:09.485297 (+ 5444us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.1:55333: BlockingRecv error: recv got EOF from 127.7.39.1:55333 (error 108)
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":255,"threads_started":1}
I20260809 19:10:09.486122 21809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:09.470326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.1:55333)
0809 19:10:09.471138 (+ 812us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:09.471183 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:09.472887 (+ 1704us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:09.474260 (+ 1373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:09.474272 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:09.474892 (+ 620us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:09.475426 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:09.475443 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:09.477004 (+ 1561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:09.477008 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:09.478924 (+ 1916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:09.478938 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:09.479939 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:09.479946 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:09.480208 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:09.480864 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:09.480890 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:09.484986 (+ 4096us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":553,"thread_start_us":343,"threads_started":1}
W20260809 19:10:09.487001 21806 heartbeater.cc:644] Failed to heartbeat to 127.7.39.62:34587 (0 consecutive failures): Not authorized: Failed to ping master at 127.7.39.62:34587: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Aug 09 19:10:09 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:09 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:09.495299 21809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:09.487533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.1:49455)
0809 19:10:09.487691 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:09.487710 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:09.487799 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:09.488211 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:09.488214 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:09.488489 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:09.488622 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:09.488629 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:09.489957 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:09.489961 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:09.490861 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:09.490872 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:09.491713 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:09.491717 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:09.491835 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:09.492321 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:09.492337 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:09.495012 (+ 2675us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 19:10:09.495410 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:09.487691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:49455 (local address 127.7.39.62:34587)
0809 19:10:09.487858 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:09.487863 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:09.487881 (+ 18us) server_negotiation.cc:407] Connection header received
0809 19:10:09.487959 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:09.487964 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:09.488043 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:09.488169 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:09.488756 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:09.489825 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:09.490989 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:09.491591 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:09.491723 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:09.495246 (+ 3523us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.1:49455: BlockingRecv error: recv got EOF from 127.7.39.1:49455 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 09 19:10:09 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:09 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:09.502924 21809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:09.495914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.1:33993)
0809 19:10:09.496075 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:09.496094 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:09.496185 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:09.496469 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:09.496474 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:09.496751 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:09.496878 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:09.496886 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:09.497839 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:09.497843 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:09.498848 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:09.498860 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:09.499532 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:09.499538 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:09.499687 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:09.500174 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:09.500189 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:09.502656 (+ 2467us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 19:10:09.502976 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:09.495973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:33993 (local address 127.7.39.62:34587)
0809 19:10:09.496120 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:09.496125 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:09.496142 (+ 17us) server_negotiation.cc:407] Connection header received
0809 19:10:09.496283 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:09.496289 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:09.496359 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:09.496435 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:09.497011 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:09.497706 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:09.498975 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:09.499400 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:09.499504 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:09.502805 (+ 3301us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.1:33993: BlockingRecv error: recv got EOF from 127.7.39.1:33993 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260809 19:10:09.503206 21806 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 19:10:09.788759 21810 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:10:09.789001 21810 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:10:09.789131 21810 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:10:09.796007 21810 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:10:09.796103 21810 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:10:09.796253 21810 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.2
I20260809 19:10:09.805588 21810 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:33353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.2.keytab
--principal=oryx/127.7.39.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.2:45175
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.39.2
--webserver_port=45815
--tserver_master_addrs=127.7.39.62:34587
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.2
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:10:09.806782 21810 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:10:09.808012 21810 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:10:09.820075 21826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:09.820009 21821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:09.820039 21822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:10:09.820940 21810 server_base.cc:1034] running on GCE node
I20260809 19:10:09.821528 21810 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:10:09.822428 21810 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:10:09.823668 21810 hybrid_clock.cc:648] HybridClock initialized: now 1786302609823608 us; error 45 us; skew 500 ppm
I20260809 19:10:09.823979 21810 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:10:09 dist-test-slave-4tdj krb5kdc[20664](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302609, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:10:09.826922 21810 init.cc:377] Logged in from keytab as oryx/127.7.39.2@KRBTEST.COM (short username oryx)
I20260809 19:10:09.828203 21810 webserver.cc:460] Webserver started at http://127.7.39.2:45815/ using document root <none> and password file <none>
I20260809 19:10:09.828830 21810 fs_manager.cc:359] Metadata directory not provided
I20260809 19:10:09.828954 21810 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:10:09.834071 21810 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.002s
I20260809 19:10:09.836587 21834 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:09.837777 21810 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 19:10:09.837916 21810 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-1/wal
uuid: "a1101b892066428bb81d992e4071b8e0"
format_stamp: "Formatted at 2026-08-09 19:10:07 on dist-test-slave-4tdj"
server_key: "8a3f1bceb6086315430eaed8c82a10a9"
server_key_iv: "46cd14bed3d7d9b26429c6df9fe4aa9d"
server_key_version: "encryptionkey@0"
I20260809 19:10:09.838872 21810 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:10:09.853019 21810 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:10:09.856515 21810 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:10:09.856753 21810 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:10:09.857606 21810 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:10:09.858834 21810 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:10:09.858925 21810 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:09.859025 21810 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:10:09.859097 21810 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:09.888399 21810 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.2:45175
I20260809 19:10:09.888463 21991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.2:45175 every 8 connection(s)
I20260809 19:10:09.889799 21810 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
I20260809 19:10:09.895249 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 21810
I20260809 19:10:09.895967 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.3:38455
--local_ip_for_outbound_sockets=127.7.39.3
--tserver_master_addrs=127.7.39.62:34587
--webserver_port=34889
--webserver_interface=127.7.39.3
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:33353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.7.39.3
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.3.keytab with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 19:10:09 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:09 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
W20260809 19:10:09.906222 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:09.892217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:54133 (local address 127.7.39.62:34587)
0809 19:10:09.892383 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:09.892387 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:09.893497 (+ 1110us) server_negotiation.cc:407] Connection header received
0809 19:10:09.895463 (+ 1966us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:09.895468 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:09.895547 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:09.895625 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:09.897611 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:09.898406 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:09.900406 (+ 2000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:09.900815 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:09.900912 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:09.906035 (+ 5123us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.2:54133: BlockingRecv error: recv got EOF from 127.7.39.2:54133 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 19:10:09.907112 21994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:09.892649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.2:54133)
0809 19:10:09.893333 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:09.893374 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:09.895138 (+ 1764us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:09.895898 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:09.895909 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:09.896607 (+ 698us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:09.897425 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:09.897452 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:09.898588 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:09.898593 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:09.900260 (+ 1667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:09.900274 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:09.901029 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:09.901036 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:09.901295 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:09.901942 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:09.901969 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:09.905867 (+ 3898us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":272,"threads_started":1}
W20260809 19:10:09.907754 21992 heartbeater.cc:644] Failed to heartbeat to 127.7.39.62:34587 (0 consecutive failures): Not authorized: Failed to ping master at 127.7.39.62:34587: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Aug 09 19:10:09 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:09 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:09.916275 21994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:09.908293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.2:53903)
0809 19:10:09.908458 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:09.908478 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:09.908594 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:09.908869 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:09.908873 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:09.909217 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:09.909374 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:09.909383 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:09.910345 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:09.910351 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:09.911654 (+ 1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:09.911672 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:09.912334 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:09.912339 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:09.912495 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:09.913037 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:09.913058 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:09.916010 (+ 2952us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":55}
W20260809 19:10:09.916404 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:09.908479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:53903 (local address 127.7.39.62:34587)
0809 19:10:09.908627 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:09.908631 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:09.908648 (+ 17us) server_negotiation.cc:407] Connection header received
0809 19:10:09.908691 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:09.908695 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:09.908749 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:09.908824 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:09.909495 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:09.910179 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:09.911773 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:09.912200 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:09.912302 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:09.916210 (+ 3908us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.2:53903: BlockingRecv error: recv got EOF from 127.7.39.2:53903 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 09 19:10:09 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:09 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:09.924029 21994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:09.917119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.2:33073)
0809 19:10:09.917289 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:09.917308 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:09.917406 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:09.917687 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:09.917691 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:09.917976 (+ 285us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:09.918119 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:09.918126 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:09.919081 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:09.919086 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:09.919968 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:09.919979 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:09.920607 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:09.920612 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:09.920766 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:09.921261 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:09.921278 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:09.923760 (+ 2482us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":53}
W20260809 19:10:09.924170 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:09.917202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:33073 (local address 127.7.39.62:34587)
0809 19:10:09.917359 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:09.917364 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:09.917381 (+ 17us) server_negotiation.cc:407] Connection header received
0809 19:10:09.917510 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:09.917515 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:09.917572 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:09.917652 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:09.918249 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:09.918953 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:09.920104 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:09.920467 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:09.920572 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:09.923967 (+ 3395us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.2:33073: BlockingRecv error: recv got EOF from 127.7.39.2:33073 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260809 19:10:09.924456 21992 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 19:10:10.223443 21995 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:10:10.223690 21995 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:10:10.223789 21995 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:10:10.230698 21995 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:10:10.230793 21995 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:10:10.230943 21995 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.3
I20260809 19:10:10.240211 21995 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:33353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/krb5kdc/oryx_127.7.39.3.keytab
--principal=oryx/127.7.39.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.3:38455
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.39.3
--webserver_port=34889
--tserver_master_addrs=127.7.39.62:34587
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.3
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:10:10.241586 21995 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:10:10.242895 21995 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:10:10.254951 22002 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:10.255019 22003 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:10.255203 22006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:10:10.255820 21995 server_base.cc:1034] running on GCE node
I20260809 19:10:10.256394 21995 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:10:10.257257 21995 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:10:10.258445 21995 hybrid_clock.cc:648] HybridClock initialized: now 1786302610258392 us; error 46 us; skew 500 ppm
I20260809 19:10:10.258731 21995 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:10:10 dist-test-slave-4tdj krb5kdc[20664](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302610, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.39.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:10:10.261696 21995 init.cc:377] Logged in from keytab as oryx/127.7.39.3@KRBTEST.COM (short username oryx)
I20260809 19:10:10.263022 21995 webserver.cc:460] Webserver started at http://127.7.39.3:34889/ using document root <none> and password file <none>
I20260809 19:10:10.263660 21995 fs_manager.cc:359] Metadata directory not provided
I20260809 19:10:10.263788 21995 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:10:10.268784 21995 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 19:10:10.271327 22018 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:10.272608 21995 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:10:10.272746 21995 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-2/wal
uuid: "792b5a4187ac471a8cde4b7a343c150d"
format_stamp: "Formatted at 2026-08-09 19:10:07 on dist-test-slave-4tdj"
server_key: "c8088dc40081d7efe8e630cb143d884d"
server_key_iv: "c17cb601d5163e898265d320660ee4bb"
server_key_version: "encryptionkey@0"
I20260809 19:10:10.273630 21995 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:10:10.284566 21995 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:10:10.288045 21995 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:10:10.288276 21995 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:10:10.289129 21995 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:10:10.290386 21995 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:10:10.290486 21995 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:10.290592 21995 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:10:10.290665 21995 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:10.319149 21995 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.3:38455
I20260809 19:10:10.319212 22180 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.3:38455 every 8 connection(s)
I20260809 19:10:10.320538 21995 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
I20260809 19:10:10.322412 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 21995
Aug 09 19:10:10 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:10 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
W20260809 19:10:10.336293 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:10.323117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:36757 (local address 127.7.39.62:34587)
0809 19:10:10.323344 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:10.323350 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:10.324538 (+ 1188us) server_negotiation.cc:407] Connection header received
0809 19:10:10.326326 (+ 1788us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:10.326332 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:10.326427 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:10.326558 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:10.327933 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:10.328881 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:10.330651 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:10.331182 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:10.331274 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:10.336035 (+ 4761us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.3:36757: BlockingRecv error: recv got EOF from 127.7.39.3:36757 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 19:10:10.336786 22184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:10.323605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.3:36757)
0809 19:10:10.324391 (+ 786us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:10.324433 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:10.326046 (+ 1613us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:10.326743 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:10.326751 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:10.327247 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:10.327767 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:10.327784 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:10.329030 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:10.329036 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:10.330518 (+ 1482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:10.330531 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:10.331394 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:10.331402 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:10.331661 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:10.332290 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:10.332310 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:10.335769 (+ 3459us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":549,"thread_start_us":346,"threads_started":1}
W20260809 19:10:10.337483 22181 heartbeater.cc:644] Failed to heartbeat to 127.7.39.62:34587 (0 consecutive failures): Not authorized: Failed to ping master at 127.7.39.62:34587: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
I20260809 19:10:10.340236 22186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:10.323856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48310 (local address 127.7.39.62:34587)
0809 19:10:10.326686 (+ 2830us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:10.326692 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:10.326705 (+ 13us) server_negotiation.cc:407] Connection header received
0809 19:10:10.326742 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:10.326745 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:10.326787 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:10.326873 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:10.328491 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:10.329582 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:10.330878 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:10.331334 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:10.331454 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:10.333807 (+ 2353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:10.333815 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:10.333829 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:10:10.333863 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:10.336962 (+ 3099us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:10.337716 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:10.337723 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:10.337729 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:10.337938 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:10.338349 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:10.338355 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:10.338358 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:10.338947 (+ 589us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:10.339253 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:10.339563 (+ 310us) server_negotiation.cc:299] Negotiation successful
0809 19:10:10.339855 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2720,"thread_start_us":2604,"threads_started":1}
Aug 09 19:10:10 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:10 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:10.345386 22184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:10.338049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.3:41425)
0809 19:10:10.338190 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:10.338207 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:10.338284 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:10.338546 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:10.338550 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:10.338956 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:10.339120 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:10.339132 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:10.340384 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:10.340390 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:10.341303 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:10.341315 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:10.341979 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:10.341985 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:10.342152 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:10.342634 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:10.342650 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:10.345133 (+ 2483us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 19:10:10.345742 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:10.338121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:41425 (local address 127.7.39.62:34587)
0809 19:10:10.338275 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:10.338280 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:10.338326 (+ 46us) server_negotiation.cc:407] Connection header received
0809 19:10:10.338378 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:10.338381 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:10.338430 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:10.338497 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:10.339276 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:10.340253 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:10.341435 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:10.341847 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:10.341950 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:10.345322 (+ 3372us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.3:41425: BlockingRecv error: recv got EOF from 127.7.39.3:41425 (error 108)
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":54}
Aug 09 19:10:10 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:10 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:10.352604 22184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:10.345942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.3:35921)
0809 19:10:10.346078 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:10.346103 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:10.346175 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:10.346640 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:10.346645 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:10.346913 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:10.347039 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:10.347047 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:10.347959 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:10.347963 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:10.348818 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:10.348829 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:10.349444 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:10.349450 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:10.349596 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:10.350040 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:10.350056 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:10.352351 (+ 2295us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 19:10:10.352770 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:10.346195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:35921 (local address 127.7.39.62:34587)
0809 19:10:10.346426 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:10.346430 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:10.346443 (+ 13us) server_negotiation.cc:407] Connection header received
0809 19:10:10.346476 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:10.346479 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:10.346524 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:10.346616 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:10.347163 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:10.347838 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:10.348941 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:10.349320 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:10.349421 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:10.352540 (+ 3119us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.3:35921: BlockingRecv error: recv got EOF from 127.7.39.3:35921 (error 108)
Metrics: {"server-negotiator.queue_time_us":144}
W20260809 19:10:10.352897 22181 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 09 19:10:10 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:10 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:10.511782 22187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:10.503728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.1:49309)
0809 19:10:10.504213 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:10.504229 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:10.504355 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:10.504684 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:10.504688 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:10.505293 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:10.505541 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:10.505553 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:10.506577 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:10.506583 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:10.507522 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:10.507535 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:10.508255 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:10.508262 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:10.508431 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:10.508932 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:10.508949 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:10.511559 (+ 2610us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":229,"threads_started":1}
W20260809 19:10:10.511910 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:10.503950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:49309 (local address 127.7.39.62:34587)
0809 19:10:10.504158 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:10.504164 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:10.504297 (+ 133us) server_negotiation.cc:407] Connection header received
0809 19:10:10.504462 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:10.504466 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:10.504547 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:10.504631 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:10.505676 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:10.506435 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:10.507659 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:10.508087 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:10.508195 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:10.511739 (+ 3544us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.1:49309: BlockingRecv error: recv got EOF from 127.7.39.1:49309 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 09 19:10:10 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:10 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:10.932747 22189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:10.925005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.2:56803)
0809 19:10:10.925563 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:10.925584 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:10.925705 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:10.925974 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:10.925977 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:10.926465 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:10.926690 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:10.926700 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:10.927602 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:10.927605 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:10.928549 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:10.928561 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:10.929191 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:10.929195 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:10.929308 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:10.929822 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:10.929839 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:10.932522 (+ 2683us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":261,"threads_started":1}
W20260809 19:10:10.932900 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:10.925067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:56803 (local address 127.7.39.62:34587)
0809 19:10:10.925325 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:10.925332 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:10.925662 (+ 330us) server_negotiation.cc:407] Connection header received
0809 19:10:10.925792 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:10.925795 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:10.925859 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:10.925934 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:10.926803 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:10.927490 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:10.928662 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:10.929064 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:10.929149 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:10.932698 (+ 3549us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.2:56803: BlockingRecv error: recv got EOF from 127.7.39.2:56803 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 09 19:10:11 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:11 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:11.361145 22190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:11.353461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.3:54323)
0809 19:10:11.353955 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:11.353971 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:11.354085 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:11.354433 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:11.354436 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:11.354868 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:11.355062 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:11.355072 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:11.356005 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:11.356008 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:11.356923 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:11.356935 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:11.357622 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:11.357627 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:11.357750 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:11.358324 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:11.358348 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:11.360920 (+ 2572us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":238,"threads_started":1}
W20260809 19:10:11.361306 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:11.353517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:54323 (local address 127.7.39.62:34587)
0809 19:10:11.353728 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:11.353734 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:11.354050 (+ 316us) server_negotiation.cc:407] Connection header received
0809 19:10:11.354201 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:11.354206 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:11.354309 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:11.354404 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:11.355167 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:11.355894 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:11.357048 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:11.357460 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:11.357559 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:11.361102 (+ 3543us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.3:54323: BlockingRecv error: recv got EOF from 127.7.39.3:54323 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 09 19:10:11 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:11 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:11.520726 22191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:11.512703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.1:39981)
0809 19:10:11.513206 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:11.513222 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:11.513364 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:11.513716 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:11.513721 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:11.514144 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:11.514330 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:11.514353 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:11.515549 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:11.515554 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:11.516440 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:11.516452 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:11.517130 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:11.517136 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:11.517287 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:11.517783 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:11.517800 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:11.520405 (+ 2605us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":278,"threads_started":1}
W20260809 19:10:11.520861 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:11.512758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:39981 (local address 127.7.39.62:34587)
0809 19:10:11.512951 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:11.512958 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:11.513308 (+ 350us) server_negotiation.cc:407] Connection header received
0809 19:10:11.513483 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:11.513489 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:11.513578 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:11.513662 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:11.514475 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:11.515416 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:11.516585 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:11.516978 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:11.517096 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:11.520618 (+ 3522us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.1:39981: BlockingRecv error: recv got EOF from 127.7.39.1:39981 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 09 19:10:11 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:11 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:11.945403 22193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:11.933560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.2:35453)
0809 19:10:11.934151 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:11.934168 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:11.934281 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:11.934623 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:11.934626 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:11.934997 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:11.935141 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:11.935149 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:11.936164 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:11.936169 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:11.937091 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:11.937104 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:11.937770 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:11.937774 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:11.937886 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:11.942209 (+ 4323us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:11.942233 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:11.945145 (+ 2912us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":360,"threads_started":1}
W20260809 19:10:11.945524 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:11.933712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:35453 (local address 127.7.39.62:34587)
0809 19:10:11.933912 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:11.933916 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:11.934255 (+ 339us) server_negotiation.cc:407] Connection header received
0809 19:10:11.934400 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:11.934404 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:11.934479 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:11.934574 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:11.935263 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:11.936024 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:11.937235 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:11.937650 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:11.937747 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:11.945336 (+ 7589us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.2:35453: BlockingRecv error: recv got EOF from 127.7.39.2:35453 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 09 19:10:12 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:12 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:12.369706 22194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:12.362056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.3:34449)
0809 19:10:12.362564 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:12.362581 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:12.362694 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:12.362956 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:12.362959 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:12.363371 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:12.363531 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:12.363558 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:12.364521 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:12.364524 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:12.365458 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:12.365471 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:12.366120 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:12.366125 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:12.366236 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:12.366789 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:12.366806 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:12.369385 (+ 2579us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":278,"threads_started":1}
W20260809 19:10:12.369889 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:12.362204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:34449 (local address 127.7.39.62:34587)
0809 19:10:12.362383 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:12.362388 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:12.362644 (+ 256us) server_negotiation.cc:407] Connection header received
0809 19:10:12.362786 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:12.362789 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:12.362849 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:12.362928 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:12.363661 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:12.364410 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:12.365571 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:12.365988 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:12.366080 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:12.369592 (+ 3512us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.3:34449: BlockingRecv error: recv got EOF from 127.7.39.3:34449 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 09 19:10:12 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:12 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:12.529057 22195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:12.521639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.1:50369)
0809 19:10:12.522160 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:12.522177 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:12.522314 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:12.522614 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:12.522617 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:12.522950 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:12.523135 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:12.523144 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:12.524084 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:12.524087 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:12.524942 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:12.524952 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:12.525545 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:12.525550 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:12.525674 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:12.526193 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:12.526210 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:12.528778 (+ 2568us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":242,"threads_started":1}
W20260809 19:10:12.529161 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:12.521754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:50369 (local address 127.7.39.62:34587)
0809 19:10:12.521932 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:12.521938 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:12.522255 (+ 317us) server_negotiation.cc:407] Connection header received
0809 19:10:12.522417 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:12.522421 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:12.522501 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:12.522579 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:12.523253 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:12.523971 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:12.525055 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:12.525433 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:12.525528 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:12.528970 (+ 3442us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.1:50369: BlockingRecv error: recv got EOF from 127.7.39.1:50369 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 09 19:10:12 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:12 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:12.954135 22196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:12.946214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.2:57771)
0809 19:10:12.946738 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:12.946755 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:12.946867 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:12.947129 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:12.947132 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:12.947457 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:12.947653 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:12.947662 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:12.948593 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:12.948596 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:12.949485 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:12.949497 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:12.950369 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:12.950375 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:12.950559 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:12.951215 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:12.951232 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:12.953877 (+ 2645us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":275,"threads_started":1}
W20260809 19:10:12.954282 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:12.946286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:57771 (local address 127.7.39.62:34587)
0809 19:10:12.946478 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:12.946485 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:12.946832 (+ 347us) server_negotiation.cc:407] Connection header received
0809 19:10:12.946953 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:12.946956 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:12.947018 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:12.947096 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:12.947760 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:12.948479 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:12.949649 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:12.950208 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:12.950343 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:12.954082 (+ 3739us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.2:57771: BlockingRecv error: recv got EOF from 127.7.39.2:57771 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 09 19:10:13 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:13 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:13.378876 22197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:13.370800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.3:59467)
0809 19:10:13.371361 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:13.371380 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:13.371542 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:13.371898 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:13.371903 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:13.372266 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:13.372471 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:13.372485 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:13.373461 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:13.373467 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:13.374439 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:13.374452 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:13.375113 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:13.375119 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:13.375291 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:13.375820 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:13.375837 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:13.378631 (+ 2794us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":272,"threads_started":1}
W20260809 19:10:13.379029 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:13.370854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:59467 (local address 127.7.39.62:34587)
0809 19:10:13.371069 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:13.371075 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:13.371514 (+ 439us) server_negotiation.cc:407] Connection header received
0809 19:10:13.371687 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:13.371691 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:13.371756 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:13.371850 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:13.372613 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:13.373332 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:13.374571 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:13.374974 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:13.375086 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:13.378812 (+ 3726us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.3:59467: BlockingRecv error: recv got EOF from 127.7.39.3:59467 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 09 19:10:13 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:13 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:13.538173 22199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:13.530057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.1:49377)
0809 19:10:13.530656 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:13.530672 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:13.530784 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:13.531054 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:13.531056 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:13.531414 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:13.531589 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:13.531598 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:13.532824 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:13.532828 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:13.533830 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:13.533843 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:13.534518 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:13.534521 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:13.534660 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:13.535260 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:13.535285 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:13.537930 (+ 2645us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":374,"threads_started":1}
W20260809 19:10:13.538347 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:13.530118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:49377 (local address 127.7.39.62:34587)
0809 19:10:13.530367 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:13.530373 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:13.530749 (+ 376us) server_negotiation.cc:407] Connection header received
0809 19:10:13.530869 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:13.530872 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:13.530934 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:13.531017 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:13.531725 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:13.532696 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:13.533958 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:13.534413 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:13.534511 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:13.538123 (+ 3612us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.1:49377: BlockingRecv error: recv got EOF from 127.7.39.1:49377 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 09 19:10:13 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:13 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:13.963757 22201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:13.955000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.2:42493)
0809 19:10:13.955469 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:13.955488 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:13.955603 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:13.955911 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:13.955914 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:13.956286 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:13.956435 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:13.956443 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:13.957911 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:13.957916 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:13.958929 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:13.958943 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:13.959858 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:13.959862 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:13.959995 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:13.960601 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:13.960618 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:13.963530 (+ 2912us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":244,"threads_started":1}
W20260809 19:10:13.964057 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:13.955103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:42493 (local address 127.7.39.62:34587)
0809 19:10:13.955292 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:13.955299 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:13.955565 (+ 266us) server_negotiation.cc:407] Connection header received
0809 19:10:13.955703 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:13.955708 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:13.955793 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:13.955898 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:13.956562 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:13.957757 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:13.959067 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:13.959733 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:13.959863 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:13.963787 (+ 3924us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.2:42493: BlockingRecv error: recv got EOF from 127.7.39.2:42493 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 09 19:10:14 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:14 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:14.387595 22203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:14.379640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.3:36869)
0809 19:10:14.380072 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:14.380088 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:14.380200 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:14.380461 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:14.380464 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:14.380820 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:14.380978 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:14.380986 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:14.382279 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:14.382285 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:14.383477 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:14.383491 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:14.384107 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:14.384111 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:14.384230 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:14.384757 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:14.384773 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:14.387358 (+ 2585us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":214,"threads_started":1}
W20260809 19:10:14.387779 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:14.379709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:36869 (local address 127.7.39.62:34587)
0809 19:10:14.379928 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:14.379934 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:14.380157 (+ 223us) server_negotiation.cc:407] Connection header received
0809 19:10:14.380286 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:14.380289 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:14.380353 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:14.380430 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:14.381135 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:14.382148 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:14.383606 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:14.383998 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:14.384093 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:14.387566 (+ 3473us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.3:36869: BlockingRecv error: recv got EOF from 127.7.39.3:36869 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 09 19:10:14 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:14 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:14.547202 22204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:14.539041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.1:34121)
0809 19:10:14.539584 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:14.539600 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:14.539721 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:14.540047 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:14.540051 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:14.540538 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:14.540718 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:14.540728 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:14.541703 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:14.541709 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:14.542674 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:14.542686 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:14.543493 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:14.543498 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:14.543683 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:14.544300 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:14.544318 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:14.546882 (+ 2564us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":255,"threads_started":1}
W20260809 19:10:14.547295 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:14.539129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:34121 (local address 127.7.39.62:34587)
0809 19:10:14.539364 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:14.539371 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:14.539683 (+ 312us) server_negotiation.cc:407] Connection header received
0809 19:10:14.539843 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:14.539848 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:14.539916 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:14.539994 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:14.540871 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:14.541569 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:14.542813 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:14.543327 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:14.543445 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:14.547112 (+ 3667us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.1:34121: BlockingRecv error: recv got EOF from 127.7.39.1:34121 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 09 19:10:14 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:14 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:14.973116 22205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:14.964639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.2:59819)
0809 19:10:14.965195 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:14.965223 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:14.965336 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:14.965613 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:14.965616 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:14.966012 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:14.966188 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:14.966196 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:14.967289 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:14.967293 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:14.968233 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:14.968245 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:14.968943 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:14.968948 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:14.969100 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:14.969707 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:14.969725 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:14.972813 (+ 3088us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":279,"threads_started":1}
W20260809 19:10:14.973320 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:14.964813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:59819 (local address 127.7.39.62:34587)
0809 19:10:14.964967 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:14.964971 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:14.965303 (+ 332us) server_negotiation.cc:407] Connection header received
0809 19:10:14.965427 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:14.965431 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:14.965494 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:14.965580 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:14.966367 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:14.967150 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:14.968360 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:14.968795 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:14.968887 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:14.973021 (+ 4134us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.2:59819: BlockingRecv error: recv got EOF from 127.7.39.2:59819 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 09 19:10:15 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:15 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:15.396334 22206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:15.388427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.3:35063)
0809 19:10:15.388919 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:15.388934 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:15.389074 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:15.389400 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:15.389405 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:15.389880 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:15.390068 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:15.390079 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:15.391373 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:15.391377 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:15.392276 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:15.392288 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:15.392884 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:15.392888 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:15.392998 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:15.393509 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:15.393526 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:15.396106 (+ 2580us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":254,"threads_started":1}
W20260809 19:10:15.396490 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:15.388516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:35063 (local address 127.7.39.62:34587)
0809 19:10:15.388714 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:15.388720 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:15.389020 (+ 300us) server_negotiation.cc:407] Connection header received
0809 19:10:15.389201 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:15.389205 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:15.389268 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:15.389345 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:15.390213 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:15.391242 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:15.392381 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:15.392782 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:15.392870 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:15.396273 (+ 3403us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.3:35063: BlockingRecv error: recv got EOF from 127.7.39.3:35063 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 09 19:10:15 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:15 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:15.555810 22208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:15.548020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.1:39799)
0809 19:10:15.548458 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:15.548474 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:15.548677 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:15.549027 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:15.549030 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:15.549398 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:15.549569 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:15.549578 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:15.550601 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:15.550605 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:15.551528 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:15.551554 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:15.552378 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:15.552385 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:15.552522 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:15.553123 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:15.553141 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:15.555611 (+ 2470us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":240,"threads_started":1}
W20260809 19:10:15.556006 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:15.548078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:39799 (local address 127.7.39.62:34587)
0809 19:10:15.548296 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:15.548302 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:15.548565 (+ 263us) server_negotiation.cc:407] Connection header received
0809 19:10:15.548838 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:15.548844 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:15.548912 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:15.548997 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:15.549703 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:15.550477 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:15.551707 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:15.552221 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:15.552321 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:15.555781 (+ 3460us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.1:39799: BlockingRecv error: recv got EOF from 127.7.39.1:39799 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 09 19:10:15 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:15 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:15.982376 22209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:15.974144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.2:40139)
0809 19:10:15.974738 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:15.974754 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:15.974871 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:15.975199 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:15.975203 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:15.975605 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:15.975754 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:15.975763 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:15.976786 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:15.976791 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:15.977737 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:15.977749 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:15.978614 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:15.978620 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:15.978788 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:15.979370 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:15.979389 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:15.982122 (+ 2733us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":367,"threads_started":1}
W20260809 19:10:15.982596 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:15.974332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:40139 (local address 127.7.39.62:34587)
0809 19:10:15.974508 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:15.974514 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:15.974851 (+ 337us) server_negotiation.cc:407] Connection header received
0809 19:10:15.974975 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:15.974979 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:15.975056 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:15.975138 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:15.975887 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:15.976653 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:15.977882 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:15.978437 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:15.978536 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:15.982357 (+ 3821us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.2:40139: BlockingRecv error: recv got EOF from 127.7.39.2:40139 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 09 19:10:16 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:16 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:16.404898 22211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:16.397267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.3:50107)
0809 19:10:16.397807 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:16.397823 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:16.397940 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:16.398219 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:16.398222 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:16.398640 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:16.398794 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:16.398804 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:16.399748 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:16.399752 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:16.400663 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:16.400675 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:16.401324 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:16.401329 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:16.401451 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:16.401992 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:16.402010 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:16.404682 (+ 2672us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":280,"threads_started":1}
W20260809 19:10:16.405221 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:16.397334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:50107 (local address 127.7.39.62:34587)
0809 19:10:16.397491 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:16.397497 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:16.397897 (+ 400us) server_negotiation.cc:407] Connection header received
0809 19:10:16.398035 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:16.398045 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:16.398109 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:16.398185 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:16.398914 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:16.399649 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:16.400771 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:16.401189 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:16.401278 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:16.404929 (+ 3651us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.3:50107: BlockingRecv error: recv got EOF from 127.7.39.3:50107 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 09 19:10:16 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:16 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:16.564771 22214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:16.556609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.1:53445)
0809 19:10:16.557191 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:16.557209 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:16.557316 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:16.557638 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:16.557641 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:16.558183 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:16.558429 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:16.558441 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:16.559486 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:16.559490 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:16.560386 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:16.560398 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:16.561059 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:16.561064 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:16.561166 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:16.561793 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:16.561817 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:16.564549 (+ 2732us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":264,"threads_started":1}
W20260809 19:10:16.565001 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:16.556684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:53445 (local address 127.7.39.62:34587)
0809 19:10:16.556855 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:16.556859 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:16.557279 (+ 420us) server_negotiation.cc:407] Connection header received
0809 19:10:16.557421 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:16.557426 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:16.557498 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:16.557623 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:16.558583 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:16.559362 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:16.560490 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:16.560937 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:16.561028 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:16.564720 (+ 3692us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.1:53445: BlockingRecv error: recv got EOF from 127.7.39.1:53445 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 09 19:10:16 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:16 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:16.996243 22215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:16.983262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.2:49539)
0809 19:10:16.983897 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:16.983914 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:16.984039 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:16.984367 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:16.984370 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:16.984870 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:16.985064 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:16.985078 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:16.986378 (+ 1300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:16.986383 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:16.987314 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:16.987326 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:16.987962 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:16.987966 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:16.988078 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:16.993294 (+ 5216us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:16.993313 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:16.995994 (+ 2681us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":279,"threads_started":1}
W20260809 19:10:16.996591 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:16.983349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:49539 (local address 127.7.39.62:34587)
0809 19:10:16.983576 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:16.983581 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:16.983977 (+ 396us) server_negotiation.cc:407] Connection header received
0809 19:10:16.984173 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:16.984178 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:16.984250 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:16.984334 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:16.985248 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:16.986238 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:16.987425 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:16.987847 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:16.987935 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:16.996186 (+ 8251us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.2:49539: BlockingRecv error: recv got EOF from 127.7.39.2:49539 (error 108)
Metrics: {"server-negotiator.queue_time_us":106}
Aug 09 19:10:17 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:17 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:17.413553 22216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:17.405792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.3:34637)
0809 19:10:17.406443 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:17.406460 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:17.406574 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:17.406861 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:17.406864 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:17.407269 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:17.407454 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:17.407464 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:17.408399 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:17.408403 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:17.409294 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:17.409307 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:17.409911 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:17.409914 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:17.410035 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:17.410643 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:17.410661 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:17.413324 (+ 2663us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":274,"threads_started":1}
W20260809 19:10:17.413710 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:17.405864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:34637 (local address 127.7.39.62:34587)
0809 19:10:17.406015 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:17.406020 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:17.406527 (+ 507us) server_negotiation.cc:407] Connection header received
0809 19:10:17.406684 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:17.406687 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:17.406749 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:17.406826 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:17.407579 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:17.408297 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:17.409397 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:17.409799 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:17.409885 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:17.413515 (+ 3630us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.3:34637: BlockingRecv error: recv got EOF from 127.7.39.3:34637 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 09 19:10:17 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:17 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:17.573597 22217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:17.565639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.1:60467)
0809 19:10:17.566150 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:17.566168 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:17.566319 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:17.566651 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:17.566656 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:17.567097 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:17.567250 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:17.567259 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:17.568266 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:17.568271 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:17.569182 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:17.569194 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:17.569959 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:17.569965 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:17.570125 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:17.570647 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:17.570664 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:17.573295 (+ 2631us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":255,"threads_started":1}
W20260809 19:10:17.573772 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:17.565796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:60467 (local address 127.7.39.62:34587)
0809 19:10:17.566003 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:17.566008 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:17.566248 (+ 240us) server_negotiation.cc:407] Connection header received
0809 19:10:17.566433 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:17.566439 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:17.566508 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:17.566597 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:17.567394 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:17.568120 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:17.569324 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:17.569779 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:17.569886 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:17.573508 (+ 3622us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.1:60467: BlockingRecv error: recv got EOF from 127.7.39.1:60467 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 09 19:10:18 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:18 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:18.005599 22221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:17.997206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.2:44063)
0809 19:10:17.997685 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:17.997701 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:17.997829 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:17.998194 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:17.998198 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:17.998739 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:17.998899 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:17.998907 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:18.000126 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:18.000132 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:18.001050 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:18.001062 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:18.001847 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:18.001853 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:18.002012 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:18.002644 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:18.002662 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:18.005287 (+ 2625us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":234,"threads_started":1}
W20260809 19:10:18.005703 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:17.997237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:44063 (local address 127.7.39.62:34587)
0809 19:10:17.997421 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:17.997428 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:17.997780 (+ 352us) server_negotiation.cc:407] Connection header received
0809 19:10:17.997959 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:17.997964 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:17.998051 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:17.998134 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:17.999051 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:17.999956 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:18.001193 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:18.001671 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:18.001779 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:18.005495 (+ 3716us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.2:44063: BlockingRecv error: recv got EOF from 127.7.39.2:44063 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 09 19:10:18 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:18 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:18.422387 22222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:18.414477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.3:57485)
0809 19:10:18.414927 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:18.414943 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:18.415066 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:18.415331 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:18.415335 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:18.415740 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:18.415886 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:18.415894 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:18.416864 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:18.416870 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:18.417992 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:18.418006 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:18.418731 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:18.418737 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:18.418896 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:18.419476 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:18.419494 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:18.422056 (+ 2562us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":236,"threads_started":1}
W20260809 19:10:18.422623 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:18.414548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:57485 (local address 127.7.39.62:34587)
0809 19:10:18.414773 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:18.414779 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:18.415016 (+ 237us) server_negotiation.cc:407] Connection header received
0809 19:10:18.415169 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:18.415172 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:18.415234 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:18.415303 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:18.415991 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:18.416706 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:18.418127 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:18.418546 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:18.418653 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:18.422398 (+ 3745us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.3:57485: BlockingRecv error: recv got EOF from 127.7.39.3:57485 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 09 19:10:18 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:18 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:18.584318 22223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:18.574545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.1:38053)
0809 19:10:18.575055 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:18.575071 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:18.575181 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:18.575431 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:18.575434 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:18.575845 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:18.576014 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:18.576023 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:18.577126 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:18.577132 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:18.578542 (+ 1410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:18.578560 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:18.579553 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:18.579560 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:18.580074 (+ 514us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:18.580770 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:18.580794 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:18.584037 (+ 3243us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":284,"threads_started":1}
W20260809 19:10:18.585886 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:18.574586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:38053 (local address 127.7.39.62:34587)
0809 19:10:18.574760 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:18.574765 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:18.575131 (+ 366us) server_negotiation.cc:407] Connection header received
0809 19:10:18.575264 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:18.575268 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:18.575326 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:18.575401 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:18.576119 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:18.576982 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:18.578707 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:18.579381 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:18.579516 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:18.585713 (+ 6197us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.1:38053: BlockingRecv error: recv got EOF from 127.7.39.1:38053 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 09 19:10:19 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:19 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:19.014797 22224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:19.006576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.2:52637)
0809 19:10:19.007036 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:19.007053 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:19.007167 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:19.007479 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:19.007485 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:19.007876 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:19.008144 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:19.008159 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:19.009421 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:19.009425 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:19.010465 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:19.010479 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:19.011087 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:19.011091 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:19.011219 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:19.011783 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:19.011800 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:19.014567 (+ 2767us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":243,"threads_started":1}
W20260809 19:10:19.014945 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:19.006620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:52637 (local address 127.7.39.62:34587)
0809 19:10:19.006814 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:19.006821 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:19.007141 (+ 320us) server_negotiation.cc:407] Connection header received
0809 19:10:19.007259 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:19.007262 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:19.007324 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:19.007401 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:19.008307 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:19.009304 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:19.010587 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:19.010975 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:19.011077 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:19.014742 (+ 3665us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.2:52637: BlockingRecv error: recv got EOF from 127.7.39.2:52637 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 09 19:10:19 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:19 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:19.431246 22225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:19.423247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.3:59037)
0809 19:10:19.423739 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:19.423756 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:19.423867 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:19.424141 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:19.424145 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:19.424529 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:19.424692 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:19.424702 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:19.425698 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:19.425703 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:19.426872 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:19.426887 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:19.427551 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:19.427557 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:19.427731 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:19.428255 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:19.428272 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:19.431015 (+ 2743us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":252,"threads_started":1}
W20260809 19:10:19.431391 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:19.423334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:59037 (local address 127.7.39.62:34587)
0809 19:10:19.423573 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:19.423579 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:19.423823 (+ 244us) server_negotiation.cc:407] Connection header received
0809 19:10:19.423962 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:19.423966 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:19.424032 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:19.424109 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:19.424814 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:19.425535 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:19.427018 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:19.427403 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:19.427524 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:19.431195 (+ 3671us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.3:59037: BlockingRecv error: recv got EOF from 127.7.39.3:59037 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 09 19:10:19 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:19 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:19.594137 22226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:19.586050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.1:42461)
0809 19:10:19.586585 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:19.586601 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:19.586721 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:19.587075 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:19.587080 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:19.587460 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:19.587626 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:19.587635 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:19.588680 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:19.588685 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:19.589692 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:19.589705 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:19.590433 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:19.590439 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:19.590607 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:19.591192 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:19.591209 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:19.593805 (+ 2596us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":309,"threads_started":1}
W20260809 19:10:19.594246 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:19.586181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:42461 (local address 127.7.39.62:34587)
0809 19:10:19.586431 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:19.586438 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:19.586677 (+ 239us) server_negotiation.cc:407] Connection header received
0809 19:10:19.586826 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:19.586832 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:19.586902 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:19.586997 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:19.587763 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:19.588551 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:19.589824 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:19.590279 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:19.590418 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:19.594011 (+ 3593us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.1:42461: BlockingRecv error: recv got EOF from 127.7.39.1:42461 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 09 19:10:20 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:20 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:20.023869 22227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:20.015727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.2:40653)
0809 19:10:20.016210 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:20.016226 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:20.016336 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:20.016607 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:20.016610 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:20.016990 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:20.017168 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:20.017182 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:20.018181 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:20.018186 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:20.019477 (+ 1291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:20.019490 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:20.020209 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:20.020213 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:20.020335 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:20.020923 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:20.020942 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:20.023648 (+ 2706us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":275,"threads_started":1}
W20260809 19:10:20.024096 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:20.015782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:40653 (local address 127.7.39.62:34587)
0809 19:10:20.016022 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:20.016028 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:20.016302 (+ 274us) server_negotiation.cc:407] Connection header received
0809 19:10:20.016425 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:20.016429 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:20.016491 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:20.016577 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:20.017301 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:20.018045 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:20.019631 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:20.020064 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:20.020163 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:20.023841 (+ 3678us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.2:40653: BlockingRecv error: recv got EOF from 127.7.39.2:40653 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 09 19:10:20 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:20 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:20.440282 22228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:20.432122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.3:48405)
0809 19:10:20.432622 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:20.432639 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:20.432748 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:20.433051 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:20.433055 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:20.433447 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:20.433604 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:20.433615 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:20.434758 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:20.434763 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:20.435711 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:20.435725 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:20.436413 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:20.436417 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:20.436540 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:20.437217 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:20.437241 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:20.440059 (+ 2818us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":271,"threads_started":1}
W20260809 19:10:20.440434 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:20.432251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:48405 (local address 127.7.39.62:34587)
0809 19:10:20.432411 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:20.432415 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:20.432703 (+ 288us) server_negotiation.cc:407] Connection header received
0809 19:10:20.432838 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:20.432841 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:20.432935 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:20.433015 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:20.433772 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:20.434582 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:20.435856 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:20.436282 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:20.436379 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:20.440226 (+ 3847us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.3:48405: BlockingRecv error: recv got EOF from 127.7.39.3:48405 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 09 19:10:20 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:20 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:20.603020 22229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:20.595033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.1:57531)
0809 19:10:20.595524 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:20.595540 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:20.595665 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:20.595969 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:20.595973 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:20.596390 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:20.596572 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:20.596581 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:20.597607 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:20.597613 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:20.598587 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:20.598600 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:20.599398 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:20.599404 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:20.599572 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:20.600141 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:20.600159 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:20.602788 (+ 2629us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":273,"threads_started":1}
W20260809 19:10:20.603184 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:20.595110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:57531 (local address 127.7.39.62:34587)
0809 19:10:20.595313 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:20.595319 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:20.595617 (+ 298us) server_negotiation.cc:407] Connection header received
0809 19:10:20.595773 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:20.595777 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:20.595838 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:20.595919 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:20.596712 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:20.597482 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:20.598723 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:20.599250 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:20.599361 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:20.602976 (+ 3615us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.1:57531: BlockingRecv error: recv got EOF from 127.7.39.1:57531 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 09 19:10:21 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:21 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:21.033558 22230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:21.024758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.2:48481)
0809 19:10:21.025470 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:21.025499 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:21.025635 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:21.025952 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:21.025958 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:21.026451 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:21.026639 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:21.026649 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:21.027621 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:21.027625 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:21.028518 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:21.028529 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:21.029199 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:21.029204 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:21.029456 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:21.030007 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:21.030023 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:21.033221 (+ 3198us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":600,"thread_start_us":447,"threads_started":1}
W20260809 19:10:21.033644 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:21.024870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:48481 (local address 127.7.39.62:34587)
0809 19:10:21.025064 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:21.025071 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:21.025580 (+ 509us) server_negotiation.cc:407] Connection header received
0809 19:10:21.025737 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:21.025740 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:21.025802 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:21.025884 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:21.026776 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:21.027496 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:21.028630 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:21.029031 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:21.029131 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:21.033432 (+ 4301us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.2:48481: BlockingRecv error: recv got EOF from 127.7.39.2:48481 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 09 19:10:21 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:21 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:21.448890 22231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:21.441176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.3:39657)
0809 19:10:21.441659 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:21.441676 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:21.441787 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:21.442065 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:21.442068 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:21.442514 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:21.442717 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:21.442728 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:21.443772 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:21.443776 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:21.444668 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:21.444680 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:21.445330 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:21.445335 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:21.445446 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:21.445972 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:21.445988 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:21.448656 (+ 2668us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":248,"threads_started":1}
W20260809 19:10:21.449013 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:21.441226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:39657 (local address 127.7.39.62:34587)
0809 19:10:21.441422 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:21.441429 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:21.441752 (+ 323us) server_negotiation.cc:407] Connection header received
0809 19:10:21.441879 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:21.441882 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:21.441958 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:21.442036 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:21.442846 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:21.443645 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:21.444783 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:21.445182 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:21.445284 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:21.448824 (+ 3540us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.3:39657: BlockingRecv error: recv got EOF from 127.7.39.3:39657 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 09 19:10:21 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:21 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:21.611476 22235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:21.603829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.1:45889)
0809 19:10:21.604323 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:21.604341 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:21.604454 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:21.604727 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:21.604730 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:21.605107 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:21.605279 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:21.605288 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:21.606191 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:21.606195 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:21.607222 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:21.607236 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:21.607918 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:21.607922 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:21.608040 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:21.608601 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:21.608618 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:21.611250 (+ 2632us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":282,"threads_started":1}
W20260809 19:10:21.611640 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:21.603894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:45889 (local address 127.7.39.62:34587)
0809 19:10:21.604065 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:21.604070 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:21.604405 (+ 335us) server_negotiation.cc:407] Connection header received
0809 19:10:21.604549 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:21.604553 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:21.604612 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:21.604681 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:21.605388 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:21.606088 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:21.607365 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:21.607813 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:21.607900 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:21.611423 (+ 3523us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.1:45889: BlockingRecv error: recv got EOF from 127.7.39.1:45889 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 09 19:10:22 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:22 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:22.045555 22236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:22.034488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.2:35869)
0809 19:10:22.034990 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:22.035008 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:22.035121 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:22.035378 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:22.035381 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:22.035776 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:22.035927 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:22.035935 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:22.036895 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:22.036898 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:22.037808 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:22.037819 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:22.038590 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:22.038594 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:22.038759 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:22.042158 (+ 3399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:22.042176 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:22.045310 (+ 3134us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":292,"threads_started":1}
W20260809 19:10:22.045697 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:22.034568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:35869 (local address 127.7.39.62:34587)
0809 19:10:22.034735 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:22.034739 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:22.035072 (+ 333us) server_negotiation.cc:407] Connection header received
0809 19:10:22.035199 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:22.035203 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:22.035263 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:22.035339 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:22.036085 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:22.036784 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:22.037947 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:22.038452 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:22.038555 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:22.045488 (+ 6933us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.2:35869: BlockingRecv error: recv got EOF from 127.7.39.2:35869 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 09 19:10:22 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:22 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:22.458158 22238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:22.449872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.3:40115)
0809 19:10:22.450397 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:22.450413 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:22.450540 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:22.450874 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:22.450878 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:22.451256 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:22.451424 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:22.451433 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:22.452447 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:22.452452 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:22.453354 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:22.453367 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:22.454353 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:22.454359 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:22.454542 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:22.455184 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:22.455202 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:22.457832 (+ 2630us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":268,"threads_started":1}
W20260809 19:10:22.458285 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:22.449904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:40115 (local address 127.7.39.62:34587)
0809 19:10:22.450076 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:22.450082 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:22.450501 (+ 419us) server_negotiation.cc:407] Connection header received
0809 19:10:22.450666 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:22.450671 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:22.450742 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:22.450824 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:22.451576 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:22.452301 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:22.453597 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:22.454161 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:22.454318 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:22.458058 (+ 3740us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.3:40115: BlockingRecv error: recv got EOF from 127.7.39.3:40115 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 09 19:10:22 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:22 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:22.619841 22240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:22.612378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.1:50447)
0809 19:10:22.612867 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:22.612885 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:22.612996 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:22.613261 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:22.613264 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:22.613668 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:22.613847 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:22.613856 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:22.614784 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:22.614787 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:22.615698 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:22.615709 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:22.616380 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:22.616385 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:22.616499 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:22.617038 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:22.617055 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:22.619624 (+ 2569us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":255,"threads_started":1}
W20260809 19:10:22.619998 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:22.612439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:50447 (local address 127.7.39.62:34587)
0809 19:10:22.612648 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:22.612654 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:22.612958 (+ 304us) server_negotiation.cc:407] Connection header received
0809 19:10:22.613090 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:22.613093 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:22.613156 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:22.613230 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:22.613959 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:22.614682 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:22.615806 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:22.616227 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:22.616317 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:22.619793 (+ 3476us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.1:50447: BlockingRecv error: recv got EOF from 127.7.39.1:50447 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 09 19:10:23 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:23 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:23.055476 22241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:23.046509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.2:33407)
0809 19:10:23.047508 (+ 999us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:23.047529 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:23.047683 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:23.048069 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:23.048072 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:23.048446 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:23.048635 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:23.048645 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:23.050080 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:23.050084 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:23.051031 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:23.051044 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:23.052008 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:23.052012 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:23.052124 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:23.052672 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:23.052689 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:23.055250 (+ 2561us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":893,"thread_start_us":744,"threads_started":1}
W20260809 19:10:23.055781 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:23.046674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:33407 (local address 127.7.39.62:34587)
0809 19:10:23.046866 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:23.046872 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:23.047627 (+ 755us) server_negotiation.cc:407] Connection header received
0809 19:10:23.047856 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:23.047862 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:23.047944 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:23.048051 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:23.048770 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:23.049948 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:23.051167 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:23.051861 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:23.051986 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:23.055505 (+ 3519us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.2:33407: BlockingRecv error: recv got EOF from 127.7.39.2:33407 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 09 19:10:23 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:23 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:23.467468 22243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:23.459126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.3:50129)
0809 19:10:23.459629 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:23.459645 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:23.459777 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:23.460101 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:23.460106 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:23.460547 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:23.460747 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:23.460758 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:23.461836 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:23.461841 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:23.462766 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:23.462779 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:23.463457 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:23.463464 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:23.463625 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:23.464137 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:23.464153 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:23.467173 (+ 3020us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":266,"threads_started":1}
W20260809 19:10:23.467531 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:23.459191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:50129 (local address 127.7.39.62:34587)
0809 19:10:23.459375 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:23.459382 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:23.459727 (+ 345us) server_negotiation.cc:407] Connection header received
0809 19:10:23.459895 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:23.459900 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:23.459967 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:23.460059 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:23.460882 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:23.461709 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:23.462910 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:23.463321 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:23.463428 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:23.467356 (+ 3928us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.3:50129: BlockingRecv error: recv got EOF from 127.7.39.3:50129 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 09 19:10:23 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:23 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:23.628679 22244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:23.620717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.1:44779)
0809 19:10:23.621172 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:23.621187 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:23.621312 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:23.621648 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:23.621653 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:23.622037 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:23.622190 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:23.622199 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:23.623242 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:23.623246 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:23.624151 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:23.624163 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:23.624836 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:23.624842 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:23.625004 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:23.625530 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:23.625563 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:23.628452 (+ 2889us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":225,"threads_started":1}
W20260809 19:10:23.628841 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:23.620806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:44779 (local address 127.7.39.62:34587)
0809 19:10:23.621104 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:23.621110 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:23.621258 (+ 148us) server_negotiation.cc:407] Connection header received
0809 19:10:23.621433 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:23.621438 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:23.621499 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:23.621580 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:23.622349 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:23.623101 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:23.624291 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:23.624698 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:23.624805 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:23.628635 (+ 3830us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.1:44779: BlockingRecv error: recv got EOF from 127.7.39.1:44779 (error 108)
Metrics: {"server-negotiator.queue_time_us":143}
Aug 09 19:10:24 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:24 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:24.064260 22245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:24.056472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.2:60679)
0809 19:10:24.056949 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:24.056971 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:24.057099 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:24.057360 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:24.057363 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:24.057734 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:24.057883 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:24.057891 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:24.058880 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:24.058884 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:24.059779 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:24.059791 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:24.060450 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:24.060454 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:24.060578 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:24.061139 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:24.061156 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:24.063897 (+ 2741us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":242,"threads_started":1}
W20260809 19:10:24.064314 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:24.056605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:60679 (local address 127.7.39.62:34587)
0809 19:10:24.056785 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:24.056790 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:24.057055 (+ 265us) server_negotiation.cc:407] Connection header received
0809 19:10:24.057181 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:24.057184 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:24.057247 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:24.057322 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:24.058018 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:24.058776 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:24.059897 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:24.060347 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:24.060439 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:24.064109 (+ 3670us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.2:60679: BlockingRecv error: recv got EOF from 127.7.39.2:60679 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 09 19:10:24 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:24 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.3@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:24.476779 22246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:24.468462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.3:55687)
0809 19:10:24.468966 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:24.468986 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:24.469120 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:24.469441 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:24.469446 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:24.469811 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:24.469968 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:24.469976 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:24.470911 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:24.470915 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:24.471976 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:24.471991 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:24.472836 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:24.472841 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:24.473008 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:24.473590 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:24.473609 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:24.476447 (+ 2838us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":229,"threads_started":1}
W20260809 19:10:24.476951 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:24.468583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:55687 (local address 127.7.39.62:34587)
0809 19:10:24.468767 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:24.468772 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:24.469068 (+ 296us) server_negotiation.cc:407] Connection header received
0809 19:10:24.469241 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:24.469244 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:24.469306 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:24.469385 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:24.470074 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:24.470784 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:24.472107 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:24.472694 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:24.472808 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:24.476735 (+ 3927us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.3:55687: BlockingRecv error: recv got EOF from 127.7.39.3:55687 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 09 19:10:24 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:24 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.1@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:24.637277 22247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:24.629722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.1:51937)
0809 19:10:24.630171 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:24.630187 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:24.630317 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:24.630632 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:24.630634 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:24.631035 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:24.631209 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:24.631218 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:24.632137 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:24.632141 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:24.633042 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:24.633053 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:24.633681 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:24.633685 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:24.633792 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:24.634411 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:24.634429 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:24.636934 (+ 2505us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":252,"threads_started":1}
W20260809 19:10:24.637394 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:24.629805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:51937 (local address 127.7.39.62:34587)
0809 19:10:24.630025 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:24.630031 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:24.630262 (+ 231us) server_negotiation.cc:407] Connection header received
0809 19:10:24.630437 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:24.630441 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:24.630520 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:24.630602 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:24.631326 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:24.632020 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:24.633144 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:24.633563 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:24.633648 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:24.637166 (+ 3518us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.1:51937: BlockingRecv error: recv got EOF from 127.7.39.1:51937 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 09 19:10:25 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 19:10:25 dist-test-slave-4tdj krb5kdc[20664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.39.2@KRBTEST.COM for oryx/127.7.39.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 19:10:25.073060 22248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:25.065387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:34587 (local address 127.7.39.2:55359)
0809 19:10:25.065904 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:25.065920 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:25.066031 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:25.066326 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:25.066331 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:25.066752 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:25.066924 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:25.066933 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:25.067894 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:25.067898 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:25.068839 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:25.068850 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:25.069478 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:25.069497 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:25.069605 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:25.070128 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:25.070148 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:25.072804 (+ 2656us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.39.62:34587: Server oryx/127.7.39.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":284,"threads_started":1}
W20260809 19:10:25.073163 21808 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:25.065474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:55359 (local address 127.7.39.62:34587)
0809 19:10:25.065643 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:25.065647 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:25.065993 (+ 346us) server_negotiation.cc:407] Connection header received
0809 19:10:25.066120 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:25.066123 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:25.066186 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:25.066265 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:25.067047 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:25.067761 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:25.068946 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:25.069372 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:25.069462 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:25.072970 (+ 3508us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.39.2:55359: BlockingRecv error: recv got EOF from 127.7.39.2:55359 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 19:10:25.328112 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 21578
I20260809 19:10:25.339723 22251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:25.329122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49216 (local address 127.7.39.1:45717)
0809 19:10:25.329671 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:25.329681 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:25.329708 (+ 27us) server_negotiation.cc:407] Connection header received
0809 19:10:25.329765 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:25.329771 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:25.329994 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:25.330147 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:25.331538 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:25.332613 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:25.333787 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:25.334366 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:25.334463 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:25.336785 (+ 2322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:25.336794 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:25.336808 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:10:25.336848 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:25.339153 (+ 2305us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.7.39.1@KRBTEST.COM not found in keytab (ticket kvno 2)
0809 19:10:25.339395 (+ 242us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49216: Request ticket server kudu/127.7.39.1@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":265,"threads_started":1}
W20260809 19:10:25.339754 7324 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 21578: Not authorized: Client connection negotiation failed: client connection to 127.7.39.1:45717: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.7.39.1@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260809 19:10:25.339820 22251 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49216: Request ticket server kudu/127.7.39.1@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260809 19:10:25.339972 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 21578
I20260809 19:10:25.364216 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 21810
I20260809 19:10:25.375655 22252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:25.365193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53836 (local address 127.7.39.2:45175)
0809 19:10:25.365812 (+ 619us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:25.365820 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:25.365850 (+ 30us) server_negotiation.cc:407] Connection header received
0809 19:10:25.365907 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:25.365914 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:25.366120 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:25.366272 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:25.367464 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:25.368489 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:25.369601 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:25.370133 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:25.370227 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:25.372747 (+ 2520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:25.372755 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:25.372768 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:10:25.372803 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:25.375156 (+ 2353us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.7.39.2@KRBTEST.COM not found in keytab (ticket kvno 2)
0809 19:10:25.375392 (+ 236us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53836: Request ticket server kudu/127.7.39.2@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":469,"thread_start_us":288,"threads_started":1}
W20260809 19:10:25.375756 22252 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53836: Request ticket server kudu/127.7.39.2@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260809 19:10:25.375779 7324 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 21810: Not authorized: Client connection negotiation failed: client connection to 127.7.39.2:45175: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.7.39.2@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260809 19:10:25.375923 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 21810
I20260809 19:10:25.396787 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 21995
I20260809 19:10:25.407665 22253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:25.397632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58626 (local address 127.7.39.3:38455)
0809 19:10:25.398157 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:25.398164 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:25.398189 (+ 25us) server_negotiation.cc:407] Connection header received
0809 19:10:25.398245 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:25.398252 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:25.398552 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:25.398701 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:25.399868 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:25.400873 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:25.401930 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:25.402552 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:25.402645 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:25.404835 (+ 2190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:25.404843 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:25.404855 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:10:25.404890 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:25.407194 (+ 2304us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.7.39.3@KRBTEST.COM not found in keytab (ticket kvno 2)
0809 19:10:25.407419 (+ 225us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58626: Request ticket server kudu/127.7.39.3@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":250,"threads_started":1}
W20260809 19:10:25.407768 22253 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58626: Request ticket server kudu/127.7.39.3@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260809 19:10:25.407805 7324 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 21995: Not authorized: Client connection negotiation failed: client connection to 127.7.39.3:38455: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.7.39.3@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260809 19:10:25.407968 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 21995
I20260809 19:10:25.428587 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 21478
I20260809 19:10:25.429816 21570 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:10:25.544234 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 21478
2026-08-09T19:10:25Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (21000 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-09T19:10:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:10:25Z Disabled control of system clock
I20260809 19:10:25.620540 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:43527
--webserver_interface=127.7.39.62
--webserver_port=0
--builtin_ntp_servers=127.7.39.20:34409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:43527
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 19:10:25.942745 22260 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:10:25.943046 22260 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:10:25.943173 22260 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:10:25.950244 22260 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:10:25.950371 22260 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:10:25.950435 22260 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:10:25.950515 22260 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:10:25.950583 22260 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:10:25.959466 22260 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:34409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:43527
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:43527
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:10:25.960714 22260 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:10:25.962508 22260 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:10:25.973999 22270 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:25.974148 22268 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:25.974704 22267 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:10:25.975291 22260 server_base.cc:1034] running on GCE node
I20260809 19:10:25.976003 22260 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:10:25.977362 22260 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:10:25.978560 22260 hybrid_clock.cc:648] HybridClock initialized: now 1786302625978451 us; error 100 us; skew 500 ppm
I20260809 19:10:25.978889 22260 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:10:25.981072 22260 webserver.cc:460] Webserver started at http://127.7.39.62:44765/ using document root <none> and password file <none>
I20260809 19:10:25.981729 22260 fs_manager.cc:359] Metadata directory not provided
I20260809 19:10:25.981830 22260 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:10:25.982147 22260 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:10:25.984997 22260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "9d8e78b1ef2e45b99e1bd5c3e0952bd8"
format_stamp: "Formatted at 2026-08-09 19:10:25 on dist-test-slave-4tdj"
server_key: "dd86929917f5cb73c9061aabe17af96a"
server_key_iv: "7e94926cc76b1f779c711f538995d7e5"
server_key_version: "encryptionkey@0"
I20260809 19:10:25.985800 22260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "9d8e78b1ef2e45b99e1bd5c3e0952bd8"
format_stamp: "Formatted at 2026-08-09 19:10:25 on dist-test-slave-4tdj"
server_key: "dd86929917f5cb73c9061aabe17af96a"
server_key_iv: "7e94926cc76b1f779c711f538995d7e5"
server_key_version: "encryptionkey@0"
I20260809 19:10:25.990867 22260 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260809 19:10:25.994187 22281 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:25.995551 22260 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 19:10:25.995723 22260 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "9d8e78b1ef2e45b99e1bd5c3e0952bd8"
format_stamp: "Formatted at 2026-08-09 19:10:25 on dist-test-slave-4tdj"
server_key: "dd86929917f5cb73c9061aabe17af96a"
server_key_iv: "7e94926cc76b1f779c711f538995d7e5"
server_key_version: "encryptionkey@0"
I20260809 19:10:25.995919 22260 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:10:26.013499 22260 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:10:26.014329 22260 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:10:26.014703 22260 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:10:26.036015 22260 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:43527
I20260809 19:10:26.036042 22352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:43527 every 8 connection(s)
I20260809 19:10:26.037453 22260 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:10:26.040340 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 22260
I20260809 19:10:26.040571 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:10:26.041380 22353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:10:26.041489 7324 external_mini_cluster.cc:1428] Setting key f7acb8b33ddfe159e32c3081cb50d340
I20260809 19:10:26.055896 22353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d8e78b1ef2e45b99e1bd5c3e0952bd8: Bootstrap starting.
I20260809 19:10:26.059222 22353 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d8e78b1ef2e45b99e1bd5c3e0952bd8: Neither blocks nor log segments found. Creating new log.
I20260809 19:10:26.060400 22353 log.cc:824] T 00000000000000000000000000000000 P 9d8e78b1ef2e45b99e1bd5c3e0952bd8: Log is configured to *not* fsync() on all Append() calls
I20260809 19:10:26.061494 22360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:26.044442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36372 (local address 127.7.39.62:43527)
0809 19:10:26.045957 (+ 1515us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:26.045980 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:26.046045 (+ 65us) server_negotiation.cc:407] Connection header received
0809 19:10:26.048231 (+ 2186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:26.048261 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:26.048758 (+ 497us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:26.049121 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:26.049684 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:26.051489 (+ 1805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:26.053381 (+ 1892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:26.054758 (+ 1377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:26.054957 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:26.058990 (+ 4033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:26.058997 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:26.059010 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:10:26.059594 (+ 584us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:26.059696 (+ 102us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:10:26.059723 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:26.059801 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:26.060045 (+ 244us) server_negotiation.cc:299] Negotiation successful
0809 19:10:26.060340 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":935,"thread_start_us":668,"threads_started":1}
I20260809 19:10:26.063639 22353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d8e78b1ef2e45b99e1bd5c3e0952bd8: No bootstrap required, opened a new log
I20260809 19:10:26.070781 22353 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9d8e78b1ef2e45b99e1bd5c3e0952bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d8e78b1ef2e45b99e1bd5c3e0952bd8" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 43527 } }
I20260809 19:10:26.071099 22353 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9d8e78b1ef2e45b99e1bd5c3e0952bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:10:26.071184 22353 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9d8e78b1ef2e45b99e1bd5c3e0952bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d8e78b1ef2e45b99e1bd5c3e0952bd8, State: Initialized, Role: FOLLOWER
I20260809 19:10:26.071668 22353 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d8e78b1ef2e45b99e1bd5c3e0952bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d8e78b1ef2e45b99e1bd5c3e0952bd8" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 43527 } }
I20260809 19:10:26.071877 22353 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9d8e78b1ef2e45b99e1bd5c3e0952bd8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:10:26.072010 22353 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9d8e78b1ef2e45b99e1bd5c3e0952bd8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:10:26.072199 22353 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9d8e78b1ef2e45b99e1bd5c3e0952bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:10:26.074435 22353 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9d8e78b1ef2e45b99e1bd5c3e0952bd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d8e78b1ef2e45b99e1bd5c3e0952bd8" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 43527 } }
I20260809 19:10:26.074855 22353 leader_election.cc:302] T 00000000000000000000000000000000 P 9d8e78b1ef2e45b99e1bd5c3e0952bd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9d8e78b1ef2e45b99e1bd5c3e0952bd8; no voters:
I20260809 19:10:26.075628 22353 leader_election.cc:288] T 00000000000000000000000000000000 P 9d8e78b1ef2e45b99e1bd5c3e0952bd8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:10:26.075773 22363 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9d8e78b1ef2e45b99e1bd5c3e0952bd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:10:26.076419 22363 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9d8e78b1ef2e45b99e1bd5c3e0952bd8 [term 1 LEADER]: Becoming Leader. State: Replica: 9d8e78b1ef2e45b99e1bd5c3e0952bd8, State: Running, Role: LEADER
I20260809 19:10:26.076963 22363 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d8e78b1ef2e45b99e1bd5c3e0952bd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d8e78b1ef2e45b99e1bd5c3e0952bd8" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 43527 } }
I20260809 19:10:26.077726 22353 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9d8e78b1ef2e45b99e1bd5c3e0952bd8 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:10:26.079697 22365 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d8e78b1ef2e45b99e1bd5c3e0952bd8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d8e78b1ef2e45b99e1bd5c3e0952bd8. Latest consensus state: current_term: 1 leader_uuid: "9d8e78b1ef2e45b99e1bd5c3e0952bd8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d8e78b1ef2e45b99e1bd5c3e0952bd8" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 43527 } } }
I20260809 19:10:26.080065 22365 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d8e78b1ef2e45b99e1bd5c3e0952bd8 [sys.catalog]: This master's current role is: LEADER
I20260809 19:10:26.080536 22364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d8e78b1ef2e45b99e1bd5c3e0952bd8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9d8e78b1ef2e45b99e1bd5c3e0952bd8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d8e78b1ef2e45b99e1bd5c3e0952bd8" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 43527 } } }
I20260809 19:10:26.080883 22364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d8e78b1ef2e45b99e1bd5c3e0952bd8 [sys.catalog]: This master's current role is: LEADER
I20260809 19:10:26.081211 22374 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:10:26.086560 22374 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:10:26.095798 22374 catalog_manager.cc:1347] Generated new cluster ID: 7e7a9d4890484658bb8be191d1f37e51
I20260809 19:10:26.095894 22374 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:10:26.107352 22374 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:10:26.109052 22374 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:10:26.124289 22374 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9d8e78b1ef2e45b99e1bd5c3e0952bd8: Generated new TSK 0
I20260809 19:10:26.125254 22374 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:10:26.134558 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.1:0
--local_ip_for_outbound_sockets=127.7.39.1
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:43527
--builtin_ntp_servers=127.7.39.20:34409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260809 19:10:26.455812 22391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:10:26.456051 22391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:10:26.456166 22391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:10:26.463150 22391 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:10:26.463238 22391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:10:26.463370 22391 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.1
I20260809 19:10:26.472142 22391 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:34409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:43527
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.1
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:10:26.473239 22391 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:10:26.475005 22391 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:10:26.487147 22398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:26.487249 22399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:26.487239 22401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:10:26.487953 22391 server_base.cc:1034] running on GCE node
I20260809 19:10:26.488528 22391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:10:26.489332 22391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:10:26.490528 22391 hybrid_clock.cc:648] HybridClock initialized: now 1786302626490485 us; error 33 us; skew 500 ppm
I20260809 19:10:26.490813 22391 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:10:26.492841 22391 webserver.cc:460] Webserver started at http://127.7.39.1:34457/ using document root <none> and password file <none>
I20260809 19:10:26.493475 22391 fs_manager.cc:359] Metadata directory not provided
I20260809 19:10:26.493562 22391 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:10:26.493877 22391 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:10:26.496526 22391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/data/instance:
uuid: "a6030e65a535434eb639f1eea45bef6b"
format_stamp: "Formatted at 2026-08-09 19:10:26 on dist-test-slave-4tdj"
server_key: "97fb60dd1bdac66ae82c9ec51fde9ab7"
server_key_iv: "e26ef05af5f0aa9b40dbff3ab0f1d09f"
server_key_version: "encryptionkey@0"
I20260809 19:10:26.497256 22391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance:
uuid: "a6030e65a535434eb639f1eea45bef6b"
format_stamp: "Formatted at 2026-08-09 19:10:26 on dist-test-slave-4tdj"
server_key: "97fb60dd1bdac66ae82c9ec51fde9ab7"
server_key_iv: "e26ef05af5f0aa9b40dbff3ab0f1d09f"
server_key_version: "encryptionkey@0"
I20260809 19:10:26.502081 22391 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 19:10:26.505275 22409 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:26.506529 22391 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:10:26.506680 22391 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/wal
uuid: "a6030e65a535434eb639f1eea45bef6b"
format_stamp: "Formatted at 2026-08-09 19:10:26 on dist-test-slave-4tdj"
server_key: "97fb60dd1bdac66ae82c9ec51fde9ab7"
server_key_iv: "e26ef05af5f0aa9b40dbff3ab0f1d09f"
server_key_version: "encryptionkey@0"
I20260809 19:10:26.506863 22391 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:10:26.539956 22391 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:10:26.540764 22391 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:10:26.541023 22391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:10:26.541934 22391 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:10:26.543371 22391 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:10:26.543473 22391 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:26.543578 22391 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:10:26.543650 22391 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:26.573711 22391 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.1:40689
I20260809 19:10:26.573772 22574 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.1:40689 every 8 connection(s)
I20260809 19:10:26.574995 22391 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
I20260809 19:10:26.579895 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 22391
I20260809 19:10:26.580070 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance
I20260809 19:10:26.580860 7324 external_mini_cluster.cc:1428] Setting key bdd14af731f0ec40c206b4ef35f4b09d
I20260809 19:10:26.583757 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.2:0
--local_ip_for_outbound_sockets=127.7.39.2
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:43527
--builtin_ntp_servers=127.7.39.20:34409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 19:10:26.587567 22581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:26.577287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:36407 (local address 127.7.39.62:43527)
0809 19:10:26.577786 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:26.577792 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:26.578989 (+ 1197us) server_negotiation.cc:407] Connection header received
0809 19:10:26.581201 (+ 2212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:26.581205 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:26.581272 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:26.581365 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:26.582627 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:26.583397 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:26.584941 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:26.585351 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:26.585461 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:26.586744 (+ 1283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:26.586749 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:26.586752 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:10:26.586768 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:26.586805 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:10:26.586817 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:26.586890 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:26.587147 (+ 257us) server_negotiation.cc:299] Negotiation successful
0809 19:10:26.587236 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":238,"threads_started":1}
I20260809 19:10:26.588475 22582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:26.577874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:43527 (local address 127.7.39.1:36407)
0809 19:10:26.578843 (+ 969us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:26.578886 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:26.580903 (+ 2017us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:26.581607 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:26.581617 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:26.581727 (+ 110us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:26.582460 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:26.582483 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:26.583539 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:26.583543 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:26.584796 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:26.584813 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:26.585568 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:26.585576 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:26.585792 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:26.586441 (+ 649us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:10:26.586444 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:26.586481 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:10:26.586549 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:10:26.586908 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:10:26.586919 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:10:26.586927 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 19:10:26.587079 (+ 152us) client_negotiation.cc:240] Negotiation successful
0809 19:10:26.587437 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":246,"threads_started":1}
I20260809 19:10:26.593271 22576 heartbeater.cc:347] Connected to a master server at 127.7.39.62:43527
I20260809 19:10:26.593525 22576 heartbeater.cc:464] Registering TS with master...
I20260809 19:10:26.594218 22576 heartbeater.cc:511] Master 127.7.39.62:43527 requested a full tablet report, sending...
I20260809 19:10:26.596099 22304 ts_manager.cc:194] Registered new tserver with Master: a6030e65a535434eb639f1eea45bef6b (127.7.39.1:40689)
I20260809 19:10:26.597496 22304 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.39.1:36407
W20260809 19:10:26.899535 22585 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:10:26.899896 22585 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:10:26.900032 22585 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:10:26.909196 22585 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:10:26.909284 22585 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:10:26.909413 22585 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.2
I20260809 19:10:26.918771 22585 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:34409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:43527
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.2
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:10:26.919953 22585 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:10:26.921769 22585 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:10:26.934629 22597 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:26.934669 22592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:26.934846 22591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:10:26.935405 22585 server_base.cc:1034] running on GCE node
I20260809 19:10:26.936004 22585 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:10:26.936923 22585 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:10:26.938153 22585 hybrid_clock.cc:648] HybridClock initialized: now 1786302626938090 us; error 45 us; skew 500 ppm
I20260809 19:10:26.938532 22585 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:10:26.940701 22585 webserver.cc:460] Webserver started at http://127.7.39.2:33689/ using document root <none> and password file <none>
I20260809 19:10:26.941344 22585 fs_manager.cc:359] Metadata directory not provided
I20260809 19:10:26.941463 22585 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:10:26.941797 22585 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:10:26.944666 22585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/data/instance:
uuid: "775ca821e1874dad9a838f4898acead9"
format_stamp: "Formatted at 2026-08-09 19:10:26 on dist-test-slave-4tdj"
server_key: "825150939a898265b041a0a165e0caa9"
server_key_iv: "c8b5f0c45057d7c6440c5f3521c3ccd8"
server_key_version: "encryptionkey@0"
I20260809 19:10:26.945508 22585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance:
uuid: "775ca821e1874dad9a838f4898acead9"
format_stamp: "Formatted at 2026-08-09 19:10:26 on dist-test-slave-4tdj"
server_key: "825150939a898265b041a0a165e0caa9"
server_key_iv: "c8b5f0c45057d7c6440c5f3521c3ccd8"
server_key_version: "encryptionkey@0"
I20260809 19:10:26.950553 22585 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 19:10:26.953807 22604 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:26.955133 22585 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:10:26.955279 22585 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/wal
uuid: "775ca821e1874dad9a838f4898acead9"
format_stamp: "Formatted at 2026-08-09 19:10:26 on dist-test-slave-4tdj"
server_key: "825150939a898265b041a0a165e0caa9"
server_key_iv: "c8b5f0c45057d7c6440c5f3521c3ccd8"
server_key_version: "encryptionkey@0"
I20260809 19:10:26.955466 22585 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:10:26.992084 22585 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:10:26.992846 22585 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:10:26.993155 22585 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:10:26.994200 22585 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:10:26.995623 22585 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:10:26.995718 22585 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:26.995824 22585 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:10:26.995899 22585 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:27.028165 22585 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.2:45405
I20260809 19:10:27.028245 22767 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.2:45405 every 8 connection(s)
I20260809 19:10:27.029430 22585 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
I20260809 19:10:27.037006 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 22585
I20260809 19:10:27.037166 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance
I20260809 19:10:27.037672 7324 external_mini_cluster.cc:1428] Setting key a87b7ab9b0a3a84f9a6b8a8b4fcae083
I20260809 19:10:27.040704 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.3:0
--local_ip_for_outbound_sockets=127.7.39.3
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:43527
--builtin_ntp_servers=127.7.39.20:34409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 19:10:27.042847 22581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:27.031794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:37425 (local address 127.7.39.62:43527)
0809 19:10:27.032018 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:27.032025 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:27.033329 (+ 1304us) server_negotiation.cc:407] Connection header received
0809 19:10:27.035018 (+ 1689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:27.035022 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:27.035125 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:27.035234 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:27.036225 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:27.037339 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:27.039606 (+ 2267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:27.040276 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:27.040398 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:27.041974 (+ 1576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:27.041980 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:27.041993 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:10:27.042014 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:27.042053 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:10:27.042070 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:27.042157 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:27.042421 (+ 264us) server_negotiation.cc:299] Negotiation successful
0809 19:10:27.042521 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 19:10:27.043982 22772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:27.032331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:43527 (local address 127.7.39.2:37425)
0809 19:10:27.033178 (+ 847us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:27.033220 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:27.034784 (+ 1564us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:27.035427 (+ 643us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:27.035437 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:27.035526 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:27.036064 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:27.036080 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:27.037495 (+ 1415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:27.037500 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:27.039437 (+ 1937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:27.039452 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:27.040534 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:27.040544 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:27.040829 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:27.041618 (+ 789us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:10:27.041622 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:27.041675 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:10:27.041775 (+ 100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:10:27.042174 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:10:27.042183 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:10:27.042190 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 19:10:27.042398 (+ 208us) client_negotiation.cc:240] Negotiation successful
0809 19:10:27.042775 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":262,"threads_started":1}
I20260809 19:10:27.045344 22769 heartbeater.cc:347] Connected to a master server at 127.7.39.62:43527
I20260809 19:10:27.045645 22769 heartbeater.cc:464] Registering TS with master...
I20260809 19:10:27.046557 22769 heartbeater.cc:511] Master 127.7.39.62:43527 requested a full tablet report, sending...
I20260809 19:10:27.048115 22304 ts_manager.cc:194] Registered new tserver with Master: 775ca821e1874dad9a838f4898acead9 (127.7.39.2:45405)
I20260809 19:10:27.049105 22304 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.39.2:37425
W20260809 19:10:27.356413 22773 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:10:27.356683 22773 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:10:27.356810 22773 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:10:27.363781 22773 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:10:27.363873 22773 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:10:27.364008 22773 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.3
I20260809 19:10:27.372659 22773 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:34409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:43527
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.3
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:10:27.373754 22773 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:10:27.375415 22773 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:10:27.387552 22782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:27.387635 22779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:27.387611 22784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:10:27.388731 22773 server_base.cc:1034] running on GCE node
I20260809 19:10:27.389305 22773 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:10:27.390144 22773 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:10:27.391345 22773 hybrid_clock.cc:648] HybridClock initialized: now 1786302627391285 us; error 45 us; skew 500 ppm
I20260809 19:10:27.391633 22773 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:10:27.397902 22773 webserver.cc:460] Webserver started at http://127.7.39.3:38817/ using document root <none> and password file <none>
I20260809 19:10:27.398598 22773 fs_manager.cc:359] Metadata directory not provided
I20260809 19:10:27.398697 22773 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:10:27.398996 22773 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:10:27.401711 22773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/data/instance:
uuid: "27f8bd96d28746bc850e1f7253b06f79"
format_stamp: "Formatted at 2026-08-09 19:10:27 on dist-test-slave-4tdj"
server_key: "7f7520c0c9acc886fb1ea9207d7c899c"
server_key_iv: "3982ee446979ba85238b04d36ed79a6d"
server_key_version: "encryptionkey@0"
I20260809 19:10:27.402520 22773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance:
uuid: "27f8bd96d28746bc850e1f7253b06f79"
format_stamp: "Formatted at 2026-08-09 19:10:27 on dist-test-slave-4tdj"
server_key: "7f7520c0c9acc886fb1ea9207d7c899c"
server_key_iv: "3982ee446979ba85238b04d36ed79a6d"
server_key_version: "encryptionkey@0"
I20260809 19:10:27.407150 22773 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 19:10:27.410182 22792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:27.411494 22773 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 19:10:27.411638 22773 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/wal
uuid: "27f8bd96d28746bc850e1f7253b06f79"
format_stamp: "Formatted at 2026-08-09 19:10:27 on dist-test-slave-4tdj"
server_key: "7f7520c0c9acc886fb1ea9207d7c899c"
server_key_iv: "3982ee446979ba85238b04d36ed79a6d"
server_key_version: "encryptionkey@0"
I20260809 19:10:27.411814 22773 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:10:27.429832 22773 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:10:27.430604 22773 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:10:27.430845 22773 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:10:27.431697 22773 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:10:27.433046 22773 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:10:27.433146 22773 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:27.433249 22773 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:10:27.433321 22773 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:27.462962 22773 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.3:43925
I20260809 19:10:27.463016 22971 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.3:43925 every 8 connection(s)
I20260809 19:10:27.464200 22773 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
I20260809 19:10:27.465139 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 22773
I20260809 19:10:27.465342 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance
I20260809 19:10:27.465940 7324 external_mini_cluster.cc:1428] Setting key 555f0aeae386e2acd134830a5756a3b6
I20260809 19:10:27.476037 22581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:27.467067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:47713 (local address 127.7.39.62:43527)
0809 19:10:27.467267 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:27.467273 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:27.468695 (+ 1422us) server_negotiation.cc:407] Connection header received
0809 19:10:27.470493 (+ 1798us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:27.470497 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:27.470562 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:27.470638 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:27.471581 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:27.472277 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:27.473690 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:27.474086 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:27.474171 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:27.475397 (+ 1226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:27.475402 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:27.475405 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:10:27.475422 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:27.475454 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:10:27.475466 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:27.475545 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:27.475731 (+ 186us) server_negotiation.cc:299] Negotiation successful
0809 19:10:27.475810 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 19:10:27.476882 22974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:27.467499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:43527 (local address 127.7.39.3:47713)
0809 19:10:27.468541 (+ 1042us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:27.468588 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:27.470229 (+ 1641us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:27.470817 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:27.470824 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:27.470906 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:27.471452 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:27.471468 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:27.472397 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:27.472400 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:27.473586 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:27.473598 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:27.474260 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:27.474265 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:27.474503 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:27.475113 (+ 610us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:10:27.475115 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:27.475152 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:10:27.475227 (+ 75us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:10:27.475549 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:10:27.475554 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:10:27.475559 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 19:10:27.475681 (+ 122us) client_negotiation.cc:240] Negotiation successful
0809 19:10:27.475938 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":300,"threads_started":1}
I20260809 19:10:27.478087 22972 heartbeater.cc:347] Connected to a master server at 127.7.39.62:43527
I20260809 19:10:27.478384 22972 heartbeater.cc:464] Registering TS with master...
I20260809 19:10:27.479161 22972 heartbeater.cc:511] Master 127.7.39.62:43527 requested a full tablet report, sending...
I20260809 19:10:27.480674 22304 ts_manager.cc:194] Registered new tserver with Master: 27f8bd96d28746bc850e1f7253b06f79 (127.7.39.3:43925)
I20260809 19:10:27.481365 7324 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 19:10:27.481565 22304 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.39.3:47713
W20260809 19:10:27.487252 22581 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:27.485769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36374 (local address 127.7.39.62:43527)
0809 19:10:27.485939 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:27.485945 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:27.486351 (+ 406us) server_negotiation.cc:407] Connection header received
0809 19:10:27.486490 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:27.486494 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:27.486578 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:27.486657 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:27.487016 (+ 359us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36374: BlockingRecv error: recv got EOF from 127.0.0.1:36374 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 19:10:27.487850 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 22391
I20260809 19:10:27.494844 22982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:27.488812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54234 (local address 127.7.39.1:40689)
0809 19:10:27.489324 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:27.489330 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:27.489353 (+ 23us) server_negotiation.cc:407] Connection header received
0809 19:10:27.489403 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:27.489409 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:27.489567 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:27.489683 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:27.489980 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:27.490988 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:27.492096 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:27.492601 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:27.492690 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:27.493507 (+ 817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:27.493514 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:27.493524 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:10:27.494099 (+ 575us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:27.494140 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:10:27.494158 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:27.494239 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:27.494384 (+ 145us) server_negotiation.cc:299] Negotiation successful
0809 19:10:27.494493 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":267,"threads_started":1}
I20260809 19:10:27.495909 22567 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:10:27.575565 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 22391
I20260809 19:10:27.597289 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 22585
I20260809 19:10:27.604592 22984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:27.598189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56246 (local address 127.7.39.2:45405)
0809 19:10:27.598735 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:27.598742 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:27.598767 (+ 25us) server_negotiation.cc:407] Connection header received
0809 19:10:27.598846 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:27.598852 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:27.599064 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:27.599180 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:27.599594 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:27.600609 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:27.601742 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:27.602275 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:27.602407 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:27.603270 (+ 863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:27.603278 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:27.603290 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:10:27.603880 (+ 590us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:27.603924 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:10:27.603943 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:27.604029 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:27.604136 (+ 107us) server_negotiation.cc:299] Negotiation successful
0809 19:10:27.604249 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":271,"threads_started":1}
I20260809 19:10:27.605798 22761 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:10:27.683950 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 22585
I20260809 19:10:27.703161 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 22773
I20260809 19:10:27.710988 22987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:27.704082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57594 (local address 127.7.39.3:43925)
0809 19:10:27.704652 (+ 570us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:27.704659 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:27.704689 (+ 30us) server_negotiation.cc:407] Connection header received
0809 19:10:27.704749 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:27.704755 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:27.704957 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:27.705105 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:27.705598 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:27.706643 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:27.707895 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:27.708442 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:27.708564 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:27.709594 (+ 1030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:27.709603 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:27.709615 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:10:27.710177 (+ 562us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:27.710221 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:10:27.710246 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:27.710370 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:27.710525 (+ 155us) server_negotiation.cc:299] Negotiation successful
0809 19:10:27.710679 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":258,"threads_started":1}
I20260809 19:10:27.712169 22963 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:10:27.791574 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 22773
I20260809 19:10:27.812664 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 22260
I20260809 19:10:27.813941 22346 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:10:27.916316 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 22260
2026-08-09T19:10:27Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2370 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-09T19:10:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:10:27Z Disabled control of system clock
I20260809 19:10:27.991144 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:37091
--webserver_interface=127.7.39.62
--webserver_port=0
--builtin_ntp_servers=127.7.39.20:35713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:37091
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 19:10:28.304704 22995 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:10:28.304968 22995 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:10:28.305097 22995 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:10:28.312183 22995 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:10:28.312281 22995 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:10:28.312325 22995 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:10:28.312405 22995 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:10:28.312467 22995 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:10:28.321399 22995 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:35713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:37091
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:37091
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:10:28.322667 22995 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:10:28.324489 22995 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:10:28.336068 23014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:28.336159 23011 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:28.336380 23008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:10:28.337121 22995 server_base.cc:1034] running on GCE node
I20260809 19:10:28.337874 22995 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:10:28.339237 22995 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:10:28.340443 22995 hybrid_clock.cc:648] HybridClock initialized: now 1786302628340404 us; error 27 us; skew 500 ppm
I20260809 19:10:28.340765 22995 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:10:28.343544 22995 webserver.cc:460] Webserver started at http://127.7.39.62:43521/ using document root <none> and password file <none>
I20260809 19:10:28.344194 22995 fs_manager.cc:359] Metadata directory not provided
I20260809 19:10:28.344280 22995 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:10:28.344547 22995 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:10:28.347401 22995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "3f0af7319cc84927a44a7160eb1f3fea"
format_stamp: "Formatted at 2026-08-09 19:10:28 on dist-test-slave-4tdj"
server_key: "018f79ab97ae6ff104b924f6b091a97d"
server_key_iv: "8d905610da2da26c2b5777abeb8a8bf9"
server_key_version: "encryptionkey@0"
I20260809 19:10:28.348142 22995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "3f0af7319cc84927a44a7160eb1f3fea"
format_stamp: "Formatted at 2026-08-09 19:10:28 on dist-test-slave-4tdj"
server_key: "018f79ab97ae6ff104b924f6b091a97d"
server_key_iv: "8d905610da2da26c2b5777abeb8a8bf9"
server_key_version: "encryptionkey@0"
I20260809 19:10:28.352977 22995 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260809 19:10:28.356253 23024 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:28.357501 22995 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 19:10:28.357650 22995 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "3f0af7319cc84927a44a7160eb1f3fea"
format_stamp: "Formatted at 2026-08-09 19:10:28 on dist-test-slave-4tdj"
server_key: "018f79ab97ae6ff104b924f6b091a97d"
server_key_iv: "8d905610da2da26c2b5777abeb8a8bf9"
server_key_version: "encryptionkey@0"
I20260809 19:10:28.357841 22995 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:10:28.363268 22995 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:10:28.363972 22995 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:10:28.364245 22995 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:10:28.381218 22995 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:37091
I20260809 19:10:28.381249 23098 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:37091 every 8 connection(s)
I20260809 19:10:28.382537 22995 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:10:28.386173 23099 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:10:28.389490 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 22995
I20260809 19:10:28.389699 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:10:28.390336 7324 external_mini_cluster.cc:1428] Setting key 2ba55381bd8445db2e930edc9abb8357
I20260809 19:10:28.396845 23099 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f0af7319cc84927a44a7160eb1f3fea: Bootstrap starting.
I20260809 19:10:28.398648 23103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:28.392276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50584 (local address 127.7.39.62:37091)
0809 19:10:28.393198 (+ 922us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:28.393211 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:28.393250 (+ 39us) server_negotiation.cc:407] Connection header received
0809 19:10:28.395386 (+ 2136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:28.395407 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:28.395789 (+ 382us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:28.396080 (+ 291us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:28.397117 (+ 1037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:28.397123 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:28.397135 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:10:28.397150 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:28.397209 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:10:28.397224 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:28.397390 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:28.397489 (+ 99us) server_negotiation.cc:299] Negotiation successful
0809 19:10:28.397756 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":542,"thread_start_us":345,"threads_started":1}
I20260809 19:10:28.400138 23099 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f0af7319cc84927a44a7160eb1f3fea: Neither blocks nor log segments found. Creating new log.
I20260809 19:10:28.401425 23099 log.cc:824] T 00000000000000000000000000000000 P 3f0af7319cc84927a44a7160eb1f3fea: Log is configured to *not* fsync() on all Append() calls
I20260809 19:10:28.403888 23099 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f0af7319cc84927a44a7160eb1f3fea: No bootstrap required, opened a new log
I20260809 19:10:28.410936 23099 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f0af7319cc84927a44a7160eb1f3fea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f0af7319cc84927a44a7160eb1f3fea" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 37091 } }
I20260809 19:10:28.411262 23099 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3f0af7319cc84927a44a7160eb1f3fea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:10:28.411334 23099 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f0af7319cc84927a44a7160eb1f3fea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0af7319cc84927a44a7160eb1f3fea, State: Initialized, Role: FOLLOWER
I20260809 19:10:28.411844 23099 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f0af7319cc84927a44a7160eb1f3fea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f0af7319cc84927a44a7160eb1f3fea" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 37091 } }
I20260809 19:10:28.412041 23099 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3f0af7319cc84927a44a7160eb1f3fea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:10:28.412173 23099 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3f0af7319cc84927a44a7160eb1f3fea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:10:28.412344 23099 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f0af7319cc84927a44a7160eb1f3fea [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:10:28.414623 23099 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3f0af7319cc84927a44a7160eb1f3fea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f0af7319cc84927a44a7160eb1f3fea" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 37091 } }
I20260809 19:10:28.415062 23099 leader_election.cc:302] T 00000000000000000000000000000000 P 3f0af7319cc84927a44a7160eb1f3fea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f0af7319cc84927a44a7160eb1f3fea; no voters:
I20260809 19:10:28.415591 23099 leader_election.cc:288] T 00000000000000000000000000000000 P 3f0af7319cc84927a44a7160eb1f3fea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:10:28.415699 23105 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3f0af7319cc84927a44a7160eb1f3fea [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:10:28.416347 23105 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3f0af7319cc84927a44a7160eb1f3fea [term 1 LEADER]: Becoming Leader. State: Replica: 3f0af7319cc84927a44a7160eb1f3fea, State: Running, Role: LEADER
I20260809 19:10:28.416893 23105 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f0af7319cc84927a44a7160eb1f3fea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f0af7319cc84927a44a7160eb1f3fea" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 37091 } }
I20260809 19:10:28.417426 23099 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f0af7319cc84927a44a7160eb1f3fea [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:10:28.419427 23106 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f0af7319cc84927a44a7160eb1f3fea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3f0af7319cc84927a44a7160eb1f3fea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f0af7319cc84927a44a7160eb1f3fea" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 37091 } } }
I20260809 19:10:28.419786 23106 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f0af7319cc84927a44a7160eb1f3fea [sys.catalog]: This master's current role is: LEADER
I20260809 19:10:28.419912 23107 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f0af7319cc84927a44a7160eb1f3fea [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f0af7319cc84927a44a7160eb1f3fea. Latest consensus state: current_term: 1 leader_uuid: "3f0af7319cc84927a44a7160eb1f3fea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f0af7319cc84927a44a7160eb1f3fea" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 37091 } } }
I20260809 19:10:28.420253 23107 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f0af7319cc84927a44a7160eb1f3fea [sys.catalog]: This master's current role is: LEADER
I20260809 19:10:28.421702 23115 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:10:28.426815 23115 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:10:28.434967 23115 catalog_manager.cc:1347] Generated new cluster ID: 5779b22541fc4cacb551a766939f3505
I20260809 19:10:28.435068 23115 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:10:28.446625 23115 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:10:28.446965 23115 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:10:28.459717 23115 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3f0af7319cc84927a44a7160eb1f3fea: Generated new TSK 0
I20260809 19:10:28.460345 23115 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:10:28.470999 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.1:0
--local_ip_for_outbound_sockets=127.7.39.1
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:37091
--builtin_ntp_servers=127.7.39.20:35713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 19:10:28.794821 23131 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:10:28.795075 23131 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:10:28.795200 23131 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:10:28.802130 23131 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:10:28.802219 23131 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:10:28.802390 23131 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.1
I20260809 19:10:28.811048 23131 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:35713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:37091
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.1
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:10:28.812208 23131 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:10:28.813920 23131 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:10:28.826203 23137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:28.826330 23142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:28.826382 23138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:10:28.827163 23131 server_base.cc:1034] running on GCE node
I20260809 19:10:28.827718 23131 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:10:28.828553 23131 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:10:28.829758 23131 hybrid_clock.cc:648] HybridClock initialized: now 1786302628829716 us; error 32 us; skew 500 ppm
I20260809 19:10:28.830049 23131 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:10:28.832108 23131 webserver.cc:460] Webserver started at http://127.7.39.1:39485/ using document root <none> and password file <none>
I20260809 19:10:28.832731 23131 fs_manager.cc:359] Metadata directory not provided
I20260809 19:10:28.832823 23131 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:10:28.833190 23131 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:10:28.835911 23131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/data/instance:
uuid: "12bc570341644ca99d79b23a770b8ab2"
format_stamp: "Formatted at 2026-08-09 19:10:28 on dist-test-slave-4tdj"
server_key: "58b9dcbe69db5fb114cedbef1f42cdee"
server_key_iv: "3808d7ce03f9ec7c869637cd29e45fcd"
server_key_version: "encryptionkey@0"
I20260809 19:10:28.836638 23131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance:
uuid: "12bc570341644ca99d79b23a770b8ab2"
format_stamp: "Formatted at 2026-08-09 19:10:28 on dist-test-slave-4tdj"
server_key: "58b9dcbe69db5fb114cedbef1f42cdee"
server_key_iv: "3808d7ce03f9ec7c869637cd29e45fcd"
server_key_version: "encryptionkey@0"
I20260809 19:10:28.841372 23131 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 19:10:28.844594 23151 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:28.845775 23131 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 19:10:28.845923 23131 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/wal
uuid: "12bc570341644ca99d79b23a770b8ab2"
format_stamp: "Formatted at 2026-08-09 19:10:28 on dist-test-slave-4tdj"
server_key: "58b9dcbe69db5fb114cedbef1f42cdee"
server_key_iv: "3808d7ce03f9ec7c869637cd29e45fcd"
server_key_version: "encryptionkey@0"
I20260809 19:10:28.846127 23131 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:10:28.851368 23131 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:10:28.852090 23131 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:10:28.852332 23131 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:10:28.853155 23131 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:10:28.854487 23131 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:10:28.854591 23131 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:28.854691 23131 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:10:28.854758 23131 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:28.884135 23131 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.1:33075
I20260809 19:10:28.884200 23326 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.1:33075 every 8 connection(s)
I20260809 19:10:28.885471 23131 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
I20260809 19:10:28.893170 23103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:28.887947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:51375 (local address 127.7.39.62:37091)
0809 19:10:28.888107 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:28.888112 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:28.889512 (+ 1400us) server_negotiation.cc:407] Connection header received
0809 19:10:28.891181 (+ 1669us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:28.891186 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:28.891246 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:28.891335 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:28.892578 (+ 1243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:28.892583 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:28.892586 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:10:28.892606 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:28.892641 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:10:28.892655 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:28.892771 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:28.892898 (+ 127us) server_negotiation.cc:299] Negotiation successful
0809 19:10:28.892951 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 19:10:28.894157 23332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:28.888446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:37091 (local address 127.7.39.1:51375)
0809 19:10:28.889347 (+ 901us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:28.889384 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:28.890909 (+ 1525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:28.891526 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:28.891533 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:28.891634 (+ 101us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:28.892256 (+ 622us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:10:28.892258 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:28.892296 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:10:28.892378 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:10:28.892743 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:10:28.892748 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:10:28.892753 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 19:10:28.892950 (+ 197us) client_negotiation.cc:240] Negotiation successful
0809 19:10:28.893142 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":259,"threads_started":1}
I20260809 19:10:28.894343 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 23131
I20260809 19:10:28.894552 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance
I20260809 19:10:28.895159 7324 external_mini_cluster.cc:1428] Setting key 7293f69443f1759b3ee4f1c53568e7c4
I20260809 19:10:28.895675 23329 heartbeater.cc:347] Connected to a master server at 127.7.39.62:37091
I20260809 19:10:28.895949 23329 heartbeater.cc:464] Registering TS with master...
I20260809 19:10:28.896618 23329 heartbeater.cc:511] Master 127.7.39.62:37091 requested a full tablet report, sending...
I20260809 19:10:28.897995 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.2:0
--local_ip_for_outbound_sockets=127.7.39.2
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:37091
--builtin_ntp_servers=127.7.39.20:35713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260809 19:10:28.898949 23044 ts_manager.cc:194] Registered new tserver with Master: 12bc570341644ca99d79b23a770b8ab2 (127.7.39.1:33075)
W20260809 19:10:29.217790 23333 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:10:29.218043 23333 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:10:29.218129 23333 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:10:29.225021 23333 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:10:29.225106 23333 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:10:29.225230 23333 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.2
I20260809 19:10:29.233680 23333 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:35713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:37091
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.2
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:10:29.234822 23333 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:10:29.236461 23333 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:10:29.248596 23339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:29.248603 23340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:29.248658 23344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:10:29.249492 23333 server_base.cc:1034] running on GCE node
I20260809 19:10:29.250068 23333 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:10:29.250957 23333 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:10:29.252178 23333 hybrid_clock.cc:648] HybridClock initialized: now 1786302629252123 us; error 47 us; skew 500 ppm
I20260809 19:10:29.252486 23333 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:10:29.254608 23333 webserver.cc:460] Webserver started at http://127.7.39.2:46451/ using document root <none> and password file <none>
I20260809 19:10:29.255247 23333 fs_manager.cc:359] Metadata directory not provided
I20260809 19:10:29.255344 23333 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:10:29.255662 23333 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:10:29.260891 23333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/data/instance:
uuid: "8fde65dc6ae848fa8a174c3b740233fb"
format_stamp: "Formatted at 2026-08-09 19:10:29 on dist-test-slave-4tdj"
server_key: "444dab4ce201874384961ea3ba812c2f"
server_key_iv: "dc26b4de9e3708f6c0b846d2a293bac2"
server_key_version: "encryptionkey@0"
I20260809 19:10:29.261700 23333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance:
uuid: "8fde65dc6ae848fa8a174c3b740233fb"
format_stamp: "Formatted at 2026-08-09 19:10:29 on dist-test-slave-4tdj"
server_key: "444dab4ce201874384961ea3ba812c2f"
server_key_iv: "dc26b4de9e3708f6c0b846d2a293bac2"
server_key_version: "encryptionkey@0"
I20260809 19:10:29.266567 23333 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 19:10:29.269757 23350 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:29.271020 23333 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:10:29.271248 23333 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/wal
uuid: "8fde65dc6ae848fa8a174c3b740233fb"
format_stamp: "Formatted at 2026-08-09 19:10:29 on dist-test-slave-4tdj"
server_key: "444dab4ce201874384961ea3ba812c2f"
server_key_iv: "dc26b4de9e3708f6c0b846d2a293bac2"
server_key_version: "encryptionkey@0"
I20260809 19:10:29.271466 23333 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:10:29.276559 23333 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:10:29.277352 23333 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:10:29.277643 23333 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:10:29.278575 23333 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:10:29.279824 23333 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:10:29.279906 23333 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:29.279982 23333 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:10:29.280038 23333 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:29.308238 23333 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.2:32823
I20260809 19:10:29.308287 23536 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.2:32823 every 8 connection(s)
I20260809 19:10:29.309454 23333 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
I20260809 19:10:29.312041 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 23333
I20260809 19:10:29.312223 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance
I20260809 19:10:29.312659 7324 external_mini_cluster.cc:1428] Setting key 6e678166c82bad69aebc348990ab0605
I20260809 19:10:29.315349 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.3:0
--local_ip_for_outbound_sockets=127.7.39.3
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:37091
--builtin_ntp_servers=127.7.39.20:35713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260809 19:10:29.317430 23103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:29.311936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:54657 (local address 127.7.39.62:37091)
0809 19:10:29.312155 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:29.312161 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:29.313626 (+ 1465us) server_negotiation.cc:407] Connection header received
0809 19:10:29.315288 (+ 1662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:29.315294 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:29.315361 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:29.315474 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:29.316757 (+ 1283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:29.316763 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:29.316768 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:10:29.316788 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:29.316825 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:10:29.316839 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:29.316955 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:29.317092 (+ 137us) server_negotiation.cc:299] Negotiation successful
0809 19:10:29.317152 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 19:10:29.318310 23541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:29.312441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:37091 (local address 127.7.39.2:54657)
0809 19:10:29.313477 (+ 1036us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:29.313522 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:29.315022 (+ 1500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:29.315755 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:29.315762 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:29.315848 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:29.316473 (+ 625us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:10:29.316475 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:29.316510 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:10:29.316592 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:10:29.316922 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:10:29.316928 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:10:29.316933 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 19:10:29.317131 (+ 198us) client_negotiation.cc:240] Negotiation successful
0809 19:10:29.317324 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":322,"threads_started":1}
I20260809 19:10:29.319643 23537 heartbeater.cc:347] Connected to a master server at 127.7.39.62:37091
I20260809 19:10:29.319911 23537 heartbeater.cc:464] Registering TS with master...
I20260809 19:10:29.320444 23537 heartbeater.cc:511] Master 127.7.39.62:37091 requested a full tablet report, sending...
I20260809 19:10:29.321815 23044 ts_manager.cc:194] Registered new tserver with Master: 8fde65dc6ae848fa8a174c3b740233fb (127.7.39.2:32823)
W20260809 19:10:29.630213 23543 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:10:29.630486 23543 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:10:29.630623 23543 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:10:29.637514 23543 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:10:29.637612 23543 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:10:29.637753 23543 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.3
I20260809 19:10:29.646384 23543 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:35713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:37091
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.3
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:10:29.647511 23543 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:10:29.649214 23543 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:10:29.661398 23551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:29.661370 23552 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:29.661929 23554 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:10:29.662210 23543 server_base.cc:1034] running on GCE node
I20260809 19:10:29.662797 23543 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:10:29.663653 23543 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:10:29.664847 23543 hybrid_clock.cc:648] HybridClock initialized: now 1786302629664792 us; error 43 us; skew 500 ppm
I20260809 19:10:29.665138 23543 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:10:29.667140 23543 webserver.cc:460] Webserver started at http://127.7.39.3:40957/ using document root <none> and password file <none>
I20260809 19:10:29.667773 23543 fs_manager.cc:359] Metadata directory not provided
I20260809 19:10:29.667876 23543 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:10:29.668179 23543 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:10:29.670882 23543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/data/instance:
uuid: "2c2690209d71405899e44d7d95163236"
format_stamp: "Formatted at 2026-08-09 19:10:29 on dist-test-slave-4tdj"
server_key: "93d4a95fdba2a2c6a8e4c25941b849a3"
server_key_iv: "ee19116773cecc8db688d61d4c31df19"
server_key_version: "encryptionkey@0"
I20260809 19:10:29.671626 23543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance:
uuid: "2c2690209d71405899e44d7d95163236"
format_stamp: "Formatted at 2026-08-09 19:10:29 on dist-test-slave-4tdj"
server_key: "93d4a95fdba2a2c6a8e4c25941b849a3"
server_key_iv: "ee19116773cecc8db688d61d4c31df19"
server_key_version: "encryptionkey@0"
I20260809 19:10:29.676357 23543 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 19:10:29.679487 23565 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:29.680662 23543 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 19:10:29.680814 23543 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/wal
uuid: "2c2690209d71405899e44d7d95163236"
format_stamp: "Formatted at 2026-08-09 19:10:29 on dist-test-slave-4tdj"
server_key: "93d4a95fdba2a2c6a8e4c25941b849a3"
server_key_iv: "ee19116773cecc8db688d61d4c31df19"
server_key_version: "encryptionkey@0"
I20260809 19:10:29.680994 23543 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:10:29.686153 23543 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:10:29.686882 23543 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:10:29.687126 23543 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:10:29.687927 23543 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:10:29.689193 23543 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:10:29.689285 23543 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:29.689392 23543 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:10:29.689462 23543 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:29.718519 23543 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.3:36499
I20260809 19:10:29.718581 23737 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.3:36499 every 8 connection(s)
I20260809 19:10:29.719724 23543 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
I20260809 19:10:29.727659 23103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:29.722121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:55141 (local address 127.7.39.62:37091)
0809 19:10:29.722320 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:29.722327 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:29.723723 (+ 1396us) server_negotiation.cc:407] Connection header received
0809 19:10:29.725351 (+ 1628us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:29.725357 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:29.725419 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:29.725518 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:29.726929 (+ 1411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:29.726935 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:29.726941 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:10:29.726960 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:29.726995 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:10:29.727006 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:29.727121 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:29.727296 (+ 175us) server_negotiation.cc:299] Negotiation successful
0809 19:10:29.727363 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 19:10:29.728442 23744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:29.722689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:37091 (local address 127.7.39.3:55141)
0809 19:10:29.723573 (+ 884us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:29.723614 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:29.725086 (+ 1472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:29.725734 (+ 648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:29.725742 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:29.725823 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:29.726635 (+ 812us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:10:29.726638 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:29.726676 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:10:29.726760 (+ 84us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:10:29.727093 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:10:29.727104 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:10:29.727112 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 19:10:29.727358 (+ 246us) client_negotiation.cc:240] Negotiation successful
0809 19:10:29.727589 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":266,"threads_started":1}
I20260809 19:10:29.728758 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 23543
I20260809 19:10:29.728940 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance
I20260809 19:10:29.729466 7324 external_mini_cluster.cc:1428] Setting key b9fe8375f18888ec82cee8736b926389
I20260809 19:10:29.729660 23740 heartbeater.cc:347] Connected to a master server at 127.7.39.62:37091
I20260809 19:10:29.729929 23740 heartbeater.cc:464] Registering TS with master...
I20260809 19:10:29.730584 23740 heartbeater.cc:511] Master 127.7.39.62:37091 requested a full tablet report, sending...
I20260809 19:10:29.732004 23042 ts_manager.cc:194] Registered new tserver with Master: 2c2690209d71405899e44d7d95163236 (127.7.39.3:36499)
I20260809 19:10:29.744460 7324 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 19:10:29.750310 23103 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:10:29.748760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50588 (local address 127.7.39.62:37091)
0809 19:10:29.748964 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:29.748970 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:29.749414 (+ 444us) server_negotiation.cc:407] Connection header received
0809 19:10:29.749575 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:29.749579 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:29.749623 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:29.749696 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:29.750074 (+ 378us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50588: BlockingRecv error: recv got EOF from 127.0.0.1:50588 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
I20260809 19:10:29.751164 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 23131
I20260809 19:10:29.754406 23752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:29.751969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49554 (local address 127.7.39.1:33075)
0809 19:10:29.752430 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:29.752436 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:29.752458 (+ 22us) server_negotiation.cc:407] Connection header received
0809 19:10:29.752509 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:29.752515 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:29.752686 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:29.752815 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:29.753703 (+ 888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:29.753709 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:29.753718 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:10:29.753736 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:29.753773 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:10:29.753786 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:29.753899 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:29.754022 (+ 123us) server_negotiation.cc:299] Negotiation successful
0809 19:10:29.754126 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":192,"threads_started":1}
I20260809 19:10:29.755453 23320 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:10:29.833053 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 23131
I20260809 19:10:29.851253 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 23333
I20260809 19:10:29.854807 23756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:29.852191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45308 (local address 127.7.39.2:32823)
0809 19:10:29.852687 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:29.852694 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:29.852721 (+ 27us) server_negotiation.cc:407] Connection header received
0809 19:10:29.852781 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:29.852787 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:29.853007 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:29.853148 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:29.854094 (+ 946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:29.854101 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:29.854112 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:10:29.854131 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:29.854172 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:10:29.854185 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:29.854323 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:29.854464 (+ 141us) server_negotiation.cc:299] Negotiation successful
0809 19:10:29.854566 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":237,"threads_started":1}
I20260809 19:10:29.855983 23531 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:10:29.934652 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 23333
I20260809 19:10:29.952023 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 23543
I20260809 19:10:29.955886 23759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:29.952946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40784 (local address 127.7.39.3:36499)
0809 19:10:29.953589 (+ 643us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:29.953596 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:29.953627 (+ 31us) server_negotiation.cc:407] Connection header received
0809 19:10:29.953689 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:29.953695 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:29.953906 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:29.954057 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:29.955174 (+ 1117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:29.955180 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:29.955191 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:10:29.955208 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:29.955246 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:10:29.955260 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:29.955421 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:29.955495 (+ 74us) server_negotiation.cc:299] Negotiation successful
0809 19:10:29.955597 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":481,"thread_start_us":314,"threads_started":1}
I20260809 19:10:29.957099 23728 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:10:30.036185 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 23543
I20260809 19:10:30.063287 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 22995
I20260809 19:10:30.064440 23088 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:10:30.163872 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 22995
2026-08-09T19:10:30Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2251 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:10:30 dist-test-slave-4tdj krb5kdc[23765](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:10:30 dist-test-slave-4tdj krb5kdc[23765](info): set up 2 sockets
Aug 09 19:10:30 dist-test-slave-4tdj krb5kdc[23765](info): commencing operation
krb5kdc: starting...
W20260809 19:10:31.393198 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.182s user 0.003s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:10:31 dist-test-slave-4tdj krb5kdc[23765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302631, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:10:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:10:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.39.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
I20260809 19:10:31.609447 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:39599
--webserver_interface=127.7.39.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:32893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:39599
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:10:31.927910 23788 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:10:31.928167 23788 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:10:31.928261 23788 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:10:31.935163 23788 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:10:31.935259 23788 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:10:31.935312 23788 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:10:31.935367 23788 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:10:31.935411 23788 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:10:31.944693 23788 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:32893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:39599
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:39599
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:10:31.945853 23788 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:10:31.947113 23788 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:10:31.957648 23800 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:31.957723 23796 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:31.957700 23797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:10:31.958679 23788 server_base.cc:1034] running on GCE node
I20260809 19:10:31.959378 23788 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:10:31.960582 23788 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:10:31.961815 23788 hybrid_clock.cc:648] HybridClock initialized: now 1786302631961747 us; error 44 us; skew 500 ppm
I20260809 19:10:31.962152 23788 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:10:31 dist-test-slave-4tdj krb5kdc[23765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302631, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:10:31.964996 23788 init.cc:377] Logged in from keytab as kudu/127.7.39.62@KRBTEST.COM (short username kudu)
I20260809 19:10:31.966331 23788 webserver.cc:460] Webserver started at http://127.7.39.62:35681/ using document root <none> and password file <none>
I20260809 19:10:31.966953 23788 fs_manager.cc:359] Metadata directory not provided
I20260809 19:10:31.967077 23788 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:10:31.967381 23788 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:10:31.970166 23788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "9d1c364536ad4cfdbdbb7e476be445f9"
format_stamp: "Formatted at 2026-08-09 19:10:31 on dist-test-slave-4tdj"
server_key: "115a0fb706acdd60204b8b2a6e3b7573"
server_key_iv: "d558ae873ff53be550fd2007888376a2"
server_key_version: "encryptionkey@0"
I20260809 19:10:31.970906 23788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "9d1c364536ad4cfdbdbb7e476be445f9"
format_stamp: "Formatted at 2026-08-09 19:10:31 on dist-test-slave-4tdj"
server_key: "115a0fb706acdd60204b8b2a6e3b7573"
server_key_iv: "d558ae873ff53be550fd2007888376a2"
server_key_version: "encryptionkey@0"
I20260809 19:10:31.975603 23788 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260809 19:10:31.978844 23810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:31.980057 23788 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260809 19:10:31.980214 23788 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "9d1c364536ad4cfdbdbb7e476be445f9"
format_stamp: "Formatted at 2026-08-09 19:10:31 on dist-test-slave-4tdj"
server_key: "115a0fb706acdd60204b8b2a6e3b7573"
server_key_iv: "d558ae873ff53be550fd2007888376a2"
server_key_version: "encryptionkey@0"
I20260809 19:10:31.980379 23788 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:10:31.994153 23788 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:10:31.997516 23788 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:10:31.997749 23788 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:10:32.013779 23788 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:39599
I20260809 19:10:32.013808 23883 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:39599 every 8 connection(s)
I20260809 19:10:32.015000 23788 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:10:32.018347 23884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:10:32.018822 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 23788
I20260809 19:10:32.019065 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:10:32.019861 7324 external_mini_cluster.cc:1428] Setting key 3b70259d2c86f74a0a61a10044115f59
I20260809 19:10:32.031625 23884 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d1c364536ad4cfdbdbb7e476be445f9: Bootstrap starting.
Aug 09 19:10:32 dist-test-slave-4tdj krb5kdc[23765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302631, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:10:32.035110 23884 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d1c364536ad4cfdbdbb7e476be445f9: Neither blocks nor log segments found. Creating new log.
I20260809 19:10:32.036103 23884 log.cc:824] T 00000000000000000000000000000000 P 9d1c364536ad4cfdbdbb7e476be445f9: Log is configured to *not* fsync() on all Append() calls
I20260809 19:10:32.038883 23884 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d1c364536ad4cfdbdbb7e476be445f9: No bootstrap required, opened a new log
I20260809 19:10:32.042146 23891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:32.021803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43854 (local address 127.7.39.62:39599)
0809 19:10:32.022556 (+ 753us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:32.022567 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:32.022606 (+ 39us) server_negotiation.cc:407] Connection header received
0809 19:10:32.024440 (+ 1834us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:32.024466 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:32.024821 (+ 355us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:32.025132 (+ 311us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:32.026835 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:32.028090 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:32.029813 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:32.030631 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:32.030773 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:32.035200 (+ 4427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:32.035212 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:32.035230 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:10:32.035268 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:32.038355 (+ 3087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:32.038952 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:32.038959 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:32.038965 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:32.039151 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:32.039515 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:32.039521 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:32.039524 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:32.040037 (+ 513us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:32.040343 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:32.040782 (+ 439us) server_negotiation.cc:299] Negotiation successful
0809 19:10:32.041186 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":534,"thread_start_us":311,"threads_started":1}
I20260809 19:10:32.046389 23884 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9d1c364536ad4cfdbdbb7e476be445f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d1c364536ad4cfdbdbb7e476be445f9" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39599 } }
I20260809 19:10:32.046720 23884 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9d1c364536ad4cfdbdbb7e476be445f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:10:32.046809 23884 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9d1c364536ad4cfdbdbb7e476be445f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d1c364536ad4cfdbdbb7e476be445f9, State: Initialized, Role: FOLLOWER
I20260809 19:10:32.047289 23884 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d1c364536ad4cfdbdbb7e476be445f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d1c364536ad4cfdbdbb7e476be445f9" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39599 } }
I20260809 19:10:32.047489 23884 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9d1c364536ad4cfdbdbb7e476be445f9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:10:32.047617 23884 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9d1c364536ad4cfdbdbb7e476be445f9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:10:32.047765 23884 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9d1c364536ad4cfdbdbb7e476be445f9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:10:32.049999 23884 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9d1c364536ad4cfdbdbb7e476be445f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d1c364536ad4cfdbdbb7e476be445f9" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39599 } }
I20260809 19:10:32.050508 23884 leader_election.cc:302] T 00000000000000000000000000000000 P 9d1c364536ad4cfdbdbb7e476be445f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9d1c364536ad4cfdbdbb7e476be445f9; no voters:
I20260809 19:10:32.051031 23884 leader_election.cc:288] T 00000000000000000000000000000000 P 9d1c364536ad4cfdbdbb7e476be445f9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:10:32.051128 23893 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9d1c364536ad4cfdbdbb7e476be445f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:10:32.051728 23893 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9d1c364536ad4cfdbdbb7e476be445f9 [term 1 LEADER]: Becoming Leader. State: Replica: 9d1c364536ad4cfdbdbb7e476be445f9, State: Running, Role: LEADER
I20260809 19:10:32.052215 23893 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d1c364536ad4cfdbdbb7e476be445f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d1c364536ad4cfdbdbb7e476be445f9" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39599 } }
I20260809 19:10:32.052883 23884 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9d1c364536ad4cfdbdbb7e476be445f9 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:10:32.054806 23895 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d1c364536ad4cfdbdbb7e476be445f9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d1c364536ad4cfdbdbb7e476be445f9. Latest consensus state: current_term: 1 leader_uuid: "9d1c364536ad4cfdbdbb7e476be445f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d1c364536ad4cfdbdbb7e476be445f9" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39599 } } }
I20260809 19:10:32.055001 23894 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d1c364536ad4cfdbdbb7e476be445f9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9d1c364536ad4cfdbdbb7e476be445f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d1c364536ad4cfdbdbb7e476be445f9" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39599 } } }
I20260809 19:10:32.055320 23894 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d1c364536ad4cfdbdbb7e476be445f9 [sys.catalog]: This master's current role is: LEADER
I20260809 19:10:32.055341 23895 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d1c364536ad4cfdbdbb7e476be445f9 [sys.catalog]: This master's current role is: LEADER
I20260809 19:10:32.057439 23902 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:10:32.062341 23902 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:10:32.070779 23902 catalog_manager.cc:1347] Generated new cluster ID: 0c369f38c5c349069950ef05438533a5
I20260809 19:10:32.070866 23902 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:10:32.085876 23902 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:10:32.087621 23902 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:10:32.098897 23902 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9d1c364536ad4cfdbdbb7e476be445f9: Generated new TSK 0
I20260809 19:10:32.099895 23902 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.39.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
I20260809 19:10:32.161881 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.1:0
--local_ip_for_outbound_sockets=127.7.39.1
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:39599
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:32893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:10:32.477397 23924 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:10:32.477660 23924 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:10:32.477758 23924 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:10:32.484838 23924 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:10:32.484952 23924 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:10:32.485074 23924 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.1
I20260809 19:10:32.494623 23924 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:32893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:39599
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.1
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:10:32.495756 23924 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:10:32.496991 23924 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:10:32.509443 23933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:32.509472 23936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:32.509662 23932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:10:32.510146 23924 server_base.cc:1034] running on GCE node
I20260809 19:10:32.510788 23924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:10:32.511631 23924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:10:32.512820 23924 hybrid_clock.cc:648] HybridClock initialized: now 1786302632512779 us; error 30 us; skew 500 ppm
I20260809 19:10:32.513098 23924 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:10:32 dist-test-slave-4tdj krb5kdc[23765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302632, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:10:32.519419 23924 init.cc:377] Logged in from keytab as kudu/127.7.39.1@KRBTEST.COM (short username kudu)
I20260809 19:10:32.520774 23924 webserver.cc:460] Webserver started at http://127.7.39.1:36783/ using document root <none> and password file <none>
I20260809 19:10:32.521395 23924 fs_manager.cc:359] Metadata directory not provided
I20260809 19:10:32.521518 23924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:10:32.521791 23924 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:10:32.524574 23924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/data/instance:
uuid: "49493042ccdc4686892552fa61bec7a3"
format_stamp: "Formatted at 2026-08-09 19:10:32 on dist-test-slave-4tdj"
server_key: "3aff510926511567d014266e506c832f"
server_key_iv: "b126634cc1a5b99c91b5b1daab87648f"
server_key_version: "encryptionkey@0"
I20260809 19:10:32.525318 23924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance:
uuid: "49493042ccdc4686892552fa61bec7a3"
format_stamp: "Formatted at 2026-08-09 19:10:32 on dist-test-slave-4tdj"
server_key: "3aff510926511567d014266e506c832f"
server_key_iv: "b126634cc1a5b99c91b5b1daab87648f"
server_key_version: "encryptionkey@0"
I20260809 19:10:32.530068 23924 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.003s
I20260809 19:10:32.533252 23953 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:32.534458 23924 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 19:10:32.534612 23924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/wal
uuid: "49493042ccdc4686892552fa61bec7a3"
format_stamp: "Formatted at 2026-08-09 19:10:32 on dist-test-slave-4tdj"
server_key: "3aff510926511567d014266e506c832f"
server_key_iv: "b126634cc1a5b99c91b5b1daab87648f"
server_key_version: "encryptionkey@0"
I20260809 19:10:32.534785 23924 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:10:32.562038 23924 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:10:32.565629 23924 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:10:32.565873 23924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:10:32.566771 23924 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:10:32.568017 23924 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:10:32.568094 23924 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:32.568205 23924 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:10:32.568259 23924 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:32.599640 23924 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.1:37617
I20260809 19:10:32.599709 24128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.1:37617 every 8 connection(s)
I20260809 19:10:32.600807 23924 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
I20260809 19:10:32.603104 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 23924
I20260809 19:10:32.603307 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance
I20260809 19:10:32.604017 7324 external_mini_cluster.cc:1428] Setting key 10d57b230c7b3f4dfa3e0c447a46a905
Aug 09 19:10:32 dist-test-slave-4tdj krb5kdc[23765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302632, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:10:32.619378 24131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:32.603185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:55873 (local address 127.7.39.62:39599)
0809 19:10:32.603672 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:32.603679 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:32.604600 (+ 921us) server_negotiation.cc:407] Connection header received
0809 19:10:32.606372 (+ 1772us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:32.606378 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:32.606448 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:32.606547 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:32.607935 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:32.608638 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:32.610107 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:32.610538 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:32.610650 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:32.613742 (+ 3092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:32.613747 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:32.613750 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:10:32.613782 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:32.616498 (+ 2716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:32.617247 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:32.617251 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:32.617254 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:32.617379 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:32.617817 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:32.617820 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:32.617822 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:32.618059 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:32.618160 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:32.618975 (+ 815us) server_negotiation.cc:299] Negotiation successful
0809 19:10:32.619137 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":215,"threads_started":1}
I20260809 19:10:32.620630 24133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:32.603690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39599 (local address 127.7.39.1:55873)
0809 19:10:32.604430 (+ 740us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:32.604482 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:32.606103 (+ 1621us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:32.606779 (+ 676us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:32.606787 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:32.607253 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:32.607774 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:32.607791 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:32.608782 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:32.608786 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:32.609960 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:32.609972 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:32.610748 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:32.610755 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:32.610963 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:32.611542 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:32.611563 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:32.613549 (+ 1986us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:10:32.616620 (+ 3071us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:10:32.616628 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:10:32.616643 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:10:32.617134 (+ 491us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:10:32.617493 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:10:32.617498 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:10:32.617501 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:10:32.617725 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:10:32.618185 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:10:32.618192 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:10:32.618610 (+ 418us) client_negotiation.cc:769] Sending connection context
0809 19:10:32.618897 (+ 287us) client_negotiation.cc:240] Negotiation successful
0809 19:10:32.619342 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":300,"threads_started":1}
I20260809 19:10:32.622004 24129 heartbeater.cc:347] Connected to a master server at 127.7.39.62:39599
I20260809 19:10:32.622270 24129 heartbeater.cc:464] Registering TS with master...
I20260809 19:10:32.622951 24129 heartbeater.cc:511] Master 127.7.39.62:39599 requested a full tablet report, sending...
I20260809 19:10:32.624861 23834 ts_manager.cc:194] Registered new tserver with Master: 49493042ccdc4686892552fa61bec7a3 (127.7.39.1:37617)
I20260809 19:10:32.626250 23834 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.1@KRBTEST.COM'} at 127.7.39.1:55873
WARNING: no policy specified for kudu/127.7.39.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
I20260809 19:10:32.657023 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.2:0
--local_ip_for_outbound_sockets=127.7.39.2
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:39599
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:32893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:10:32.969005 24138 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:10:32.969280 24138 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:10:32.969405 24138 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:10:32.976300 24138 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:10:32.976411 24138 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:10:32.976564 24138 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.2
I20260809 19:10:32.986166 24138 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:32893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:39599
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.2
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:10:32.987393 24138 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:10:32.988677 24138 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:10:33.001029 24158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:33.001192 24156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:33.001165 24154 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:10:33.001962 24138 server_base.cc:1034] running on GCE node
I20260809 19:10:33.002633 24138 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:10:33.003479 24138 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:10:33.004675 24138 hybrid_clock.cc:648] HybridClock initialized: now 1786302633004620 us; error 45 us; skew 500 ppm
I20260809 19:10:33.004956 24138 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:10:33 dist-test-slave-4tdj krb5kdc[23765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302633, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:10:33.007869 24138 init.cc:377] Logged in from keytab as kudu/127.7.39.2@KRBTEST.COM (short username kudu)
I20260809 19:10:33.009128 24138 webserver.cc:460] Webserver started at http://127.7.39.2:33343/ using document root <none> and password file <none>
I20260809 19:10:33.009769 24138 fs_manager.cc:359] Metadata directory not provided
I20260809 19:10:33.009882 24138 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:10:33.010175 24138 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:10:33.012915 24138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/data/instance:
uuid: "4fa2a2cc243742b7adcf7526e209cb57"
format_stamp: "Formatted at 2026-08-09 19:10:33 on dist-test-slave-4tdj"
server_key: "7d60faf0486f69845eb2045511c8904f"
server_key_iv: "129dcb6b5ace567bb18f08f46e21a523"
server_key_version: "encryptionkey@0"
I20260809 19:10:33.013855 24138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance:
uuid: "4fa2a2cc243742b7adcf7526e209cb57"
format_stamp: "Formatted at 2026-08-09 19:10:33 on dist-test-slave-4tdj"
server_key: "7d60faf0486f69845eb2045511c8904f"
server_key_iv: "129dcb6b5ace567bb18f08f46e21a523"
server_key_version: "encryptionkey@0"
I20260809 19:10:33.020092 24138 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260809 19:10:33.024282 24167 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:33.025718 24138 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 19:10:33.025877 24138 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/wal
uuid: "4fa2a2cc243742b7adcf7526e209cb57"
format_stamp: "Formatted at 2026-08-09 19:10:33 on dist-test-slave-4tdj"
server_key: "7d60faf0486f69845eb2045511c8904f"
server_key_iv: "129dcb6b5ace567bb18f08f46e21a523"
server_key_version: "encryptionkey@0"
I20260809 19:10:33.026072 24138 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:10:33.041139 24138 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:10:33.045034 24138 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:10:33.045298 24138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:10:33.046167 24138 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:10:33.047457 24138 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:10:33.047535 24138 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:33.047653 24138 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:10:33.047712 24138 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:33.076433 24138 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.2:38597
I20260809 19:10:33.076471 24352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.2:38597 every 8 connection(s)
I20260809 19:10:33.077701 24138 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
I20260809 19:10:33.085740 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 24138
I20260809 19:10:33.085938 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance
I20260809 19:10:33.086527 7324 external_mini_cluster.cc:1428] Setting key 574ad0da624543ae74982e7f3be2ba65
Aug 09 19:10:33 dist-test-slave-4tdj krb5kdc[23765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302633, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:10:33.098023 24131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:33.080185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:57243 (local address 127.7.39.62:39599)
0809 19:10:33.080365 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:33.080369 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:33.081446 (+ 1077us) server_negotiation.cc:407] Connection header received
0809 19:10:33.083272 (+ 1826us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:33.083278 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:33.083380 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:33.083479 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:33.085309 (+ 1830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.086389 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.088058 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.088610 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.088706 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:33.092644 (+ 3938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:33.092648 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:33.092652 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:10:33.092683 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:33.095187 (+ 2504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:33.095973 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:33.095977 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:33.095979 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:33.096113 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:33.096537 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:33.096540 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:33.096542 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:33.096779 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:33.096884 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:33.097625 (+ 741us) server_negotiation.cc:299] Negotiation successful
0809 19:10:33.097787 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 19:10:33.099349 24357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:33.080596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39599 (local address 127.7.39.2:57243)
0809 19:10:33.081283 (+ 687us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:33.081328 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:33.083004 (+ 1676us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:33.083796 (+ 792us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:33.083806 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:33.084528 (+ 722us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:33.085116 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:33.085134 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.086524 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.086528 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:33.087911 (+ 1383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:33.087922 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.088837 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.088845 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:33.089133 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:33.089818 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:33.089846 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:33.092422 (+ 2576us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:10:33.095326 (+ 2904us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:10:33.095335 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:10:33.095353 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:10:33.095878 (+ 525us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:10:33.096205 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:10:33.096210 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:10:33.096213 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:10:33.096450 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:10:33.096886 (+ 436us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:10:33.096893 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:10:33.097285 (+ 392us) client_negotiation.cc:769] Sending connection context
0809 19:10:33.097566 (+ 281us) client_negotiation.cc:240] Negotiation successful
0809 19:10:33.098080 (+ 514us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":260,"threads_started":1}
I20260809 19:10:33.100726 24355 heartbeater.cc:347] Connected to a master server at 127.7.39.62:39599
I20260809 19:10:33.101047 24355 heartbeater.cc:464] Registering TS with master...
I20260809 19:10:33.101758 24355 heartbeater.cc:511] Master 127.7.39.62:39599 requested a full tablet report, sending...
I20260809 19:10:33.103202 23834 ts_manager.cc:194] Registered new tserver with Master: 4fa2a2cc243742b7adcf7526e209cb57 (127.7.39.2:38597)
I20260809 19:10:33.103981 23834 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.2@KRBTEST.COM'} at 127.7.39.2:57243
WARNING: no policy specified for kudu/127.7.39.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
I20260809 19:10:33.139669 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.3:0
--local_ip_for_outbound_sockets=127.7.39.3
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:39599
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:32893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:10:33.451983 24363 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:10:33.452265 24363 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:10:33.452399 24363 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:10:33.459856 24363 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:10:33.459968 24363 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:10:33.460121 24363 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.3
I20260809 19:10:33.469385 24363 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:32893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:39599
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.3
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:10:33.470623 24363 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:10:33.471894 24363 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:10:33.484050 24373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:33.484207 24375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:10:33.484136 24371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:10:33.485059 24363 server_base.cc:1034] running on GCE node
I20260809 19:10:33.485642 24363 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:10:33.486510 24363 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:10:33.487712 24363 hybrid_clock.cc:648] HybridClock initialized: now 1786302633487666 us; error 40 us; skew 500 ppm
I20260809 19:10:33.487993 24363 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:10:33 dist-test-slave-4tdj krb5kdc[23765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302633, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:10:33.490942 24363 init.cc:377] Logged in from keytab as kudu/127.7.39.3@KRBTEST.COM (short username kudu)
I20260809 19:10:33.492237 24363 webserver.cc:460] Webserver started at http://127.7.39.3:43097/ using document root <none> and password file <none>
I20260809 19:10:33.492841 24363 fs_manager.cc:359] Metadata directory not provided
I20260809 19:10:33.492935 24363 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:10:33.493177 24363 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:10:33.495939 24363 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/data/instance:
uuid: "1eef58436a26415cadaad201e403bac8"
format_stamp: "Formatted at 2026-08-09 19:10:33 on dist-test-slave-4tdj"
server_key: "7b975500aad021d915ff9a90e5fa4683"
server_key_iv: "6698224ac8ae3cfcd8f01b0aeac337af"
server_key_version: "encryptionkey@0"
I20260809 19:10:33.496667 24363 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance:
uuid: "1eef58436a26415cadaad201e403bac8"
format_stamp: "Formatted at 2026-08-09 19:10:33 on dist-test-slave-4tdj"
server_key: "7b975500aad021d915ff9a90e5fa4683"
server_key_iv: "6698224ac8ae3cfcd8f01b0aeac337af"
server_key_version: "encryptionkey@0"
I20260809 19:10:33.501413 24363 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 19:10:33.504698 24385 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:33.506037 24363 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 19:10:33.506170 24363 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/wal
uuid: "1eef58436a26415cadaad201e403bac8"
format_stamp: "Formatted at 2026-08-09 19:10:33 on dist-test-slave-4tdj"
server_key: "7b975500aad021d915ff9a90e5fa4683"
server_key_iv: "6698224ac8ae3cfcd8f01b0aeac337af"
server_key_version: "encryptionkey@0"
I20260809 19:10:33.506398 24363 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:10:33.524614 24363 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:10:33.528196 24363 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:10:33.528421 24363 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:10:33.529273 24363 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:10:33.530507 24363 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:10:33.530579 24363 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:33.530680 24363 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:10:33.530737 24363 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:10:33.559968 24363 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.3:38173
I20260809 19:10:33.560012 24576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.3:38173 every 8 connection(s)
I20260809 19:10:33.561178 24363 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
I20260809 19:10:33.569778 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 24363
I20260809 19:10:33.569985 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance
I20260809 19:10:33.570546 7324 external_mini_cluster.cc:1428] Setting key 51bd7f2a80fa0bf33fd5b0bacfd06ca9
Aug 09 19:10:33 dist-test-slave-4tdj krb5kdc[23765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302633, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:10:33.579427 24131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:33.563559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:37313 (local address 127.7.39.62:39599)
0809 19:10:33.563758 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:33.563764 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:33.564906 (+ 1142us) server_negotiation.cc:407] Connection header received
0809 19:10:33.566626 (+ 1720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:33.566630 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:33.566711 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:33.566797 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:33.568132 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.568909 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.570855 (+ 1946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.571243 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.571335 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:33.574732 (+ 3397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:33.574737 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:33.574740 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:10:33.574773 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:33.576948 (+ 2175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:33.577553 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:33.577556 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:33.577558 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:33.577666 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:33.578005 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:33.578008 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:33.578010 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:33.578317 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:33.578430 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:33.579030 (+ 600us) server_negotiation.cc:299] Negotiation successful
0809 19:10:33.579194 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 19:10:33.580266 24580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:33.564055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39599 (local address 127.7.39.3:37313)
0809 19:10:33.564749 (+ 694us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:33.564793 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:33.566383 (+ 1590us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:33.566977 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:33.566985 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:33.567453 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:10:33.567997 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:33.568013 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.569013 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.569017 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:33.570723 (+ 1706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:33.570739 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.571455 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.571463 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:33.571699 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:33.572339 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:10:33.572371 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:10:33.574535 (+ 2164us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:10:33.577067 (+ 2532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:10:33.577073 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:10:33.577084 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:10:33.577464 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:10:33.577751 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:10:33.577755 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:10:33.577757 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:10:33.577927 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:10:33.578436 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:10:33.578441 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:10:33.578730 (+ 289us) client_negotiation.cc:769] Sending connection context
0809 19:10:33.578936 (+ 206us) client_negotiation.cc:240] Negotiation successful
0809 19:10:33.579324 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":266,"threads_started":1}
I20260809 19:10:33.581382 24577 heartbeater.cc:347] Connected to a master server at 127.7.39.62:39599
I20260809 19:10:33.581651 24577 heartbeater.cc:464] Registering TS with master...
I20260809 19:10:33.582429 24577 heartbeater.cc:511] Master 127.7.39.62:39599 requested a full tablet report, sending...
I20260809 19:10:33.583727 23834 ts_manager.cc:194] Registered new tserver with Master: 1eef58436a26415cadaad201e403bac8 (127.7.39.3:38173)
I20260809 19:10:33.584556 23834 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.3@KRBTEST.COM'} at 127.7.39.3:37313
I20260809 19:10:33.585489 7324 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 19:10:33.600474 24131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:33.589554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43868 (local address 127.7.39.62:39599)
0809 19:10:33.589704 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:33.589708 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:33.590225 (+ 517us) server_negotiation.cc:407] Connection header received
0809 19:10:33.590381 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:33.590384 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:33.590450 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:33.590523 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:33.591765 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.592407 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.593520 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.593894 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.593977 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:33.595906 (+ 1929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:33.595910 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:33.595913 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:10:33.595936 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:33.598066 (+ 2130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:33.598656 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:33.598659 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:33.598661 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:33.598768 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:33.599057 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:33.599061 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:33.599064 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:33.599468 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:33.599710 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:33.599974 (+ 264us) server_negotiation.cc:299] Negotiation successful
0809 19:10:33.600179 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 19:10:33.605824 23834 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43868:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:10:33.612416 23834 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:10:33.628890 24129 heartbeater.cc:503] Master 127.7.39.62:39599 was elected leader, sending a full tablet report...
I20260809 19:10:33.650014 24598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:33.628669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36370 (local address 127.7.39.1:37617)
0809 19:10:33.642757 (+ 14088us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:33.642765 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:33.642794 (+ 29us) server_negotiation.cc:407] Connection header received
0809 19:10:33.642878 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:33.642884 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:33.643142 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:33.643330 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:10:33.644122 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.645341 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.647882 (+ 2541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.648926 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.649039 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:33.649272 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:33.649552 (+ 280us) server_negotiation.cc:299] Negotiation successful
0809 19:10:33.649713 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13933,"thread_start_us":13796,"threads_started":1}
I20260809 19:10:33.650408 24597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:33.628328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:37617 (local address 127.0.0.1:36370)
0809 19:10:33.641139 (+ 12811us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:33.641156 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:33.641255 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:33.643375 (+ 2120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:33.643384 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:33.643419 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:10:33.643895 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:33.643907 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.645506 (+ 1599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.645511 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:33.647728 (+ 2217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:33.647743 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.649112 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.649119 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:33.649341 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:33.649378 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 19:10:33.649495 (+ 117us) client_negotiation.cc:240] Negotiation successful
0809 19:10:33.649678 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12701,"mutex_wait_us":2,"thread_start_us":12990,"threads_started":1}
I20260809 19:10:33.650991 24594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:33.628116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:38597 (local address 127.0.0.1:55480)
0809 19:10:33.640323 (+ 12207us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:33.640374 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:33.640552 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:33.643750 (+ 3198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:33.643754 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:33.643784 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:10:33.644214 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:33.644226 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.646229 (+ 2003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.646234 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:33.648149 (+ 1915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:33.648162 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.650145 (+ 1983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.650152 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:33.650380 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:33.650416 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 19:10:33.650504 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 19:10:33.650619 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11946,"mutex_wait_us":25,"thread_start_us":12620,"threads_started":1}
I20260809 19:10:33.651732 24595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:33.628300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55480 (local address 127.7.39.2:38597)
0809 19:10:33.643000 (+ 14700us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:33.643007 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:33.643032 (+ 25us) server_negotiation.cc:407] Connection header received
0809 19:10:33.643119 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:33.643126 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:33.643329 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:33.643496 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:10:33.644412 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.646058 (+ 1646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.648302 (+ 2244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.649670 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.649790 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:33.649965 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:33.651271 (+ 1306us) server_negotiation.cc:299] Negotiation successful
0809 19:10:33.651431 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14548,"thread_start_us":15199,"threads_started":1}
I20260809 19:10:33.654589 24599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:33.641697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:38173 (local address 127.0.0.1:34006)
0809 19:10:33.646078 (+ 4381us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:33.646094 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:33.646455 (+ 361us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:33.647055 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:33.647060 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:33.647089 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:10:33.647518 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:33.647529 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.649233 (+ 1704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.649238 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:33.651875 (+ 2637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:33.651889 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.653805 (+ 1916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.653811 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:33.653967 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:33.653999 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 19:10:33.654091 (+ 92us) client_negotiation.cc:240] Negotiation successful
0809 19:10:33.654205 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4236,"mutex_wait_us":3,"thread_start_us":4509,"threads_started":1}
I20260809 19:10:33.654698 24600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:33.642223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34006 (local address 127.7.39.3:38173)
0809 19:10:33.643000 (+ 777us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:33.643009 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:33.646182 (+ 3173us) server_negotiation.cc:407] Connection header received
0809 19:10:33.646662 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:33.646670 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:33.646872 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:33.647042 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:10:33.647694 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.649065 (+ 1371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.652024 (+ 2959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.653328 (+ 1304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.653450 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:33.653671 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:33.654154 (+ 483us) server_negotiation.cc:299] Negotiation successful
0809 19:10:33.654375 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":597,"thread_start_us":434,"threads_started":1}
I20260809 19:10:33.654318 24026 tablet_service.cc:1467] Processing CreateTablet for tablet fb5ff56d855c4eb691f3f9fa96532026 (DEFAULT_TABLE table=test-table [id=6523192698c645b8bfb2499564a9e505]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:10:33.654968 24246 tablet_service.cc:1467] Processing CreateTablet for tablet fb5ff56d855c4eb691f3f9fa96532026 (DEFAULT_TABLE table=test-table [id=6523192698c645b8bfb2499564a9e505]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:10:33.655779 24026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb5ff56d855c4eb691f3f9fa96532026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:10:33.656283 24246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb5ff56d855c4eb691f3f9fa96532026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:10:33.658324 24475 tablet_service.cc:1467] Processing CreateTablet for tablet fb5ff56d855c4eb691f3f9fa96532026 (DEFAULT_TABLE table=test-table [id=6523192698c645b8bfb2499564a9e505]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:10:33.659662 24475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb5ff56d855c4eb691f3f9fa96532026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:10:33.666842 24601 tablet_bootstrap.cc:492] T fb5ff56d855c4eb691f3f9fa96532026 P 4fa2a2cc243742b7adcf7526e209cb57: Bootstrap starting.
I20260809 19:10:33.669900 24601 tablet_bootstrap.cc:654] T fb5ff56d855c4eb691f3f9fa96532026 P 4fa2a2cc243742b7adcf7526e209cb57: Neither blocks nor log segments found. Creating new log.
I20260809 19:10:33.669900 24603 tablet_bootstrap.cc:492] T fb5ff56d855c4eb691f3f9fa96532026 P 49493042ccdc4686892552fa61bec7a3: Bootstrap starting.
I20260809 19:10:33.671250 24601 log.cc:824] T fb5ff56d855c4eb691f3f9fa96532026 P 4fa2a2cc243742b7adcf7526e209cb57: Log is configured to *not* fsync() on all Append() calls
I20260809 19:10:33.673270 24603 tablet_bootstrap.cc:654] T fb5ff56d855c4eb691f3f9fa96532026 P 49493042ccdc4686892552fa61bec7a3: Neither blocks nor log segments found. Creating new log.
I20260809 19:10:33.674490 24603 log.cc:824] T fb5ff56d855c4eb691f3f9fa96532026 P 49493042ccdc4686892552fa61bec7a3: Log is configured to *not* fsync() on all Append() calls
I20260809 19:10:33.675330 24608 tablet_bootstrap.cc:492] T fb5ff56d855c4eb691f3f9fa96532026 P 1eef58436a26415cadaad201e403bac8: Bootstrap starting.
I20260809 19:10:33.678913 24608 tablet_bootstrap.cc:654] T fb5ff56d855c4eb691f3f9fa96532026 P 1eef58436a26415cadaad201e403bac8: Neither blocks nor log segments found. Creating new log.
I20260809 19:10:33.680083 24608 log.cc:824] T fb5ff56d855c4eb691f3f9fa96532026 P 1eef58436a26415cadaad201e403bac8: Log is configured to *not* fsync() on all Append() calls
I20260809 19:10:33.680505 24601 tablet_bootstrap.cc:492] T fb5ff56d855c4eb691f3f9fa96532026 P 4fa2a2cc243742b7adcf7526e209cb57: No bootstrap required, opened a new log
I20260809 19:10:33.680807 24601 ts_tablet_manager.cc:1397] T fb5ff56d855c4eb691f3f9fa96532026 P 4fa2a2cc243742b7adcf7526e209cb57: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.009s
I20260809 19:10:33.682832 24608 tablet_bootstrap.cc:492] T fb5ff56d855c4eb691f3f9fa96532026 P 1eef58436a26415cadaad201e403bac8: No bootstrap required, opened a new log
I20260809 19:10:33.683077 24603 tablet_bootstrap.cc:492] T fb5ff56d855c4eb691f3f9fa96532026 P 49493042ccdc4686892552fa61bec7a3: No bootstrap required, opened a new log
I20260809 19:10:33.683210 24608 ts_tablet_manager.cc:1397] T fb5ff56d855c4eb691f3f9fa96532026 P 1eef58436a26415cadaad201e403bac8: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260809 19:10:33.683377 24603 ts_tablet_manager.cc:1397] T fb5ff56d855c4eb691f3f9fa96532026 P 49493042ccdc4686892552fa61bec7a3: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.008s
I20260809 19:10:33.690109 24608 raft_consensus.cc:348] T fb5ff56d855c4eb691f3f9fa96532026 P 1eef58436a26415cadaad201e403bac8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fa2a2cc243742b7adcf7526e209cb57" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 38597 } } peers { permanent_uuid: "49493042ccdc4686892552fa61bec7a3" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 37617 } } peers { permanent_uuid: "1eef58436a26415cadaad201e403bac8" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 38173 } }
I20260809 19:10:33.690464 24608 raft_consensus.cc:374] T fb5ff56d855c4eb691f3f9fa96532026 P 1eef58436a26415cadaad201e403bac8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:10:33.690563 24608 raft_consensus.cc:729] T fb5ff56d855c4eb691f3f9fa96532026 P 1eef58436a26415cadaad201e403bac8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1eef58436a26415cadaad201e403bac8, State: Initialized, Role: FOLLOWER
I20260809 19:10:33.690793 24601 raft_consensus.cc:348] T fb5ff56d855c4eb691f3f9fa96532026 P 4fa2a2cc243742b7adcf7526e209cb57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fa2a2cc243742b7adcf7526e209cb57" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 38597 } } peers { permanent_uuid: "49493042ccdc4686892552fa61bec7a3" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 37617 } } peers { permanent_uuid: "1eef58436a26415cadaad201e403bac8" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 38173 } }
I20260809 19:10:33.691198 24601 raft_consensus.cc:374] T fb5ff56d855c4eb691f3f9fa96532026 P 4fa2a2cc243742b7adcf7526e209cb57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:10:33.691099 24608 consensus_queue.cc:260] T fb5ff56d855c4eb691f3f9fa96532026 P 1eef58436a26415cadaad201e403bac8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fa2a2cc243742b7adcf7526e209cb57" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 38597 } } peers { permanent_uuid: "49493042ccdc4686892552fa61bec7a3" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 37617 } } peers { permanent_uuid: "1eef58436a26415cadaad201e403bac8" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 38173 } }
I20260809 19:10:33.691294 24601 raft_consensus.cc:729] T fb5ff56d855c4eb691f3f9fa96532026 P 4fa2a2cc243742b7adcf7526e209cb57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fa2a2cc243742b7adcf7526e209cb57, State: Initialized, Role: FOLLOWER
I20260809 19:10:33.692148 24577 heartbeater.cc:503] Master 127.7.39.62:39599 was elected leader, sending a full tablet report...
I20260809 19:10:33.692648 24608 ts_tablet_manager.cc:1428] T fb5ff56d855c4eb691f3f9fa96532026 P 1eef58436a26415cadaad201e403bac8: Time spent starting tablet: real 0.009s user 0.009s sys 0.000s
I20260809 19:10:33.692785 24601 consensus_queue.cc:260] T fb5ff56d855c4eb691f3f9fa96532026 P 4fa2a2cc243742b7adcf7526e209cb57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fa2a2cc243742b7adcf7526e209cb57" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 38597 } } peers { permanent_uuid: "49493042ccdc4686892552fa61bec7a3" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 37617 } } peers { permanent_uuid: "1eef58436a26415cadaad201e403bac8" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 38173 } }
I20260809 19:10:33.693234 24603 raft_consensus.cc:348] T fb5ff56d855c4eb691f3f9fa96532026 P 49493042ccdc4686892552fa61bec7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fa2a2cc243742b7adcf7526e209cb57" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 38597 } } peers { permanent_uuid: "49493042ccdc4686892552fa61bec7a3" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 37617 } } peers { permanent_uuid: "1eef58436a26415cadaad201e403bac8" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 38173 } }
I20260809 19:10:33.693679 24603 raft_consensus.cc:374] T fb5ff56d855c4eb691f3f9fa96532026 P 49493042ccdc4686892552fa61bec7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:10:33.693825 24603 raft_consensus.cc:729] T fb5ff56d855c4eb691f3f9fa96532026 P 49493042ccdc4686892552fa61bec7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49493042ccdc4686892552fa61bec7a3, State: Initialized, Role: FOLLOWER
I20260809 19:10:33.693859 24355 heartbeater.cc:503] Master 127.7.39.62:39599 was elected leader, sending a full tablet report...
I20260809 19:10:33.694442 24601 ts_tablet_manager.cc:1428] T fb5ff56d855c4eb691f3f9fa96532026 P 4fa2a2cc243742b7adcf7526e209cb57: Time spent starting tablet: real 0.013s user 0.008s sys 0.004s
I20260809 19:10:33.694547 24603 consensus_queue.cc:260] T fb5ff56d855c4eb691f3f9fa96532026 P 49493042ccdc4686892552fa61bec7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fa2a2cc243742b7adcf7526e209cb57" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 38597 } } peers { permanent_uuid: "49493042ccdc4686892552fa61bec7a3" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 37617 } } peers { permanent_uuid: "1eef58436a26415cadaad201e403bac8" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 38173 } }
I20260809 19:10:33.697150 24603 ts_tablet_manager.cc:1428] T fb5ff56d855c4eb691f3f9fa96532026 P 49493042ccdc4686892552fa61bec7a3: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260809 19:10:33.771920 24616 raft_consensus.cc:482] T fb5ff56d855c4eb691f3f9fa96532026 P 49493042ccdc4686892552fa61bec7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:10:33.772230 24616 raft_consensus.cc:504] T fb5ff56d855c4eb691f3f9fa96532026 P 49493042ccdc4686892552fa61bec7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fa2a2cc243742b7adcf7526e209cb57" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 38597 } } peers { permanent_uuid: "49493042ccdc4686892552fa61bec7a3" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 37617 } } peers { permanent_uuid: "1eef58436a26415cadaad201e403bac8" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 38173 } }
I20260809 19:10:33.773960 24616 leader_election.cc:288] T fb5ff56d855c4eb691f3f9fa96532026 P 49493042ccdc4686892552fa61bec7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4fa2a2cc243742b7adcf7526e209cb57 (127.7.39.2:38597), 1eef58436a26415cadaad201e403bac8 (127.7.39.3:38173)
I20260809 19:10:33.782043 24600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:33.774591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:54901 (local address 127.7.39.3:38173)
0809 19:10:33.774804 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:33.774811 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:33.775197 (+ 386us) server_negotiation.cc:407] Connection header received
0809 19:10:33.775413 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:33.775417 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:33.775491 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:33.775587 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:10:33.776167 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.777245 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.779863 (+ 2618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.781033 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.781162 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:33.781259 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:33.781672 (+ 413us) server_negotiation.cc:299] Negotiation successful
0809 19:10:33.781798 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 19:10:33.782321 24618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:33.774365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:38597 (local address 127.7.39.1:38007)
0809 19:10:33.775370 (+ 1005us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:33.775385 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:33.775476 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:33.775753 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:33.775757 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:33.775853 (+ 96us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:10:33.776259 (+ 406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:33.776268 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.777503 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.777507 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:33.779708 (+ 2201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:33.779724 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.781265 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.781275 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:33.781517 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:33.781547 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 19:10:33.781635 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 19:10:33.781819 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":894,"mutex_wait_us":137,"spinlock_wait_cycles":23424,"thread_start_us":710,"threads_started":1}
I20260809 19:10:33.782434 24595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:33.774904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:38007 (local address 127.7.39.2:38597)
0809 19:10:33.775071 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:33.775075 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:33.775459 (+ 384us) server_negotiation.cc:407] Connection header received
0809 19:10:33.775569 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:33.775574 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:33.775643 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:33.775725 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:10:33.776393 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.777390 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.779863 (+ 2473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.781033 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.781162 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:33.781254 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:33.781675 (+ 421us) server_negotiation.cc:299] Negotiation successful
0809 19:10:33.781798 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 19:10:33.782457 24617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:33.774323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:38173 (local address 127.7.39.1:54901)
0809 19:10:33.775077 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:33.775098 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:33.775272 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:33.775622 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:33.775625 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:33.775646 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:10:33.776030 (+ 384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:33.776042 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.777369 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.777372 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:33.779710 (+ 2338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:33.779724 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.781288 (+ 1564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.781294 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:33.781511 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:33.781551 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 19:10:33.781638 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 19:10:33.781819 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":615,"mutex_wait_us":72,"thread_start_us":402,"threads_started":1}
I20260809 19:10:33.782642 24615 raft_consensus.cc:482] T fb5ff56d855c4eb691f3f9fa96532026 P 4fa2a2cc243742b7adcf7526e209cb57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:10:33.783258 24615 raft_consensus.cc:504] T fb5ff56d855c4eb691f3f9fa96532026 P 4fa2a2cc243742b7adcf7526e209cb57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fa2a2cc243742b7adcf7526e209cb57" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 38597 } } peers { permanent_uuid: "49493042ccdc4686892552fa61bec7a3" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 37617 } } peers { permanent_uuid: "1eef58436a26415cadaad201e403bac8" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 38173 } }
I20260809 19:10:33.783609 24507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb5ff56d855c4eb691f3f9fa96532026" candidate_uuid: "49493042ccdc4686892552fa61bec7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eef58436a26415cadaad201e403bac8" is_pre_election: true
I20260809 19:10:33.783620 24280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb5ff56d855c4eb691f3f9fa96532026" candidate_uuid: "49493042ccdc4686892552fa61bec7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fa2a2cc243742b7adcf7526e209cb57" is_pre_election: true
I20260809 19:10:33.784152 24507 raft_consensus.cc:2454] T fb5ff56d855c4eb691f3f9fa96532026 P 1eef58436a26415cadaad201e403bac8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49493042ccdc4686892552fa61bec7a3 in term 0.
I20260809 19:10:33.784119 24280 raft_consensus.cc:2454] T fb5ff56d855c4eb691f3f9fa96532026 P 4fa2a2cc243742b7adcf7526e209cb57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49493042ccdc4686892552fa61bec7a3 in term 0.
I20260809 19:10:33.784809 23957 leader_election.cc:302] T fb5ff56d855c4eb691f3f9fa96532026 P 49493042ccdc4686892552fa61bec7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eef58436a26415cadaad201e403bac8, 49493042ccdc4686892552fa61bec7a3; no voters:
I20260809 19:10:33.785259 24616 raft_consensus.cc:2781] T fb5ff56d855c4eb691f3f9fa96532026 P 49493042ccdc4686892552fa61bec7a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:10:33.785406 24615 leader_election.cc:288] T fb5ff56d855c4eb691f3f9fa96532026 P 4fa2a2cc243742b7adcf7526e209cb57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49493042ccdc4686892552fa61bec7a3 (127.7.39.1:37617), 1eef58436a26415cadaad201e403bac8 (127.7.39.3:38173)
I20260809 19:10:33.785394 24616 raft_consensus.cc:482] T fb5ff56d855c4eb691f3f9fa96532026 P 49493042ccdc4686892552fa61bec7a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:10:33.785521 24616 raft_consensus.cc:3037] T fb5ff56d855c4eb691f3f9fa96532026 P 49493042ccdc4686892552fa61bec7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:10:33.788599 24616 raft_consensus.cc:504] T fb5ff56d855c4eb691f3f9fa96532026 P 49493042ccdc4686892552fa61bec7a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fa2a2cc243742b7adcf7526e209cb57" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 38597 } } peers { permanent_uuid: "49493042ccdc4686892552fa61bec7a3" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 37617 } } peers { permanent_uuid: "1eef58436a26415cadaad201e403bac8" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 38173 } }
I20260809 19:10:33.789235 24616 leader_election.cc:288] T fb5ff56d855c4eb691f3f9fa96532026 P 49493042ccdc4686892552fa61bec7a3 [CANDIDATE]: Term 1 election: Requested vote from peers 4fa2a2cc243742b7adcf7526e209cb57 (127.7.39.2:38597), 1eef58436a26415cadaad201e403bac8 (127.7.39.3:38173)
I20260809 19:10:33.789669 24280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb5ff56d855c4eb691f3f9fa96532026" candidate_uuid: "49493042ccdc4686892552fa61bec7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fa2a2cc243742b7adcf7526e209cb57"
I20260809 19:10:33.789858 24280 raft_consensus.cc:3037] T fb5ff56d855c4eb691f3f9fa96532026 P 4fa2a2cc243742b7adcf7526e209cb57 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:10:33.792691 24280 raft_consensus.cc:2454] T fb5ff56d855c4eb691f3f9fa96532026 P 4fa2a2cc243742b7adcf7526e209cb57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49493042ccdc4686892552fa61bec7a3 in term 1.
I20260809 19:10:33.793076 24507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb5ff56d855c4eb691f3f9fa96532026" candidate_uuid: "49493042ccdc4686892552fa61bec7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eef58436a26415cadaad201e403bac8"
I20260809 19:10:33.793208 23958 leader_election.cc:302] T fb5ff56d855c4eb691f3f9fa96532026 P 49493042ccdc4686892552fa61bec7a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49493042ccdc4686892552fa61bec7a3, 4fa2a2cc243742b7adcf7526e209cb57; no voters:
I20260809 19:10:33.793295 24507 raft_consensus.cc:3037] T fb5ff56d855c4eb691f3f9fa96532026 P 1eef58436a26415cadaad201e403bac8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:10:33.793478 24616 raft_consensus.cc:2781] T fb5ff56d855c4eb691f3f9fa96532026 P 49493042ccdc4686892552fa61bec7a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:10:33.793782 24622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:33.786586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:38173 (local address 127.7.39.2:45685)
0809 19:10:33.787369 (+ 783us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:33.787384 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:33.787510 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:33.787801 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:33.787805 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:33.787827 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:10:33.788187 (+ 360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:33.788196 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.789280 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.789289 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:33.791432 (+ 2143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:33.791445 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.792723 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.792728 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:33.792919 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:33.792954 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 19:10:33.793322 (+ 368us) client_negotiation.cc:240] Negotiation successful
0809 19:10:33.793434 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":683,"mutex_wait_us":1,"thread_start_us":510,"threads_started":1}
I20260809 19:10:33.793864 24598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:33.785848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:35105 (local address 127.7.39.1:37617)
0809 19:10:33.786042 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:33.786047 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:33.786641 (+ 594us) server_negotiation.cc:407] Connection header received
0809 19:10:33.786974 (+ 333us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:33.786979 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:33.787059 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:33.787149 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:10:33.787900 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.788885 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.791456 (+ 2571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.792655 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.792789 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:33.792877 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:33.793519 (+ 642us) server_negotiation.cc:299] Negotiation successful
0809 19:10:33.793652 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 19:10:33.794199 24621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:33.785846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:37617 (local address 127.7.39.2:35105)
0809 19:10:33.786513 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0809 19:10:33.786530 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:10:33.786740 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:10:33.787293 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:10:33.787298 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:10:33.787322 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:10:33.787746 (+ 424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:33.787757 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.789008 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.789014 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:33.791288 (+ 2274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:10:33.791304 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.792864 (+ 1560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.792870 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:10:33.793059 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:33.793088 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 19:10:33.793159 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 19:10:33.793272 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"mutex_wait_us":21,"spinlock_wait_cycles":20736,"thread_start_us":320,"threads_started":1}
I20260809 19:10:33.794898 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb5ff56d855c4eb691f3f9fa96532026" candidate_uuid: "4fa2a2cc243742b7adcf7526e209cb57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49493042ccdc4686892552fa61bec7a3" is_pre_election: true
I20260809 19:10:33.796613 24507 raft_consensus.cc:2454] T fb5ff56d855c4eb691f3f9fa96532026 P 1eef58436a26415cadaad201e403bac8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49493042ccdc4686892552fa61bec7a3 in term 1.
I20260809 19:10:33.797245 24600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:33.786668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:45685 (local address 127.7.39.3:38173)
0809 19:10:33.786805 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:33.786810 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:33.787459 (+ 649us) server_negotiation.cc:407] Connection header received
0809 19:10:33.787624 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:33.787628 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:33.787700 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:33.787769 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:10:33.788312 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.789089 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.791597 (+ 2508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.792417 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.792486 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:33.792553 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:33.793142 (+ 589us) server_negotiation.cc:299] Negotiation successful
0809 19:10:33.793265 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 19:10:33.797318 24616 raft_consensus.cc:686] T fb5ff56d855c4eb691f3f9fa96532026 P 49493042ccdc4686892552fa61bec7a3 [term 1 LEADER]: Becoming Leader. State: Replica: 49493042ccdc4686892552fa61bec7a3, State: Running, Role: LEADER
I20260809 19:10:33.797720 24507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb5ff56d855c4eb691f3f9fa96532026" candidate_uuid: "4fa2a2cc243742b7adcf7526e209cb57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eef58436a26415cadaad201e403bac8" is_pre_election: true
I20260809 19:10:33.797956 24507 raft_consensus.cc:2379] T fb5ff56d855c4eb691f3f9fa96532026 P 1eef58436a26415cadaad201e403bac8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4fa2a2cc243742b7adcf7526e209cb57 in current term 1: Already voted for candidate 49493042ccdc4686892552fa61bec7a3 in this term.
I20260809 19:10:33.797834 24616 consensus_queue.cc:237] T fb5ff56d855c4eb691f3f9fa96532026 P 49493042ccdc4686892552fa61bec7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fa2a2cc243742b7adcf7526e209cb57" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 38597 } } peers { permanent_uuid: "49493042ccdc4686892552fa61bec7a3" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 37617 } } peers { permanent_uuid: "1eef58436a26415cadaad201e403bac8" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 38173 } }
I20260809 19:10:33.801538 24170 leader_election.cc:302] T fb5ff56d855c4eb691f3f9fa96532026 P 4fa2a2cc243742b7adcf7526e209cb57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4fa2a2cc243742b7adcf7526e209cb57; no voters: 1eef58436a26415cadaad201e403bac8, 49493042ccdc4686892552fa61bec7a3
I20260809 19:10:33.801913 24615 raft_consensus.cc:2726] T fb5ff56d855c4eb691f3f9fa96532026 P 4fa2a2cc243742b7adcf7526e209cb57 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260809 19:10:33.802670 23834 catalog_manager.cc:5495] T fb5ff56d855c4eb691f3f9fa96532026 P 49493042ccdc4686892552fa61bec7a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 49493042ccdc4686892552fa61bec7a3 (127.7.39.1). New cstate: current_term: 1 leader_uuid: "49493042ccdc4686892552fa61bec7a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fa2a2cc243742b7adcf7526e209cb57" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 38597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49493042ccdc4686892552fa61bec7a3" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 37617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1eef58436a26415cadaad201e403bac8" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 38173 } health_report { overall_health: UNKNOWN } } }
W20260809 19:10:33.812610 24579 tablet.cc:2369] T fb5ff56d855c4eb691f3f9fa96532026 P 1eef58436a26415cadaad201e403bac8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 19:10:33.829502 24356 tablet.cc:2369] T fb5ff56d855c4eb691f3f9fa96532026 P 4fa2a2cc243742b7adcf7526e209cb57: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:10:33.833292 24598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:33.828171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36380 (local address 127.7.39.1:37617)
0809 19:10:33.828358 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:33.828364 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:33.828438 (+ 74us) server_negotiation.cc:407] Connection header received
0809 19:10:33.828600 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:33.828604 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:33.828688 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:33.828824 (+ 136us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:10:33.829114 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.829906 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.831294 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.831696 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.831802 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:33.832267 (+ 465us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:10:33.832733 (+ 466us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:10:33.832860 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:33.832964 (+ 104us) server_negotiation.cc:299] Negotiation successful
0809 19:10:33.833038 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 19:10:33.840828 24507 raft_consensus.cc:1261] T fb5ff56d855c4eb691f3f9fa96532026 P 1eef58436a26415cadaad201e403bac8 [term 1 FOLLOWER]: Refusing update from remote peer 49493042ccdc4686892552fa61bec7a3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:10:33.840859 24280 raft_consensus.cc:1261] T fb5ff56d855c4eb691f3f9fa96532026 P 4fa2a2cc243742b7adcf7526e209cb57 [term 1 FOLLOWER]: Refusing update from remote peer 49493042ccdc4686892552fa61bec7a3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:10:33.841599 24623 consensus_queue.cc:1035] T fb5ff56d855c4eb691f3f9fa96532026 P 49493042ccdc4686892552fa61bec7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4fa2a2cc243742b7adcf7526e209cb57" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 38597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:10:33.841943 24616 consensus_queue.cc:1035] T fb5ff56d855c4eb691f3f9fa96532026 P 49493042ccdc4686892552fa61bec7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1eef58436a26415cadaad201e403bac8" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:10:33.856053 24632 mvcc.cc:205] Tried to move back new op lower bound from 7316695588202856448 to 7316695588039581696. Current Snapshot: MvccSnapshot[applied={T|T < 7316695588202856448}]
I20260809 19:10:33.865109 23834 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43868:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:10:33.865345 23834 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43868:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:10:33.868703 23834 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9d1c364536ad4cfdbdbb7e476be445f9: Sending DeleteTablet for 3 replicas of tablet fb5ff56d855c4eb691f3f9fa96532026
I20260809 19:10:33.869722 24246 tablet_service.cc:1514] Processing DeleteTablet for tablet fb5ff56d855c4eb691f3f9fa96532026 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:10:33 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:55480
I20260809 19:10:33.870676 24026 tablet_service.cc:1514] Processing DeleteTablet for tablet fb5ff56d855c4eb691f3f9fa96532026 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:10:33 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:36370
I20260809 19:10:33.870762 24475 tablet_service.cc:1514] Processing DeleteTablet for tablet fb5ff56d855c4eb691f3f9fa96532026 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:10:33 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:34006
I20260809 19:10:33.870946 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 23924
I20260809 19:10:33.873485 24650 tablet_replica.cc:330] T fb5ff56d855c4eb691f3f9fa96532026 P 4fa2a2cc243742b7adcf7526e209cb57: stopping tablet replica
I20260809 19:10:33.873943 24650 raft_consensus.cc:2229] T fb5ff56d855c4eb691f3f9fa96532026 P 4fa2a2cc243742b7adcf7526e209cb57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:10:33.874502 24650 raft_consensus.cc:2258] T fb5ff56d855c4eb691f3f9fa96532026 P 4fa2a2cc243742b7adcf7526e209cb57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:10:33.875869 24655 tablet_replica.cc:330] T fb5ff56d855c4eb691f3f9fa96532026 P 49493042ccdc4686892552fa61bec7a3: stopping tablet replica
I20260809 19:10:33.876293 24655 raft_consensus.cc:2229] T fb5ff56d855c4eb691f3f9fa96532026 P 49493042ccdc4686892552fa61bec7a3 [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:10:33.876941 24655 raft_consensus.cc:2258] T fb5ff56d855c4eb691f3f9fa96532026 P 49493042ccdc4686892552fa61bec7a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:10:33.877492 24657 tablet_replica.cc:330] T fb5ff56d855c4eb691f3f9fa96532026 P 1eef58436a26415cadaad201e403bac8: stopping tablet replica
I20260809 19:10:33.877472 24650 ts_tablet_manager.cc:1905] T fb5ff56d855c4eb691f3f9fa96532026 P 4fa2a2cc243742b7adcf7526e209cb57: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:10:33.879070 24657 raft_consensus.cc:2229] T fb5ff56d855c4eb691f3f9fa96532026 P 1eef58436a26415cadaad201e403bac8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:10:33.880039 24655 ts_tablet_manager.cc:1905] T fb5ff56d855c4eb691f3f9fa96532026 P 49493042ccdc4686892552fa61bec7a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:10:33.880520 24657 raft_consensus.cc:2258] T fb5ff56d855c4eb691f3f9fa96532026 P 1eef58436a26415cadaad201e403bac8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:10:33.884773 24650 ts_tablet_manager.cc:1918] T fb5ff56d855c4eb691f3f9fa96532026 P 4fa2a2cc243742b7adcf7526e209cb57: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:10:33.884972 24650 log.cc:1196] T fb5ff56d855c4eb691f3f9fa96532026 P 4fa2a2cc243742b7adcf7526e209cb57: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-1/wal/wals/fb5ff56d855c4eb691f3f9fa96532026
I20260809 19:10:33.885601 24650 ts_tablet_manager.cc:1939] T fb5ff56d855c4eb691f3f9fa96532026 P 4fa2a2cc243742b7adcf7526e209cb57: Deleting consensus metadata
Aug 09 19:10:33 dist-test-slave-4tdj krb5kdc[23765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302631, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.1@KRBTEST.COM
I20260809 19:10:33.886927 24657 ts_tablet_manager.cc:1905] T fb5ff56d855c4eb691f3f9fa96532026 P 1eef58436a26415cadaad201e403bac8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:10:33.887599 23815 catalog_manager.cc:4841] TS 4fa2a2cc243742b7adcf7526e209cb57 (127.7.39.2:38597): tablet fb5ff56d855c4eb691f3f9fa96532026 (table test-table [id=6523192698c645b8bfb2499564a9e505]) successfully deleted
I20260809 19:10:33.888314 24655 ts_tablet_manager.cc:1918] T fb5ff56d855c4eb691f3f9fa96532026 P 49493042ccdc4686892552fa61bec7a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:10:33.888535 24655 log.cc:1196] T fb5ff56d855c4eb691f3f9fa96532026 P 49493042ccdc4686892552fa61bec7a3: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-0/wal/wals/fb5ff56d855c4eb691f3f9fa96532026
I20260809 19:10:33.889145 24655 ts_tablet_manager.cc:1939] T fb5ff56d855c4eb691f3f9fa96532026 P 49493042ccdc4686892552fa61bec7a3: Deleting consensus metadata
I20260809 19:10:33.891487 23814 catalog_manager.cc:4841] TS 49493042ccdc4686892552fa61bec7a3 (127.7.39.1:37617): tablet fb5ff56d855c4eb691f3f9fa96532026 (table test-table [id=6523192698c645b8bfb2499564a9e505]) successfully deleted
I20260809 19:10:33.892926 24657 ts_tablet_manager.cc:1918] T fb5ff56d855c4eb691f3f9fa96532026 P 1eef58436a26415cadaad201e403bac8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:10:33.893057 24657 log.cc:1196] T fb5ff56d855c4eb691f3f9fa96532026 P 1eef58436a26415cadaad201e403bac8: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786302538618573-7324-0/minicluster-data/ts-2/wal/wals/fb5ff56d855c4eb691f3f9fa96532026
I20260809 19:10:33.893579 24657 ts_tablet_manager.cc:1939] T fb5ff56d855c4eb691f3f9fa96532026 P 1eef58436a26415cadaad201e403bac8: Deleting consensus metadata
I20260809 19:10:33.895025 23814 catalog_manager.cc:4841] TS 1eef58436a26415cadaad201e403bac8 (127.7.39.3:38173): tablet fb5ff56d855c4eb691f3f9fa96532026 (table test-table [id=6523192698c645b8bfb2499564a9e505]) successfully deleted
I20260809 19:10:33.896214 24598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:33.873363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36396 (local address 127.7.39.1:37617)
0809 19:10:33.873534 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:33.873540 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:33.875309 (+ 1769us) server_negotiation.cc:407] Connection header received
0809 19:10:33.875529 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:33.875535 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:33.875623 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:33.875725 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:33.877529 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.878737 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.880496 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:33.881096 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:33.881213 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:33.889103 (+ 7890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:33.889116 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:33.889137 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:10:33.889181 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:33.893133 (+ 3952us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:33.893906 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:33.893914 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:33.893918 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:33.894077 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:33.894532 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:33.894537 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:33.894540 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:33.895044 (+ 504us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:33.895338 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:33.895635 (+ 297us) server_negotiation.cc:299] Negotiation successful
0809 19:10:33.895865 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 19:10:33.896853 24122 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:10:33.992964 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 23924
I20260809 19:10:34.017444 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 24138
Aug 09 19:10:34 dist-test-slave-4tdj krb5kdc[23765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302631, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.2@KRBTEST.COM
I20260809 19:10:34.032547 24595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:34.018164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55494 (local address 127.7.39.2:38597)
0809 19:10:34.018362 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:34.018367 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:34.018487 (+ 120us) server_negotiation.cc:407] Connection header received
0809 19:10:34.018705 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:34.018709 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:34.018775 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:34.018855 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:34.020128 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:34.020815 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:34.022045 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:34.022527 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:34.022642 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:34.026904 (+ 4262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:34.026915 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:34.026929 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:10:34.026968 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:34.029851 (+ 2883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:34.030538 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:34.030549 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:34.030553 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:34.030733 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:34.031082 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:34.031088 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:34.031092 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:34.031617 (+ 525us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:34.031909 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:34.032092 (+ 183us) server_negotiation.cc:299] Negotiation successful
0809 19:10:34.032262 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 19:10:34.033185 24348 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:10:34.122323 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 24138
I20260809 19:10:34.145704 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 24363
Aug 09 19:10:34 dist-test-slave-4tdj krb5kdc[23765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302631, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.3@KRBTEST.COM
I20260809 19:10:34.160763 24600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:10:34.146442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34012 (local address 127.7.39.3:38173)
0809 19:10:34.146622 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 19:10:34.146626 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:10:34.146645 (+ 19us) server_negotiation.cc:407] Connection header received
0809 19:10:34.146789 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:10:34.146793 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:10:34.146870 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:10:34.146951 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:10:34.148199 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:34.148913 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:34.150218 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:10:34.150792 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:10:34.150893 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:10:34.155211 (+ 4318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:10:34.155231 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:10:34.155254 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:10:34.155294 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:10:34.158430 (+ 3136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:34.159073 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:34.159080 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:34.159082 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:34.159207 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:10:34.159506 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:10:34.159509 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:10:34.159511 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:10:34.159876 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:10:34.160100 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0809 19:10:34.160335 (+ 235us) server_negotiation.cc:299] Negotiation successful
0809 19:10:34.160522 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 19:10:34.161417 24563 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:10:34.246680 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 24363
I20260809 19:10:34.268617 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 23788
I20260809 19:10:34.269731 23879 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:10:34.374423 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 23788
2026-08-09T19:10:34Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4211 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:10:34 dist-test-slave-4tdj krb5kdc[24670](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:10:34 dist-test-slave-4tdj krb5kdc[24670](info): set up 2 sockets
Aug 09 19:10:34 dist-test-slave-4tdj krb5kdc[24670](info): commencing operation
krb5kdc: starting...
W20260809 19:10:35.613989 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.191s user 0.004s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:10:35 dist-test-slave-4tdj krb5kdc[24670](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302635, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:10:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:10:35Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.7.39.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.7.39.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.7.39.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/rangeradmin_127.7.39.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.7.39.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/rangeradmin_127.7.39.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.7.39.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.7.39.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.7.39.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/rangerlookup_127.7.39.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.7.39.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/rangerlookup_127.7.39.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.7.39.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.7.39.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.7.39.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/HTTP_127.7.39.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.7.39.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/HTTP_127.7.39.20@KRBTEST.COM.keytab.
I20260809 19:10:35.894964 7324 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskP6iNI4/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/postgres -l logfile start
2026-08-09 19:10:38.083 UTC [24718] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 19:10:38.084 UTC [24718] LOG: listening on IPv4 address "127.7.39.20", port 33747
2026-08-09 19:10:38.087 UTC [24718] LOG: listening on Unix socket "/tmp/.s.PGSQL.33747"
2026-08-09 19:10:38.107 UTC [24721] LOG: database system was shut down at 2026-08-09 19:10:36 UTC
2026-08-09 19:10:38.110 UTC [24718] LOG: database system is ready to accept connections
I20260809 19:10:39.187762 7324 mini_postgres.cc:96] Postgres bound to 33747
2026-08-09 19:10:39.210 UTC [24737] FATAL: database "slave" does not exist
127.7.39.20:33747 - accepting connections
I20260809 19:10:39.210872 7324 mini_ranger.cc:161] Starting Ranger...
I20260809 19:10:39.236882 7324 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 19:10:39.617496 7324 mini_ranger.cc:87] Created ranger Postgres database
I20260809 19:10:39.617642 7324 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ranger-admin
2026-08-09 19:10:39,958 [I] DB FLAVOR :POSTGRES
2026-08-09 19:10:39,959 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 19:10:39,959 [I] Checking connection..
2026-08-09 19:10:39,959 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:33747/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 19:10:40,228 [I] Checking connection passed.
2026-08-09 19:10:40,228 [I] --------- Verifying version history table ---------
2026-08-09 19:10:40,229 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:33747/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 19:10:40,452 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 19:10:40,452 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:33747/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 19:10:40,700 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 19:10:40,701 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 19:10:40,701 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:33747/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 19:10:40.947 UTC [24831] WARNING: there is no transaction in progress
2026-08-09 19:10:40,956 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 19:10:40,956 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:33747/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 19:10:41,212 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 19:10:41,213 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 19:10:41,213 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:33747/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 19:10:41,464 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:33747/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 19:10:41,684 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:33747/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-4tdj.c.gcp-upstream.internal','N') ;"
2026-08-09 19:10:41,916 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:33747/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 19:10:42,149 [I] Table x_portal_user does not exist in database ranger
2026-08-09 19:10:42,149 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:33747/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 19:10:42,384 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 19:10:42,384 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:33747/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 19:10:42,633 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:33747/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 19:10:42,878 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 19:10:42,878 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:33747/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 19:10:43.752 UTC [25003] WARNING: there is no transaction in progress
2026-08-09 19:10:43.766 UTC [25003] WARNING: there is no transaction in progress
2026-08-09 19:10:43.780 UTC [25003] WARNING: there is no transaction in progress
2026-08-09 19:10:43.793 UTC [25003] WARNING: there is no transaction in progress
2026-08-09 19:10:43.807 UTC [25003] WARNING: there is no transaction in progress
2026-08-09 19:10:43.825 UTC [25003] WARNING: there is no transaction in progress
2026-08-09 19:10:43.886 UTC [25003] WARNING: there is no transaction in progress
2026-08-09 19:10:43.892 UTC [25003] WARNING: there is no transaction in progress
2026-08-09 19:10:43.905 UTC [25003] WARNING: there is no transaction in progress
2026-08-09 19:10:43.914 UTC [25003] WARNING: there is no transaction in progress
2026-08-09 19:10:43.922 UTC [25003] WARNING: there is no transaction in progress
2026-08-09 19:10:43.935 UTC [25003] WARNING: there is no transaction in progress
2026-08-09 19:10:43.943 UTC [25003] WARNING: there is no transaction in progress
2026-08-09 19:10:43.950 UTC [25003] WARNING: there is no transaction in progress
2026-08-09 19:10:43.956 UTC [25003] WARNING: there is no transaction in progress
2026-08-09 19:10:43.962 UTC [25003] WARNING: there is no transaction in progress
2026-08-09 19:10:44,484 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 19:10:44,484 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:33747/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 19:10:44,735 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 19:10:44,735 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:33747/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 19:10:44,994 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 19:10:44,995 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:33747/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 19:10:45,244 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 19:10:45,244 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:33747/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 19:10:45,481 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:33747/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 19:10:45,734 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:33747/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-4tdj.c.gcp-upstream.internal';"
2026-08-09 19:10:45,960 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 19:10:45,961 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:33747/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 19:10:46,203 [I] DB_PATCHES have already been applied
I20260809 19:10:46.209699 7324 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ranger-admin:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskP6iNI4/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 19:10:46.209787 7324 mini_ranger.cc:193] Using host: 127.7.39.20
I20260809 19:10:46.228726 7324 mini_ranger.cc:227] Ranger admin URL: http://127.7.39.20:60299
Aug 09, 2026 7:10:46 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 7:10:46 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 7:10:46 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 7:10:46 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 7:10:46 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 7:10:47 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 7:10:47 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 19:10:47.446362 7324 mini_ranger.cc:160] Time spent starting Ranger: real 8.236s user 0.006s sys 0.044s
Aug 09, 2026 7:11:07 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 7:11:07 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 09, 2026 7:11:07 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 7:11:07 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 7:11:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 7:11:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 7:11:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 7:11:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 7:11:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 7:11:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 7:11:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 7:11:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 7:11:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 7:11:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 7:11:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 7:11:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 7:11:07 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 7:11:08 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 19:11:09.041076 7324 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.7.39.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.7.39.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.7.39.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/rangerkms_127.7.39.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.7.39.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/rangerkms_127.7.39.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.7.39.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.7.39.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.7.39.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/HTTP_127.7.39.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.7.39.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/HTTP_127.7.39.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 19:11:09 dist-test-slave-4tdj krb5kdc[24670](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302669, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 19:11:09.218271 7324 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 19:11:09.240206 7324 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 19:11:09.945322 7324 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 19:11:09.945478 7324 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ranger-kms
I20260809 19:11:09.945583 7324 mini_ranger_kms.cc:227] Using postgres at 127.7.39.20:33747
2026-08-09 19:11:10,401 [I] DB FLAVOR :POSTGRES
2026-08-09 19:11:10,401 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 19:11:10,401 [I] Checking connection
2026-08-09 19:11:10,401 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:33747/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 19:11:10,640 [I] connection success
2026-08-09 19:11:10,640 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 19:11:10,640 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 19:11:10,640 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:33747/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 19:11:10,893 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 19:11:10,893 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 19:11:10,893 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 19:11:10,894 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:33747/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 19:11:11,160 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 19:11:11.560659 7324 mini_ranger_kms.cc:310] Created kms service
I20260809 19:11:11.730125 7324 mini_ranger_kms.cc:326] Created kudu user
I20260809 19:11:11.772668 7324 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 19:11:11 dist-test-slave-4tdj krb5kdc[24670](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302669, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.7.39.20@KRBTEST.COM
I20260809 19:11:12.175146 7324 mini_ranger_kms.cc:384] Added ranger policy
I20260809 19:11:12.176335 7324 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ranger-kms:/tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 19:11:12.176400 7324 mini_ranger_kms.cc:240] Using host: 127.7.39.20
I20260809 19:11:12.197139 7324 mini_ranger_kms.cc:276] Ranger KMS PID: 25263
I20260809 19:11:12.197337 7324 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.7.39.20:44651
Aug 09, 2026 7:11:13 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 7:11:13 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 7:11:13 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 7:11:13 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 7:11:13 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 7:11:13 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 09 19:11:14 dist-test-slave-4tdj krb5kdc[24670](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786302674, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.7.39.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:11:14.727969 7324 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.510s user 0.119s sys 0.362s
I20260809 19:11:14.728312 7324 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 19:11:14.728518 7324 mini_ranger_kms.cc:401] 127.7.39.20:44651/kms/v1/keys
Aug 09 19:11:14 dist-test-slave-4tdj krb5kdc[24670](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302674, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.7.39.20@KRBTEST.COM for HTTP/127.7.39.20@KRBTEST.COM
Aug 09 19:11:15 dist-test-slave-4tdj krb5kdc[24670](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302674, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.7.39.20@KRBTEST.COM for HTTP/127.7.39.20@KRBTEST.COM
Aug 09 19:11:17 dist-test-slave-4tdj krb5kdc[24670](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302677, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.7.39.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
I20260809 19:11:17.684049 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:45839
--webserver_interface=127.7.39.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:46279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:45839
--ranger_config_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.39.20:44651/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:11:18.247628 25340 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:11:18.247920 25340 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:11:18.248051 25340 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:11:18.258919 25340 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:11:18.259131 25340 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:11:18.259260 25340 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:11:18.259440 25340 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:11:18.259582 25340 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:11:18.274451 25340 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:46279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/master-0/wal
--ranger_kms_url=127.7.39.20:44651/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:45839
--ranger_config_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:45839
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:11:18.275849 25340 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:11:18.277401 25340 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:11:18.290498 25351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:11:18.290661 25352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:11:18.290694 25354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:11:18.291942 25340 server_base.cc:1034] running on GCE node
I20260809 19:11:18.292644 25340 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:11:18.293917 25340 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:11:18.295099 25340 hybrid_clock.cc:648] HybridClock initialized: now 1786302678295059 us; error 38 us; skew 500 ppm
I20260809 19:11:18.295413 25340 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:11:18 dist-test-slave-4tdj krb5kdc[24670](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302678, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:11:18.302968 25340 init.cc:377] Logged in from keytab as kudu/127.7.39.62@KRBTEST.COM (short username kudu)
I20260809 19:11:18.304670 25340 webserver.cc:460] Webserver started at http://127.7.39.62:36835/ using document root <none> and password file <none>
I20260809 19:11:18.305457 25340 fs_manager.cc:359] Metadata directory not provided
I20260809 19:11:18.305577 25340 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:11:18.305895 25340 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 19:11:18 dist-test-slave-4tdj krb5kdc[24670](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302678, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for HTTP/127.7.39.20@KRBTEST.COM
I20260809 19:11:18.373023 25340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "8202ff5e9c1749e9b05ec8b29ad54d17"
format_stamp: "Formatted at 2026-08-09 19:11:18 on dist-test-slave-4tdj"
server_key: "ce53d1311b94e76c4daffea44c92aae3"
server_key_iv: "9d6025868ca171c85238c14022cbc69c"
server_key_version: "kuduclusterkey@0"
I20260809 19:11:18.374073 25340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "8202ff5e9c1749e9b05ec8b29ad54d17"
format_stamp: "Formatted at 2026-08-09 19:11:18 on dist-test-slave-4tdj"
server_key: "ce53d1311b94e76c4daffea44c92aae3"
server_key_iv: "9d6025868ca171c85238c14022cbc69c"
server_key_version: "kuduclusterkey@0"
I20260809 19:11:18.381983 25340 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.001s
I20260809 19:11:18.400179 25372 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:11:18.401702 25340 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260809 19:11:18.401921 25340 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "8202ff5e9c1749e9b05ec8b29ad54d17"
format_stamp: "Formatted at 2026-08-09 19:11:18 on dist-test-slave-4tdj"
server_key: "ce53d1311b94e76c4daffea44c92aae3"
server_key_iv: "9d6025868ca171c85238c14022cbc69c"
server_key_version: "kuduclusterkey@0"
I20260809 19:11:18.402341 25340 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:11:18.423935 25340 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:11:18.429966 25340 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:11:18.430543 25340 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:11:18.489137 25340 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:45839
I20260809 19:11:18.489400 25457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:45839 every 8 connection(s)
I20260809 19:11:18.491190 25340 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:11:18.494355 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 25340
I20260809 19:11:18.494549 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:11:18.495429 7324 external_mini_cluster.cc:1428] Setting key e479fb1b31becd466785d48e66b880c9
I20260809 19:11:18.498342 25458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:11:18.520080 25458 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8202ff5e9c1749e9b05ec8b29ad54d17: Bootstrap starting.
I20260809 19:11:18.527272 25458 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8202ff5e9c1749e9b05ec8b29ad54d17: Neither blocks nor log segments found. Creating new log.
I20260809 19:11:18.529944 25458 log.cc:824] T 00000000000000000000000000000000 P 8202ff5e9c1749e9b05ec8b29ad54d17: Log is configured to *not* fsync() on all Append() calls
Aug 09 19:11:18 dist-test-slave-4tdj krb5kdc[24670](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302677, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:11:18.534796 25458 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8202ff5e9c1749e9b05ec8b29ad54d17: No bootstrap required, opened a new log
I20260809 19:11:18.545796 25461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:11:18.497951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41010 (local address 127.7.39.62:45839)
0809 19:11:18.518804 (+ 20853us) server_negotiation.cc:206] Beginning negotiation
0809 19:11:18.518817 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 19:11:18.518888 (+ 71us) server_negotiation.cc:407] Connection header received
0809 19:11:18.522515 (+ 3627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:11:18.522539 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:11:18.522925 (+ 386us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:11:18.523398 (+ 473us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:11:18.524762 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:11:18.526871 (+ 2109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:11:18.528263 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:11:18.529244 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:11:18.529413 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:11:18.534608 (+ 5195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:11:18.534621 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:11:18.534641 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:11:18.534706 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:11:18.540165 (+ 5459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:11:18.541001 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:11:18.541009 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:11:18.541020 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:11:18.541290 (+ 270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:11:18.541780 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:11:18.541785 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:11:18.541788 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:11:18.542686 (+ 898us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:11:18.543105 (+ 419us) server_negotiation.cc:1035] Waiting for connection context
0809 19:11:18.543560 (+ 455us) server_negotiation.cc:299] Negotiation successful
0809 19:11:18.544032 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20531,"thread_start_us":20295,"threads_started":1}
I20260809 19:11:18.551620 25458 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8202ff5e9c1749e9b05ec8b29ad54d17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8202ff5e9c1749e9b05ec8b29ad54d17" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 45839 } }
I20260809 19:11:18.552150 25458 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8202ff5e9c1749e9b05ec8b29ad54d17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:11:18.552338 25458 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8202ff5e9c1749e9b05ec8b29ad54d17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8202ff5e9c1749e9b05ec8b29ad54d17, State: Initialized, Role: FOLLOWER
I20260809 19:11:18.553040 25458 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8202ff5e9c1749e9b05ec8b29ad54d17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8202ff5e9c1749e9b05ec8b29ad54d17" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 45839 } }
I20260809 19:11:18.553395 25458 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8202ff5e9c1749e9b05ec8b29ad54d17 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:11:18.553656 25458 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8202ff5e9c1749e9b05ec8b29ad54d17 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:11:18.553930 25458 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8202ff5e9c1749e9b05ec8b29ad54d17 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:11:18.558003 25458 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8202ff5e9c1749e9b05ec8b29ad54d17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8202ff5e9c1749e9b05ec8b29ad54d17" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 45839 } }
I20260809 19:11:18.558791 25458 leader_election.cc:302] T 00000000000000000000000000000000 P 8202ff5e9c1749e9b05ec8b29ad54d17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8202ff5e9c1749e9b05ec8b29ad54d17; no voters:
I20260809 19:11:18.560134 25458 leader_election.cc:288] T 00000000000000000000000000000000 P 8202ff5e9c1749e9b05ec8b29ad54d17 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:11:18.560315 25464 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8202ff5e9c1749e9b05ec8b29ad54d17 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:11:18.563244 25458 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8202ff5e9c1749e9b05ec8b29ad54d17 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:11:18.564373 25464 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8202ff5e9c1749e9b05ec8b29ad54d17 [term 1 LEADER]: Becoming Leader. State: Replica: 8202ff5e9c1749e9b05ec8b29ad54d17, State: Running, Role: LEADER
I20260809 19:11:18.565188 25464 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8202ff5e9c1749e9b05ec8b29ad54d17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8202ff5e9c1749e9b05ec8b29ad54d17" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 45839 } }
I20260809 19:11:18.569638 25470 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8202ff5e9c1749e9b05ec8b29ad54d17 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8202ff5e9c1749e9b05ec8b29ad54d17. Latest consensus state: current_term: 1 leader_uuid: "8202ff5e9c1749e9b05ec8b29ad54d17" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8202ff5e9c1749e9b05ec8b29ad54d17" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 45839 } } }
I20260809 19:11:18.569988 25467 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8202ff5e9c1749e9b05ec8b29ad54d17 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8202ff5e9c1749e9b05ec8b29ad54d17" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8202ff5e9c1749e9b05ec8b29ad54d17" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 45839 } } }
I20260809 19:11:18.570750 25470 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8202ff5e9c1749e9b05ec8b29ad54d17 [sys.catalog]: This master's current role is: LEADER
I20260809 19:11:18.570848 25467 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8202ff5e9c1749e9b05ec8b29ad54d17 [sys.catalog]: This master's current role is: LEADER
I20260809 19:11:18.580647 25479 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:11:18.581842 25458 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 19:11:18.599332 25479 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:11:18.618906 25479 catalog_manager.cc:1347] Generated new cluster ID: a48929a2337a4e64884648ef828db128
I20260809 19:11:18.619081 25479 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:11:18.644407 25479 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:11:18.646764 25479 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:11:18.657234 25479 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8202ff5e9c1749e9b05ec8b29ad54d17: Generated new TSK 0
I20260809 19:11:18.658380 25479 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.39.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
I20260809 19:11:19.534049 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.39.20:44651/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.1:0
--local_ip_for_outbound_sockets=127.7.39.1
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:45839
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:46279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 19:11:19 dist-test-slave-4tdj krb5kdc[24670](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786302679, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260809 19:11:20.170208 25528 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:11:20.170869 25528 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:11:20.171242 25528 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:11:20.181982 25528 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:11:20.182192 25528 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:11:20.182463 25528 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.1
I20260809 19:11:20.196070 25528 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:46279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.7.39.20:44651/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:45839
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.1
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:11:20.197633 25528 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:11:20.199100 25528 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:11:20.222263 25546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:11:20.223595 25549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:11:20.224210 25547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:11:20.224676 25528 server_base.cc:1034] running on GCE node
I20260809 19:11:20.225365 25528 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:11:20.226503 25528 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:11:20.227761 25528 hybrid_clock.cc:648] HybridClock initialized: now 1786302680227623 us; error 93 us; skew 500 ppm
I20260809 19:11:20.228118 25528 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:11:20 dist-test-slave-4tdj krb5kdc[24670](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302680, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:11:20.232921 25528 init.cc:377] Logged in from keytab as kudu/127.7.39.1@KRBTEST.COM (short username kudu)
I20260809 19:11:20.236951 25528 webserver.cc:460] Webserver started at http://127.7.39.1:44655/ using document root <none> and password file <none>
I20260809 19:11:20.238152 25528 fs_manager.cc:359] Metadata directory not provided
I20260809 19:11:20.238463 25528 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:11:20.239022 25528 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 19:11:20 dist-test-slave-4tdj krb5kdc[24670](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302680, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for HTTP/127.7.39.20@KRBTEST.COM
I20260809 19:11:20.259552 25528 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-0/data/instance:
uuid: "daef444f205a4b458b66971cad5acb6f"
format_stamp: "Formatted at 2026-08-09 19:11:20 on dist-test-slave-4tdj"
server_key: "710ee3f16ae71e55f4cd5886a6e323b5"
server_key_iv: "a66a24c4bf991dcfbae6e55242bbcf2b"
server_key_version: "kuduclusterkey@0"
I20260809 19:11:20.260838 25528 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance:
uuid: "daef444f205a4b458b66971cad5acb6f"
format_stamp: "Formatted at 2026-08-09 19:11:20 on dist-test-slave-4tdj"
server_key: "710ee3f16ae71e55f4cd5886a6e323b5"
server_key_iv: "a66a24c4bf991dcfbae6e55242bbcf2b"
server_key_version: "kuduclusterkey@0"
I20260809 19:11:20.273154 25528 fs_manager.cc:691] Time spent creating directory manager: real 0.012s user 0.009s sys 0.001s
I20260809 19:11:20.305634 25560 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:11:20.307848 25528 fs_manager.cc:725] Time spent opening block manager: real 0.012s user 0.003s sys 0.006s
I20260809 19:11:20.308172 25528 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-0/wal
uuid: "daef444f205a4b458b66971cad5acb6f"
format_stamp: "Formatted at 2026-08-09 19:11:20 on dist-test-slave-4tdj"
server_key: "710ee3f16ae71e55f4cd5886a6e323b5"
server_key_iv: "a66a24c4bf991dcfbae6e55242bbcf2b"
server_key_version: "kuduclusterkey@0"
I20260809 19:11:20.308677 25528 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:11:20.341331 25528 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:11:20.348435 25528 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:11:20.349045 25528 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:11:20.351060 25528 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:11:20.357560 25528 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:11:20.357752 25528 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:11:20.358011 25528 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:11:20.358238 25528 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 19:11:20 dist-test-slave-4tdj krb5kdc[24670](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302679, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for HTTP/127.7.39.20@KRBTEST.COM
I20260809 19:11:20.583559 25528 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.1:34277
I20260809 19:11:20.583619 25725 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.1:34277 every 8 connection(s)
I20260809 19:11:20.585592 25528 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
I20260809 19:11:20.594214 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 25528
I20260809 19:11:20.594441 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance
I20260809 19:11:20.595252 7324 external_mini_cluster.cc:1428] Setting key 5b24c9db40cd347fdee772ac8cc9099f
Aug 09 19:11:20 dist-test-slave-4tdj krb5kdc[24670](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302680, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.7.39.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.2@KRBTEST.COM" created.
I20260809 19:11:20.643591 25729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:11:20.590050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:45839 (local address 127.7.39.1:51427)
0809 19:11:20.613288 (+ 23238us) negotiation.cc:107] Waiting for socket to connect
0809 19:11:20.613351 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0809 19:11:20.616212 (+ 2861us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:11:20.618999 (+ 2787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:11:20.619013 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:11:20.619835 (+ 822us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:11:20.621058 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:11:20.621084 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:11:20.622932 (+ 1848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:11:20.622939 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:11:20.625627 (+ 2688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:11:20.625666 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:11:20.627484 (+ 1818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:11:20.627495 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:11:20.627938 (+ 443us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:11:20.628942 (+ 1004us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:11:20.628980 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:11:20.632516 (+ 3536us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:11:20.637966 (+ 5450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:11:20.637975 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:11:20.637992 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:11:20.638747 (+ 755us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:11:20.639308 (+ 561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:11:20.639313 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:11:20.639317 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:11:20.639784 (+ 467us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:11:20.640604 (+ 820us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:11:20.640612 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:11:20.641018 (+ 406us) client_negotiation.cc:769] Sending connection context
0809 19:11:20.641348 (+ 330us) client_negotiation.cc:240] Negotiation successful
0809 19:11:20.641933 (+ 585us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22891,"thread_start_us":26477,"threads_started":1}
I20260809 19:11:20.645171 25728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:11:20.590640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:51427 (local address 127.7.39.62:45839)
0809 19:11:20.618090 (+ 27450us) server_negotiation.cc:206] Beginning negotiation
0809 19:11:20.618096 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:11:20.618117 (+ 21us) server_negotiation.cc:407] Connection header received
0809 19:11:20.618174 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:11:20.618179 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:11:20.618253 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:11:20.618375 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:11:20.621272 (+ 2897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:11:20.622678 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:11:20.625870 (+ 3192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:11:20.626902 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:11:20.627053 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:11:20.632791 (+ 5738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:11:20.632799 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:11:20.632804 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:11:20.632849 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:11:20.637765 (+ 4916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:11:20.638917 (+ 1152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:11:20.638923 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:11:20.638927 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:11:20.639144 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:11:20.639945 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:11:20.639951 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:11:20.639955 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:11:20.640338 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:11:20.640493 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 19:11:20.644333 (+ 3840us) server_negotiation.cc:299] Negotiation successful
0809 19:11:20.644593 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27312,"thread_start_us":27911,"threads_started":1}
I20260809 19:11:20.646898 25726 heartbeater.cc:347] Connected to a master server at 127.7.39.62:45839
I20260809 19:11:20.647258 25726 heartbeater.cc:464] Registering TS with master...
I20260809 19:11:20.648097 25726 heartbeater.cc:511] Master 127.7.39.62:45839 requested a full tablet report, sending...
I20260809 19:11:20.650785 25399 ts_manager.cc:194] Registered new tserver with Master: daef444f205a4b458b66971cad5acb6f (127.7.39.1:34277)
I20260809 19:11:20.653292 25399 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.1@KRBTEST.COM'} at 127.7.39.1:51427
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
I20260809 19:11:20.673250 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.39.20:44651/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.2:0
--local_ip_for_outbound_sockets=127.7.39.2
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:45839
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:46279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 19:11:20 dist-test-slave-4tdj krb5kdc[24670](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302679, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for HTTP/127.7.39.20@KRBTEST.COM
W20260809 19:11:21.431007 25737 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:11:21.431366 25737 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:11:21.431572 25737 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:11:21.440797 25737 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:11:21.440958 25737 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:11:21.441138 25737 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.2
I20260809 19:11:21.453998 25737 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:46279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.7.39.20:44651/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:45839
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.2
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:11:21.455425 25737 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:11:21.457007 25737 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:11:21.475323 25755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:11:21.475544 25757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:11:21.476359 25760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:11:21.483738 25737 server_base.cc:1034] running on GCE node
I20260809 19:11:21.484364 25737 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:11:21.485425 25737 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:11:21.486786 25737 hybrid_clock.cc:648] HybridClock initialized: now 1786302681486550 us; error 93 us; skew 500 ppm
I20260809 19:11:21.487273 25737 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:11:21 dist-test-slave-4tdj krb5kdc[24670](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302681, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:11:21.492615 25737 init.cc:377] Logged in from keytab as kudu/127.7.39.2@KRBTEST.COM (short username kudu)
I20260809 19:11:21.495541 25737 webserver.cc:460] Webserver started at http://127.7.39.2:37695/ using document root <none> and password file <none>
I20260809 19:11:21.496547 25737 fs_manager.cc:359] Metadata directory not provided
I20260809 19:11:21.496757 25737 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:11:21.497341 25737 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 19:11:21 dist-test-slave-4tdj krb5kdc[24670](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302681, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for HTTP/127.7.39.20@KRBTEST.COM
I20260809 19:11:21.519291 25737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-1/data/instance:
uuid: "a94121d9710e408d8d5b319f29144fa7"
format_stamp: "Formatted at 2026-08-09 19:11:21 on dist-test-slave-4tdj"
server_key: "629872b787020a48ebfb00540db86a27"
server_key_iv: "dd9f88fdbeb5c2e11287b1bbf9794c8a"
server_key_version: "kuduclusterkey@0"
I20260809 19:11:21.520641 25737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance:
uuid: "a94121d9710e408d8d5b319f29144fa7"
format_stamp: "Formatted at 2026-08-09 19:11:21 on dist-test-slave-4tdj"
server_key: "629872b787020a48ebfb00540db86a27"
server_key_iv: "dd9f88fdbeb5c2e11287b1bbf9794c8a"
server_key_version: "kuduclusterkey@0"
I20260809 19:11:21.528468 25737 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.008s sys 0.000s
I20260809 19:11:21.549561 25771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:11:21.551477 25737 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.001s
I20260809 19:11:21.551738 25737 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-1/wal
uuid: "a94121d9710e408d8d5b319f29144fa7"
format_stamp: "Formatted at 2026-08-09 19:11:21 on dist-test-slave-4tdj"
server_key: "629872b787020a48ebfb00540db86a27"
server_key_iv: "dd9f88fdbeb5c2e11287b1bbf9794c8a"
server_key_version: "kuduclusterkey@0"
I20260809 19:11:21.552095 25737 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:11:21.574608 25737 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:11:21.578821 25737 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:11:21.579241 25737 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:11:21.580250 25737 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:11:21.581817 25737 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:11:21.581893 25737 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:11:21.582043 25737 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:11:21.582134 25737 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:11:21.648537 25737 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.2:35677
I20260809 19:11:21.648568 25955 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.2:35677 every 8 connection(s)
I20260809 19:11:21.649935 25737 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
I20260809 19:11:21.654844 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 25737
I20260809 19:11:21.655035 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance
I20260809 19:11:21.655598 7324 external_mini_cluster.cc:1428] Setting key 48b2589dad282062c1d12a7e2792400d
I20260809 19:11:21.657341 25726 heartbeater.cc:503] Master 127.7.39.62:45839 was elected leader, sending a full tablet report...
Aug 09 19:11:21 dist-test-slave-4tdj krb5kdc[24670](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302681, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:11:21.675583 25959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:11:21.653032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:53503 (local address 127.7.39.62:45839)
0809 19:11:21.653649 (+ 617us) server_negotiation.cc:206] Beginning negotiation
0809 19:11:21.653653 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:11:21.654745 (+ 1092us) server_negotiation.cc:407] Connection header received
0809 19:11:21.657250 (+ 2505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:11:21.657256 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:11:21.657389 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:11:21.657512 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:11:21.659963 (+ 2451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:11:21.660808 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:11:21.663484 (+ 2676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:11:21.664014 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:11:21.664122 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:11:21.668836 (+ 4714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:11:21.668842 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:11:21.668845 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:11:21.668929 (+ 84us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:11:21.672229 (+ 3300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:11:21.672951 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:11:21.672955 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:11:21.672957 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:11:21.673149 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:11:21.673662 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:11:21.673666 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:11:21.673668 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:11:21.673970 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:11:21.674119 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 19:11:21.674887 (+ 768us) server_negotiation.cc:299] Negotiation successful
0809 19:11:21.675114 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":331,"threads_started":1}
I20260809 19:11:21.676484 25962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:11:21.653634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:45839 (local address 127.7.39.2:53503)
0809 19:11:21.654584 (+ 950us) negotiation.cc:107] Waiting for socket to connect
0809 19:11:21.654629 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 19:11:21.656946 (+ 2317us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:11:21.657801 (+ 855us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:11:21.657813 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:11:21.658740 (+ 927us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:11:21.659790 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:11:21.659817 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:11:21.660980 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:11:21.660984 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:11:21.663340 (+ 2356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:11:21.663355 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:11:21.664310 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:11:21.664320 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:11:21.664671 (+ 351us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:11:21.665578 (+ 907us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:11:21.665605 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:11:21.668602 (+ 2997us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:11:21.672356 (+ 3754us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:11:21.672365 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:11:21.672381 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:11:21.672830 (+ 449us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:11:21.673257 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:11:21.673263 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:11:21.673266 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:11:21.673523 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:11:21.674111 (+ 588us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:11:21.674119 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:11:21.674448 (+ 329us) client_negotiation.cc:769] Sending connection context
0809 19:11:21.674704 (+ 256us) client_negotiation.cc:240] Negotiation successful
0809 19:11:21.675210 (+ 506us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":701,"thread_start_us":431,"threads_started":1}
I20260809 19:11:21.678097 25957 heartbeater.cc:347] Connected to a master server at 127.7.39.62:45839
I20260809 19:11:21.678436 25957 heartbeater.cc:464] Registering TS with master...
I20260809 19:11:21.679231 25957 heartbeater.cc:511] Master 127.7.39.62:45839 requested a full tablet report, sending...
I20260809 19:11:21.680800 25399 ts_manager.cc:194] Registered new tserver with Master: a94121d9710e408d8d5b319f29144fa7 (127.7.39.2:35677)
I20260809 19:11:21.682014 25399 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.2@KRBTEST.COM'} at 127.7.39.2:53503
WARNING: no policy specified for kudu/127.7.39.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
I20260809 19:11:21.709770 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.39.20:44651/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.3:0
--local_ip_for_outbound_sockets=127.7.39.3
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:45839
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:46279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:11:22.310070 25967 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:11:22.310433 25967 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:11:22.310639 25967 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:11:22.319643 25967 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:11:22.319763 25967 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:11:22.319913 25967 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.3
I20260809 19:11:22.331744 25967 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:46279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.7.39.20:44651/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:45839
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.3
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:11:22.333168 25967 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:11:22.334501 25967 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:11:22.348812 25972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:11:22.349043 25973 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:11:22.349450 25975 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:11:22.350394 25967 server_base.cc:1034] running on GCE node
I20260809 19:11:22.350989 25967 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:11:22.352033 25967 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:11:22.353227 25967 hybrid_clock.cc:648] HybridClock initialized: now 1786302682353183 us; error 36 us; skew 500 ppm
I20260809 19:11:22.353593 25967 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:11:22 dist-test-slave-4tdj krb5kdc[24670](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302682, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:11:22.356843 25967 init.cc:377] Logged in from keytab as kudu/127.7.39.3@KRBTEST.COM (short username kudu)
I20260809 19:11:22.358284 25967 webserver.cc:460] Webserver started at http://127.7.39.3:40517/ using document root <none> and password file <none>
I20260809 19:11:22.358934 25967 fs_manager.cc:359] Metadata directory not provided
I20260809 19:11:22.359030 25967 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:11:22.359311 25967 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 19:11:22 dist-test-slave-4tdj krb5kdc[24670](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302682, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for HTTP/127.7.39.20@KRBTEST.COM
I20260809 19:11:22.374141 25967 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-2/data/instance:
uuid: "a58d0e559747497c95eca32495b1da9a"
format_stamp: "Formatted at 2026-08-09 19:11:22 on dist-test-slave-4tdj"
server_key: "6de21600ec19c695bac43d7b673708e5"
server_key_iv: "09eb5db5fefe0975e8f10f0df3fc90e0"
server_key_version: "kuduclusterkey@0"
I20260809 19:11:22.375449 25967 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance:
uuid: "a58d0e559747497c95eca32495b1da9a"
format_stamp: "Formatted at 2026-08-09 19:11:22 on dist-test-slave-4tdj"
server_key: "6de21600ec19c695bac43d7b673708e5"
server_key_iv: "09eb5db5fefe0975e8f10f0df3fc90e0"
server_key_version: "kuduclusterkey@0"
I20260809 19:11:22.381385 25967 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260809 19:11:22.396183 25986 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:11:22.397595 25967 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260809 19:11:22.397848 25967 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-2/wal
uuid: "a58d0e559747497c95eca32495b1da9a"
format_stamp: "Formatted at 2026-08-09 19:11:22 on dist-test-slave-4tdj"
server_key: "6de21600ec19c695bac43d7b673708e5"
server_key_iv: "09eb5db5fefe0975e8f10f0df3fc90e0"
server_key_version: "kuduclusterkey@0"
I20260809 19:11:22.398106 25967 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:11:22.420866 25967 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:11:22.426263 25967 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:11:22.426783 25967 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:11:22.427929 25967 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:11:22.429754 25967 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:11:22.429834 25967 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:11:22.429948 25967 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:11:22.430002 25967 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:11:22.496198 25967 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.3:46293
I20260809 19:11:22.496277 26162 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.3:46293 every 8 connection(s)
I20260809 19:11:22.498104 25967 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
I20260809 19:11:22.503623 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 25967
I20260809 19:11:22.503800 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance
I20260809 19:11:22.504244 7324 external_mini_cluster.cc:1428] Setting key 47c83c2ac633ecbf90ee17514d1d22cf
Aug 09 19:11:22 dist-test-slave-4tdj krb5kdc[24670](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302682, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:11:22.527746 26165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:11:22.501884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:51133 (local address 127.7.39.62:45839)
0809 19:11:22.502883 (+ 999us) server_negotiation.cc:206] Beginning negotiation
0809 19:11:22.502889 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:11:22.505258 (+ 2369us) server_negotiation.cc:407] Connection header received
0809 19:11:22.508540 (+ 3282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:11:22.508544 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:11:22.508647 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:11:22.508885 (+ 238us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:11:22.510969 (+ 2084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:11:22.512291 (+ 1322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:11:22.514600 (+ 2309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:11:22.515217 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:11:22.515311 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:11:22.520254 (+ 4943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:11:22.520259 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:11:22.520262 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:11:22.520321 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:11:22.524478 (+ 4157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:11:22.525285 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:11:22.525288 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:11:22.525291 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:11:22.525473 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:11:22.525995 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:11:22.525998 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:11:22.526000 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:11:22.526423 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:11:22.526532 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 19:11:22.527198 (+ 666us) server_negotiation.cc:299] Negotiation successful
0809 19:11:22.527342 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":870,"thread_start_us":760,"threads_started":1}
I20260809 19:11:22.528980 26166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:11:22.502954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:45839 (local address 127.7.39.3:51133)
0809 19:11:22.504895 (+ 1941us) negotiation.cc:107] Waiting for socket to connect
0809 19:11:22.504939 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 19:11:22.508279 (+ 3340us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:11:22.509111 (+ 832us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:11:22.509119 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:11:22.509845 (+ 726us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:11:22.510818 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:11:22.510839 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:11:22.512449 (+ 1610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:11:22.512453 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:11:22.514368 (+ 1915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:11:22.514416 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:11:22.515493 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:11:22.515500 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:11:22.515820 (+ 320us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:11:22.516579 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:11:22.516600 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:11:22.519951 (+ 3351us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:11:22.524596 (+ 4645us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:11:22.524602 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:11:22.524612 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:11:22.525183 (+ 571us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:11:22.525561 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:11:22.525564 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:11:22.525567 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:11:22.525906 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:11:22.526536 (+ 630us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:11:22.526542 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:11:22.526848 (+ 306us) client_negotiation.cc:769] Sending connection context
0809 19:11:22.527127 (+ 279us) client_negotiation.cc:240] Negotiation successful
0809 19:11:22.527576 (+ 449us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1625,"thread_start_us":1266,"threads_started":1}
I20260809 19:11:22.530565 26163 heartbeater.cc:347] Connected to a master server at 127.7.39.62:45839
I20260809 19:11:22.530917 26163 heartbeater.cc:464] Registering TS with master...
I20260809 19:11:22.532287 26163 heartbeater.cc:511] Master 127.7.39.62:45839 requested a full tablet report, sending...
I20260809 19:11:22.533932 25399 ts_manager.cc:194] Registered new tserver with Master: a58d0e559747497c95eca32495b1da9a (127.7.39.3:46293)
I20260809 19:11:22.535032 25399 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.3@KRBTEST.COM'} at 127.7.39.3:51133
I20260809 19:11:22.544382 7324 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 19:11:22.568307 26165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:11:22.550725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41012 (local address 127.7.39.62:45839)
0809 19:11:22.550866 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 19:11:22.550870 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:11:22.551925 (+ 1055us) server_negotiation.cc:407] Connection header received
0809 19:11:22.552089 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:11:22.552094 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:11:22.552204 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:11:22.552288 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:11:22.554551 (+ 2263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:11:22.555653 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:11:22.557841 (+ 2188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:11:22.558669 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:11:22.558784 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:11:22.561607 (+ 2823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:11:22.561616 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:11:22.561621 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:11:22.561721 (+ 100us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:11:22.565409 (+ 3688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:11:22.566114 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:11:22.566118 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:11:22.566121 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:11:22.566354 (+ 233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:11:22.566774 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:11:22.566779 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:11:22.566781 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:11:22.567064 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:11:22.567306 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0809 19:11:22.567736 (+ 430us) server_negotiation.cc:299] Negotiation successful
0809 19:11:22.567953 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 19:11:22.572430 25399 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41012:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:11:22.582820 25399 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:11:22.619279 26187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:11:22.601193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42580 (local address 127.7.39.2:35677)
0809 19:11:22.603283 (+ 2090us) server_negotiation.cc:206] Beginning negotiation
0809 19:11:22.603293 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:11:22.605506 (+ 2213us) server_negotiation.cc:407] Connection header received
0809 19:11:22.605728 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:11:22.605736 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:11:22.605976 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:11:22.606256 (+ 280us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:11:22.608633 (+ 2377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:11:22.610727 (+ 2094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:11:22.614738 (+ 4011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:11:22.617109 (+ 2371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:11:22.617300 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:11:22.617468 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 19:11:22.618362 (+ 894us) server_negotiation.cc:299] Negotiation successful
0809 19:11:22.618584 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1828,"thread_start_us":1627,"threads_started":1}
I20260809 19:11:22.619658 26185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:11:22.600132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39454 (local address 127.7.39.3:46293)
0809 19:11:22.604544 (+ 4412us) server_negotiation.cc:206] Beginning negotiation
0809 19:11:22.604553 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:11:22.604607 (+ 54us) server_negotiation.cc:407] Connection header received
0809 19:11:22.604740 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:11:22.604748 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:11:22.605006 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:11:22.606926 (+ 1920us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:11:22.607610 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:11:22.609793 (+ 2183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:11:22.614761 (+ 4968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:11:22.616771 (+ 2010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:11:22.616893 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:11:22.618573 (+ 1680us) server_negotiation.cc:1035] Waiting for connection context
0809 19:11:22.618689 (+ 116us) server_negotiation.cc:299] Negotiation successful
0809 19:11:22.618884 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4195,"thread_start_us":3852,"threads_started":1}
I20260809 19:11:22.620026 26182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:11:22.599809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:46293 (local address 127.0.0.1:39454)
0809 19:11:22.601401 (+ 1592us) negotiation.cc:107] Waiting for socket to connect
0809 19:11:22.601482 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0809 19:11:22.601784 (+ 302us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:11:22.605334 (+ 3550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:11:22.605341 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:11:22.605373 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:11:22.606557 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:11:22.606573 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:11:22.609978 (+ 3405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:11:22.609983 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:11:22.614566 (+ 4583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:11:22.614584 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:11:22.617437 (+ 2853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:11:22.617443 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:11:22.617662 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:11:22.617698 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 19:11:22.617819 (+ 121us) client_negotiation.cc:240] Negotiation successful
0809 19:11:22.617956 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1271,"mutex_wait_us":49,"thread_start_us":886,"threads_started":1}
I20260809 19:11:22.620230 26186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:11:22.600643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:35677 (local address 127.0.0.1:42580)
0809 19:11:22.605314 (+ 4671us) negotiation.cc:107] Waiting for socket to connect
0809 19:11:22.605331 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:11:22.605575 (+ 244us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:11:22.606708 (+ 1133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:11:22.606714 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:11:22.606744 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:11:22.608331 (+ 1587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:11:22.608347 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:11:22.610941 (+ 2594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:11:22.610946 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:11:22.614499 (+ 3553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:11:22.614512 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:11:22.617840 (+ 3328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:11:22.617848 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:11:22.618122 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:11:22.618158 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 19:11:22.618254 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 19:11:22.618411 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4430,"mutex_wait_us":27,"thread_start_us":4140,"threads_started":1}
I20260809 19:11:22.622265 26188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:11:22.601636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:34277 (local address 127.0.0.1:52732)
0809 19:11:22.609005 (+ 7369us) negotiation.cc:107] Waiting for socket to connect
0809 19:11:22.609022 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:11:22.609285 (+ 263us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:11:22.610038 (+ 753us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:11:22.610043 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:11:22.610071 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:11:22.611692 (+ 1621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:11:22.611709 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:11:22.614951 (+ 3242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:11:22.614956 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:11:22.618502 (+ 3546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:11:22.618519 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:11:22.621177 (+ 2658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:11:22.621186 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:11:22.621413 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:11:22.621446 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 19:11:22.621532 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 19:11:22.621658 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7207,"thread_start_us":6927,"threads_started":1}
I20260809 19:11:22.622620 26189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:11:22.602694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52732 (local address 127.7.39.1:34277)
0809 19:11:22.607852 (+ 5158us) server_negotiation.cc:206] Beginning negotiation
0809 19:11:22.607861 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:11:22.609372 (+ 1511us) server_negotiation.cc:407] Connection header received
0809 19:11:22.609517 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:11:22.609525 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:11:22.609730 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:11:22.610099 (+ 369us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:11:22.612051 (+ 1952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:11:22.614681 (+ 2630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:11:22.618685 (+ 4004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:11:22.620785 (+ 2100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:11:22.620896 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:11:22.621205 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0809 19:11:22.621671 (+ 466us) server_negotiation.cc:299] Negotiation successful
0809 19:11:22.621869 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4916,"thread_start_us":3484,"threads_started":1}
I20260809 19:11:22.624394 25857 tablet_service.cc:1467] Processing CreateTablet for tablet 85b79983d73b40c5833f131fd6ee160d (DEFAULT_TABLE table=test-table [id=d68ad78f0c22426bac8ff09adfad46e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:11:22.624542 26058 tablet_service.cc:1467] Processing CreateTablet for tablet 85b79983d73b40c5833f131fd6ee160d (DEFAULT_TABLE table=test-table [id=d68ad78f0c22426bac8ff09adfad46e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:11:22.625833 25857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85b79983d73b40c5833f131fd6ee160d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:11:22.626551 26058 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85b79983d73b40c5833f131fd6ee160d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:11:22.630136 25624 tablet_service.cc:1467] Processing CreateTablet for tablet 85b79983d73b40c5833f131fd6ee160d (DEFAULT_TABLE table=test-table [id=d68ad78f0c22426bac8ff09adfad46e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:11:22.631762 25624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85b79983d73b40c5833f131fd6ee160d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:11:22.646965 26191 tablet_bootstrap.cc:492] T 85b79983d73b40c5833f131fd6ee160d P a94121d9710e408d8d5b319f29144fa7: Bootstrap starting.
I20260809 19:11:22.654275 26197 tablet_bootstrap.cc:492] T 85b79983d73b40c5833f131fd6ee160d P daef444f205a4b458b66971cad5acb6f: Bootstrap starting.
I20260809 19:11:22.656427 26191 tablet_bootstrap.cc:654] T 85b79983d73b40c5833f131fd6ee160d P a94121d9710e408d8d5b319f29144fa7: Neither blocks nor log segments found. Creating new log.
I20260809 19:11:22.663095 26197 tablet_bootstrap.cc:654] T 85b79983d73b40c5833f131fd6ee160d P daef444f205a4b458b66971cad5acb6f: Neither blocks nor log segments found. Creating new log.
I20260809 19:11:22.663738 26191 log.cc:824] T 85b79983d73b40c5833f131fd6ee160d P a94121d9710e408d8d5b319f29144fa7: Log is configured to *not* fsync() on all Append() calls
I20260809 19:11:22.664678 26192 tablet_bootstrap.cc:492] T 85b79983d73b40c5833f131fd6ee160d P a58d0e559747497c95eca32495b1da9a: Bootstrap starting.
I20260809 19:11:22.665899 26197 log.cc:824] T 85b79983d73b40c5833f131fd6ee160d P daef444f205a4b458b66971cad5acb6f: Log is configured to *not* fsync() on all Append() calls
I20260809 19:11:22.671396 26191 tablet_bootstrap.cc:492] T 85b79983d73b40c5833f131fd6ee160d P a94121d9710e408d8d5b319f29144fa7: No bootstrap required, opened a new log
I20260809 19:11:22.671499 26192 tablet_bootstrap.cc:654] T 85b79983d73b40c5833f131fd6ee160d P a58d0e559747497c95eca32495b1da9a: Neither blocks nor log segments found. Creating new log.
I20260809 19:11:22.671767 26191 ts_tablet_manager.cc:1397] T 85b79983d73b40c5833f131fd6ee160d P a94121d9710e408d8d5b319f29144fa7: Time spent bootstrapping tablet: real 0.025s user 0.009s sys 0.005s
I20260809 19:11:22.672405 26197 tablet_bootstrap.cc:492] T 85b79983d73b40c5833f131fd6ee160d P daef444f205a4b458b66971cad5acb6f: No bootstrap required, opened a new log
I20260809 19:11:22.672811 26197 ts_tablet_manager.cc:1397] T 85b79983d73b40c5833f131fd6ee160d P daef444f205a4b458b66971cad5acb6f: Time spent bootstrapping tablet: real 0.019s user 0.009s sys 0.003s
I20260809 19:11:22.674103 26192 log.cc:824] T 85b79983d73b40c5833f131fd6ee160d P a58d0e559747497c95eca32495b1da9a: Log is configured to *not* fsync() on all Append() calls
I20260809 19:11:22.679167 26192 tablet_bootstrap.cc:492] T 85b79983d73b40c5833f131fd6ee160d P a58d0e559747497c95eca32495b1da9a: No bootstrap required, opened a new log
I20260809 19:11:22.679593 26192 ts_tablet_manager.cc:1397] T 85b79983d73b40c5833f131fd6ee160d P a58d0e559747497c95eca32495b1da9a: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.004s
I20260809 19:11:22.684899 25957 heartbeater.cc:503] Master 127.7.39.62:45839 was elected leader, sending a full tablet report...
I20260809 19:11:22.685493 26191 raft_consensus.cc:348] T 85b79983d73b40c5833f131fd6ee160d P a94121d9710e408d8d5b319f29144fa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a58d0e559747497c95eca32495b1da9a" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 46293 } } peers { permanent_uuid: "daef444f205a4b458b66971cad5acb6f" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 34277 } } peers { permanent_uuid: "a94121d9710e408d8d5b319f29144fa7" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35677 } }
I20260809 19:11:22.686079 26191 raft_consensus.cc:374] T 85b79983d73b40c5833f131fd6ee160d P a94121d9710e408d8d5b319f29144fa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:11:22.686241 26191 raft_consensus.cc:729] T 85b79983d73b40c5833f131fd6ee160d P a94121d9710e408d8d5b319f29144fa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a94121d9710e408d8d5b319f29144fa7, State: Initialized, Role: FOLLOWER
I20260809 19:11:22.686978 26191 consensus_queue.cc:260] T 85b79983d73b40c5833f131fd6ee160d P a94121d9710e408d8d5b319f29144fa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a58d0e559747497c95eca32495b1da9a" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 46293 } } peers { permanent_uuid: "daef444f205a4b458b66971cad5acb6f" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 34277 } } peers { permanent_uuid: "a94121d9710e408d8d5b319f29144fa7" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35677 } }
I20260809 19:11:22.689450 26197 raft_consensus.cc:348] T 85b79983d73b40c5833f131fd6ee160d P daef444f205a4b458b66971cad5acb6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a58d0e559747497c95eca32495b1da9a" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 46293 } } peers { permanent_uuid: "daef444f205a4b458b66971cad5acb6f" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 34277 } } peers { permanent_uuid: "a94121d9710e408d8d5b319f29144fa7" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35677 } }
I20260809 19:11:22.690074 26197 raft_consensus.cc:374] T 85b79983d73b40c5833f131fd6ee160d P daef444f205a4b458b66971cad5acb6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:11:22.690274 26197 raft_consensus.cc:729] T 85b79983d73b40c5833f131fd6ee160d P daef444f205a4b458b66971cad5acb6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: daef444f205a4b458b66971cad5acb6f, State: Initialized, Role: FOLLOWER
I20260809 19:11:22.691305 26197 consensus_queue.cc:260] T 85b79983d73b40c5833f131fd6ee160d P daef444f205a4b458b66971cad5acb6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a58d0e559747497c95eca32495b1da9a" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 46293 } } peers { permanent_uuid: "daef444f205a4b458b66971cad5acb6f" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 34277 } } peers { permanent_uuid: "a94121d9710e408d8d5b319f29144fa7" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35677 } }
I20260809 19:11:22.696249 26191 ts_tablet_manager.cc:1428] T 85b79983d73b40c5833f131fd6ee160d P a94121d9710e408d8d5b319f29144fa7: Time spent starting tablet: real 0.024s user 0.004s sys 0.020s
I20260809 19:11:22.697304 26197 ts_tablet_manager.cc:1428] T 85b79983d73b40c5833f131fd6ee160d P daef444f205a4b458b66971cad5acb6f: Time spent starting tablet: real 0.024s user 0.008s sys 0.018s
I20260809 19:11:22.698974 26192 raft_consensus.cc:348] T 85b79983d73b40c5833f131fd6ee160d P a58d0e559747497c95eca32495b1da9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a58d0e559747497c95eca32495b1da9a" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 46293 } } peers { permanent_uuid: "daef444f205a4b458b66971cad5acb6f" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 34277 } } peers { permanent_uuid: "a94121d9710e408d8d5b319f29144fa7" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35677 } }
I20260809 19:11:22.699558 26192 raft_consensus.cc:374] T 85b79983d73b40c5833f131fd6ee160d P a58d0e559747497c95eca32495b1da9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:11:22.699719 26192 raft_consensus.cc:729] T 85b79983d73b40c5833f131fd6ee160d P a58d0e559747497c95eca32495b1da9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a58d0e559747497c95eca32495b1da9a, State: Initialized, Role: FOLLOWER
I20260809 19:11:22.700366 26192 consensus_queue.cc:260] T 85b79983d73b40c5833f131fd6ee160d P a58d0e559747497c95eca32495b1da9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a58d0e559747497c95eca32495b1da9a" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 46293 } } peers { permanent_uuid: "daef444f205a4b458b66971cad5acb6f" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 34277 } } peers { permanent_uuid: "a94121d9710e408d8d5b319f29144fa7" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35677 } }
I20260809 19:11:22.702013 26163 heartbeater.cc:503] Master 127.7.39.62:45839 was elected leader, sending a full tablet report...
I20260809 19:11:22.702670 26192 ts_tablet_manager.cc:1428] T 85b79983d73b40c5833f131fd6ee160d P a58d0e559747497c95eca32495b1da9a: Time spent starting tablet: real 0.023s user 0.014s sys 0.007s
W20260809 19:11:22.751355 26164 tablet.cc:2369] T 85b79983d73b40c5833f131fd6ee160d P a58d0e559747497c95eca32495b1da9a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 19:11:22.859814 25727 tablet.cc:2369] T 85b79983d73b40c5833f131fd6ee160d P daef444f205a4b458b66971cad5acb6f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:11:22.864027 26205 raft_consensus.cc:482] T 85b79983d73b40c5833f131fd6ee160d P daef444f205a4b458b66971cad5acb6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:11:22.864539 26205 raft_consensus.cc:504] T 85b79983d73b40c5833f131fd6ee160d P daef444f205a4b458b66971cad5acb6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a58d0e559747497c95eca32495b1da9a" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 46293 } } peers { permanent_uuid: "daef444f205a4b458b66971cad5acb6f" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 34277 } } peers { permanent_uuid: "a94121d9710e408d8d5b319f29144fa7" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35677 } }
I20260809 19:11:22.867260 26205 leader_election.cc:288] T 85b79983d73b40c5833f131fd6ee160d P daef444f205a4b458b66971cad5acb6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a58d0e559747497c95eca32495b1da9a (127.7.39.3:46293), a94121d9710e408d8d5b319f29144fa7 (127.7.39.2:35677)
I20260809 19:11:22.878445 26187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:11:22.868301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:49009 (local address 127.7.39.2:35677)
0809 19:11:22.868584 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0809 19:11:22.868590 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:11:22.869806 (+ 1216us) server_negotiation.cc:407] Connection header received
0809 19:11:22.870036 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:11:22.870040 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:11:22.870111 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:11:22.870188 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:11:22.871621 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:11:22.872687 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:11:22.875778 (+ 3091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:11:22.877179 (+ 1401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:11:22.877327 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:11:22.877431 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 19:11:22.877868 (+ 437us) server_negotiation.cc:299] Negotiation successful
0809 19:11:22.878008 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260809 19:11:22.878836 26208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:11:22.867773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:35677 (local address 127.7.39.1:49009)
0809 19:11:22.869576 (+ 1803us) negotiation.cc:107] Waiting for socket to connect
0809 19:11:22.869593 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:11:22.869891 (+ 298us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:11:22.870224 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:11:22.870229 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:11:22.870256 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:11:22.871469 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:11:22.871482 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:11:22.872812 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:11:22.872816 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:11:22.875591 (+ 2775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:11:22.875604 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:11:22.877539 (+ 1935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:11:22.877545 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:11:22.877717 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:11:22.877742 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 19:11:22.877825 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 19:11:22.877951 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1611,"mutex_wait_us":60,"thread_start_us":1238,"threads_started":1}
I20260809 19:11:22.879331 26185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:11:22.867690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:36265 (local address 127.7.39.3:46293)
0809 19:11:22.867978 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0809 19:11:22.867984 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:11:22.870970 (+ 2986us) server_negotiation.cc:407] Connection header received
0809 19:11:22.871159 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:11:22.871162 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:11:22.871223 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:11:22.871299 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:11:22.872441 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:11:22.873493 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:11:22.876672 (+ 3179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:11:22.878033 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:11:22.878153 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:11:22.878286 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 19:11:22.878859 (+ 573us) server_negotiation.cc:299] Negotiation successful
0809 19:11:22.878983 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 19:11:22.879758 26209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:11:22.868795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:46293 (local address 127.7.39.1:36265)
0809 19:11:22.870814 (+ 2019us) negotiation.cc:107] Waiting for socket to connect
0809 19:11:22.870832 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 19:11:22.871025 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:11:22.871328 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:11:22.871332 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:11:22.871356 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:11:22.872231 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:11:22.872243 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:11:22.873692 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:11:22.873695 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:11:22.876522 (+ 2827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:11:22.876536 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:11:22.878455 (+ 1919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:11:22.878462 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:11:22.878699 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:11:22.878732 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 19:11:22.878827 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 19:11:22.878953 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1840,"mutex_wait_us":1,"thread_start_us":1428,"threads_started":1}
I20260809 19:11:22.880571 25892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85b79983d73b40c5833f131fd6ee160d" candidate_uuid: "daef444f205a4b458b66971cad5acb6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a94121d9710e408d8d5b319f29144fa7" is_pre_election: true
I20260809 19:11:22.881227 26091 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85b79983d73b40c5833f131fd6ee160d" candidate_uuid: "daef444f205a4b458b66971cad5acb6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a58d0e559747497c95eca32495b1da9a" is_pre_election: true
I20260809 19:11:22.881533 25892 raft_consensus.cc:2454] T 85b79983d73b40c5833f131fd6ee160d P a94121d9710e408d8d5b319f29144fa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate daef444f205a4b458b66971cad5acb6f in term 0.
I20260809 19:11:22.881999 26091 raft_consensus.cc:2454] T 85b79983d73b40c5833f131fd6ee160d P a58d0e559747497c95eca32495b1da9a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate daef444f205a4b458b66971cad5acb6f in term 0.
I20260809 19:11:22.882725 25565 leader_election.cc:302] T 85b79983d73b40c5833f131fd6ee160d P daef444f205a4b458b66971cad5acb6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a94121d9710e408d8d5b319f29144fa7, daef444f205a4b458b66971cad5acb6f; no voters:
I20260809 19:11:22.883361 26205 raft_consensus.cc:2781] T 85b79983d73b40c5833f131fd6ee160d P daef444f205a4b458b66971cad5acb6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:11:22.883625 26205 raft_consensus.cc:482] T 85b79983d73b40c5833f131fd6ee160d P daef444f205a4b458b66971cad5acb6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:11:22.883831 26205 raft_consensus.cc:3037] T 85b79983d73b40c5833f131fd6ee160d P daef444f205a4b458b66971cad5acb6f [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:11:22.887565 26205 raft_consensus.cc:504] T 85b79983d73b40c5833f131fd6ee160d P daef444f205a4b458b66971cad5acb6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a58d0e559747497c95eca32495b1da9a" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 46293 } } peers { permanent_uuid: "daef444f205a4b458b66971cad5acb6f" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 34277 } } peers { permanent_uuid: "a94121d9710e408d8d5b319f29144fa7" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35677 } }
I20260809 19:11:22.888563 26205 leader_election.cc:288] T 85b79983d73b40c5833f131fd6ee160d P daef444f205a4b458b66971cad5acb6f [CANDIDATE]: Term 1 election: Requested vote from peers a58d0e559747497c95eca32495b1da9a (127.7.39.3:46293), a94121d9710e408d8d5b319f29144fa7 (127.7.39.2:35677)
I20260809 19:11:22.889056 26091 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85b79983d73b40c5833f131fd6ee160d" candidate_uuid: "daef444f205a4b458b66971cad5acb6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a58d0e559747497c95eca32495b1da9a"
I20260809 19:11:22.889119 25892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85b79983d73b40c5833f131fd6ee160d" candidate_uuid: "daef444f205a4b458b66971cad5acb6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a94121d9710e408d8d5b319f29144fa7"
I20260809 19:11:22.889367 25892 raft_consensus.cc:3037] T 85b79983d73b40c5833f131fd6ee160d P a94121d9710e408d8d5b319f29144fa7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:11:22.889357 26091 raft_consensus.cc:3037] T 85b79983d73b40c5833f131fd6ee160d P a58d0e559747497c95eca32495b1da9a [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:11:22.894192 25892 raft_consensus.cc:2454] T 85b79983d73b40c5833f131fd6ee160d P a94121d9710e408d8d5b319f29144fa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daef444f205a4b458b66971cad5acb6f in term 1.
I20260809 19:11:22.894351 26091 raft_consensus.cc:2454] T 85b79983d73b40c5833f131fd6ee160d P a58d0e559747497c95eca32495b1da9a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daef444f205a4b458b66971cad5acb6f in term 1.
I20260809 19:11:22.894779 25565 leader_election.cc:302] T 85b79983d73b40c5833f131fd6ee160d P daef444f205a4b458b66971cad5acb6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a94121d9710e408d8d5b319f29144fa7, daef444f205a4b458b66971cad5acb6f; no voters:
I20260809 19:11:22.895140 26205 raft_consensus.cc:2781] T 85b79983d73b40c5833f131fd6ee160d P daef444f205a4b458b66971cad5acb6f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:11:22.896251 26205 raft_consensus.cc:686] T 85b79983d73b40c5833f131fd6ee160d P daef444f205a4b458b66971cad5acb6f [term 1 LEADER]: Becoming Leader. State: Replica: daef444f205a4b458b66971cad5acb6f, State: Running, Role: LEADER
I20260809 19:11:22.897189 26205 consensus_queue.cc:237] T 85b79983d73b40c5833f131fd6ee160d P daef444f205a4b458b66971cad5acb6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a58d0e559747497c95eca32495b1da9a" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 46293 } } peers { permanent_uuid: "daef444f205a4b458b66971cad5acb6f" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 34277 } } peers { permanent_uuid: "a94121d9710e408d8d5b319f29144fa7" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35677 } }
I20260809 19:11:22.902654 25399 catalog_manager.cc:5495] T 85b79983d73b40c5833f131fd6ee160d P daef444f205a4b458b66971cad5acb6f reported cstate change: term changed from 0 to 1, leader changed from <none> to daef444f205a4b458b66971cad5acb6f (127.7.39.1). New cstate: current_term: 1 leader_uuid: "daef444f205a4b458b66971cad5acb6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a58d0e559747497c95eca32495b1da9a" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 46293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "daef444f205a4b458b66971cad5acb6f" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 34277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a94121d9710e408d8d5b319f29144fa7" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35677 } health_report { overall_health: UNKNOWN } } }
W20260809 19:11:22.903189 25958 tablet.cc:2369] T 85b79983d73b40c5833f131fd6ee160d P a94121d9710e408d8d5b319f29144fa7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:11:22.984033 26189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:11:22.976218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52748 (local address 127.7.39.1:34277)
0809 19:11:22.976550 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0809 19:11:22.976557 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:11:22.976580 (+ 23us) server_negotiation.cc:407] Connection header received
0809 19:11:22.976770 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:11:22.976774 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:11:22.976864 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:11:22.977037 (+ 173us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:11:22.977673 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:11:22.978890 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:11:22.981012 (+ 2122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:11:22.981858 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:11:22.981991 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:11:22.982809 (+ 818us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:11:22.983330 (+ 521us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:11:22.983535 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0809 19:11:22.983591 (+ 56us) server_negotiation.cc:299] Negotiation successful
0809 19:11:22.983677 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260809 19:11:22.996140 25892 raft_consensus.cc:1261] T 85b79983d73b40c5833f131fd6ee160d P a94121d9710e408d8d5b319f29144fa7 [term 1 FOLLOWER]: Refusing update from remote peer daef444f205a4b458b66971cad5acb6f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:11:22.996251 26091 raft_consensus.cc:1261] T 85b79983d73b40c5833f131fd6ee160d P a58d0e559747497c95eca32495b1da9a [term 1 FOLLOWER]: Refusing update from remote peer daef444f205a4b458b66971cad5acb6f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:11:22.997218 26210 consensus_queue.cc:1035] T 85b79983d73b40c5833f131fd6ee160d P daef444f205a4b458b66971cad5acb6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a94121d9710e408d8d5b319f29144fa7" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:11:22.997763 26205 consensus_queue.cc:1035] T 85b79983d73b40c5833f131fd6ee160d P daef444f205a4b458b66971cad5acb6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a58d0e559747497c95eca32495b1da9a" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 46293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:11:23.036335 25399 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41012:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:11:23.036679 25399 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41012:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:11:23.041260 25399 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8202ff5e9c1749e9b05ec8b29ad54d17: Sending DeleteTablet for 3 replicas of tablet 85b79983d73b40c5833f131fd6ee160d
I20260809 19:11:23.042537 26058 tablet_service.cc:1514] Processing DeleteTablet for tablet 85b79983d73b40c5833f131fd6ee160d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:11:23 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:39454
I20260809 19:11:23.042685 25624 tablet_service.cc:1514] Processing DeleteTablet for tablet 85b79983d73b40c5833f131fd6ee160d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:11:23 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:52732
I20260809 19:11:23.042794 25857 tablet_service.cc:1514] Processing DeleteTablet for tablet 85b79983d73b40c5833f131fd6ee160d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:11:23 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:42580
I20260809 19:11:23.046799 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 25528
I20260809 19:11:23.055073 26226 tablet_replica.cc:330] T 85b79983d73b40c5833f131fd6ee160d P a58d0e559747497c95eca32495b1da9a: stopping tablet replica
I20260809 19:11:23.055488 26226 raft_consensus.cc:2229] T 85b79983d73b40c5833f131fd6ee160d P a58d0e559747497c95eca32495b1da9a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:11:23.055859 26230 tablet_replica.cc:330] T 85b79983d73b40c5833f131fd6ee160d P a94121d9710e408d8d5b319f29144fa7: stopping tablet replica
I20260809 19:11:23.055960 26226 raft_consensus.cc:2258] T 85b79983d73b40c5833f131fd6ee160d P a58d0e559747497c95eca32495b1da9a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:11:23.056908 26229 tablet_replica.cc:330] T 85b79983d73b40c5833f131fd6ee160d P daef444f205a4b458b66971cad5acb6f: stopping tablet replica
I20260809 19:11:23.057318 26229 raft_consensus.cc:2229] T 85b79983d73b40c5833f131fd6ee160d P daef444f205a4b458b66971cad5acb6f [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:11:23.058046 26226 ts_tablet_manager.cc:1905] T 85b79983d73b40c5833f131fd6ee160d P a58d0e559747497c95eca32495b1da9a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:11:23.058051 26229 raft_consensus.cc:2258] T 85b79983d73b40c5833f131fd6ee160d P daef444f205a4b458b66971cad5acb6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:11:23.058717 26230 raft_consensus.cc:2229] T 85b79983d73b40c5833f131fd6ee160d P a94121d9710e408d8d5b319f29144fa7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:11:23.059250 26230 raft_consensus.cc:2258] T 85b79983d73b40c5833f131fd6ee160d P a94121d9710e408d8d5b319f29144fa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:11:23.060416 26229 ts_tablet_manager.cc:1905] T 85b79983d73b40c5833f131fd6ee160d P daef444f205a4b458b66971cad5acb6f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:11:23.062029 26230 ts_tablet_manager.cc:1905] T 85b79983d73b40c5833f131fd6ee160d P a94121d9710e408d8d5b319f29144fa7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:11:23.068084 26226 ts_tablet_manager.cc:1918] T 85b79983d73b40c5833f131fd6ee160d P a58d0e559747497c95eca32495b1da9a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:11:23.068363 26226 log.cc:1196] T 85b79983d73b40c5833f131fd6ee160d P a58d0e559747497c95eca32495b1da9a: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-2/wal/wals/85b79983d73b40c5833f131fd6ee160d
I20260809 19:11:23.069075 26226 ts_tablet_manager.cc:1939] T 85b79983d73b40c5833f131fd6ee160d P a58d0e559747497c95eca32495b1da9a: Deleting consensus metadata
I20260809 19:11:23.071285 25374 catalog_manager.cc:4841] TS a58d0e559747497c95eca32495b1da9a (127.7.39.3:46293): tablet 85b79983d73b40c5833f131fd6ee160d (table test-table [id=d68ad78f0c22426bac8ff09adfad46e8]) successfully deleted
I20260809 19:11:23.072994 26229 ts_tablet_manager.cc:1918] T 85b79983d73b40c5833f131fd6ee160d P daef444f205a4b458b66971cad5acb6f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:11:23.073311 26229 log.cc:1196] T 85b79983d73b40c5833f131fd6ee160d P daef444f205a4b458b66971cad5acb6f: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-0/wal/wals/85b79983d73b40c5833f131fd6ee160d
I20260809 19:11:23.074223 26229 ts_tablet_manager.cc:1939] T 85b79983d73b40c5833f131fd6ee160d P daef444f205a4b458b66971cad5acb6f: Deleting consensus metadata
Aug 09 19:11:23 dist-test-slave-4tdj krb5kdc[24670](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302677, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.1@KRBTEST.COM
I20260809 19:11:23.075395 26230 ts_tablet_manager.cc:1918] T 85b79983d73b40c5833f131fd6ee160d P a94121d9710e408d8d5b319f29144fa7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:11:23.075807 26230 log.cc:1196] T 85b79983d73b40c5833f131fd6ee160d P a94121d9710e408d8d5b319f29144fa7: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786302538618573-7324-0/minicluster-data/ts-1/wal/wals/85b79983d73b40c5833f131fd6ee160d
I20260809 19:11:23.076325 25374 catalog_manager.cc:4841] TS daef444f205a4b458b66971cad5acb6f (127.7.39.1:34277): tablet 85b79983d73b40c5833f131fd6ee160d (table test-table [id=d68ad78f0c22426bac8ff09adfad46e8]) successfully deleted
I20260809 19:11:23.076745 26230 ts_tablet_manager.cc:1939] T 85b79983d73b40c5833f131fd6ee160d P a94121d9710e408d8d5b319f29144fa7: Deleting consensus metadata
I20260809 19:11:23.078421 25376 catalog_manager.cc:4841] TS a94121d9710e408d8d5b319f29144fa7 (127.7.39.2:35677): tablet 85b79983d73b40c5833f131fd6ee160d (table test-table [id=d68ad78f0c22426bac8ff09adfad46e8]) successfully deleted
I20260809 19:11:23.085732 26189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:11:23.048233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52758 (local address 127.7.39.1:34277)
0809 19:11:23.048401 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 19:11:23.048407 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:11:23.061050 (+ 12643us) server_negotiation.cc:407] Connection header received
0809 19:11:23.061503 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:11:23.061509 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:11:23.061593 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:11:23.061679 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:11:23.063806 (+ 2127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:11:23.065094 (+ 1288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:11:23.066984 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:11:23.067877 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:11:23.068085 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:11:23.076082 (+ 7997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:11:23.076098 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:11:23.076116 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:11:23.076185 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:11:23.081889 (+ 5704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:11:23.082750 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:11:23.082759 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:11:23.082764 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:11:23.083113 (+ 349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:11:23.083555 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:11:23.083560 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:11:23.083564 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:11:23.084142 (+ 578us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:11:23.084619 (+ 477us) server_negotiation.cc:1035] Waiting for connection context
0809 19:11:23.084846 (+ 227us) server_negotiation.cc:299] Negotiation successful
0809 19:11:23.085119 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 19:11:23.086942 25718 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:11:23.185514 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 25528
I20260809 19:11:23.208042 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 25737
Aug 09 19:11:23 dist-test-slave-4tdj krb5kdc[24670](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302677, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.2@KRBTEST.COM
I20260809 19:11:23.222527 26187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:11:23.208809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42596 (local address 127.7.39.2:35677)
0809 19:11:23.208975 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 19:11:23.208981 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:11:23.209002 (+ 21us) server_negotiation.cc:407] Connection header received
0809 19:11:23.209203 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:11:23.209207 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:11:23.209274 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:11:23.209357 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:11:23.210696 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:11:23.211376 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:11:23.212683 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:11:23.213096 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:11:23.213226 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:11:23.217296 (+ 4070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:11:23.217310 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:11:23.217324 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:11:23.217369 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:11:23.219873 (+ 2504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:11:23.220549 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:11:23.220555 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:11:23.220557 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:11:23.220687 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:11:23.221059 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:11:23.221062 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:11:23.221064 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:11:23.221416 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:11:23.221615 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0809 19:11:23.221925 (+ 310us) server_negotiation.cc:299] Negotiation successful
0809 19:11:23.222086 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 19:11:23.223138 25950 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:11:23.311189 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 25737
I20260809 19:11:23.332252 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 25967
Aug 09 19:11:23 dist-test-slave-4tdj krb5kdc[24670](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302677, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.3@KRBTEST.COM
I20260809 19:11:23.350009 26185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:11:23.332958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39470 (local address 127.7.39.3:46293)
0809 19:11:23.333123 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 19:11:23.333128 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:11:23.333146 (+ 18us) server_negotiation.cc:407] Connection header received
0809 19:11:23.333294 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:11:23.333298 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:11:23.333366 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:11:23.333456 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:11:23.334635 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:11:23.335325 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:11:23.336592 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:11:23.337003 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:11:23.337095 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:11:23.345186 (+ 8091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:11:23.345201 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:11:23.345229 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:11:23.345263 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:11:23.347831 (+ 2568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:11:23.348394 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:11:23.348400 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:11:23.348402 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:11:23.348542 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:11:23.348814 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:11:23.348816 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:11:23.348818 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:11:23.349189 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:11:23.349400 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0809 19:11:23.349605 (+ 205us) server_negotiation.cc:299] Negotiation successful
0809 19:11:23.349758 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 19:11:23.350639 26155 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:11:23.437216 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 25967
I20260809 19:11:23.456915 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 25340
I20260809 19:11:23.458096 25449 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:11:23.567839 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 25340
I20260809 19:11:23.594249 7324 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 19:11:23.928015 7324 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 19:11:23.928319 7324 mini_ranger.cc:66] Stopping Ranger...
I20260809 19:11:24.272506 7324 mini_ranger.cc:68] Stopped Ranger
2026-08-09 19:11:24.272 UTC [24718] LOG: received smart shutdown request
2026-08-09 19:11:24.276 UTC [24718] LOG: background worker "logical replication launcher" (PID 24734) exited with exit code 1
2026-08-09 19:11:24.276 UTC [24722] LOG: shutting down
2026-08-09 19:11:24.411 UTC [24718] LOG: database system is shut down
2026-08-09T19:11:24Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (50129 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:11:24 dist-test-slave-4tdj krb5kdc[26250](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:11:24 dist-test-slave-4tdj krb5kdc[26250](info): set up 2 sockets
Aug 09 19:11:24 dist-test-slave-4tdj krb5kdc[26250](info): commencing operation
krb5kdc: starting...
W20260809 19:11:25.736220 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.184s user 0.006s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:11:25 dist-test-slave-4tdj krb5kdc[26250](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302685, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:11:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:11:25Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.7.39.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.7.39.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.7.39.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/rangeradmin_127.7.39.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.7.39.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/rangeradmin_127.7.39.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.7.39.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.7.39.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.7.39.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/rangerlookup_127.7.39.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.7.39.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/rangerlookup_127.7.39.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.7.39.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.7.39.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.7.39.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/HTTP_127.7.39.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.7.39.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/HTTP_127.7.39.20@KRBTEST.COM.keytab.
I20260809 19:11:26.038273 7324 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskP6iNI4/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/postgres -l logfile start
2026-08-09 19:11:28.232 UTC [26301] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 19:11:28.233 UTC [26301] LOG: listening on IPv4 address "127.7.39.20", port 37999
2026-08-09 19:11:28.235 UTC [26301] LOG: listening on Unix socket "/tmp/.s.PGSQL.37999"
2026-08-09 19:11:28.254 UTC [26304] LOG: database system was shut down at 2026-08-09 19:11:27 UTC
2026-08-09 19:11:28.258 UTC [26301] LOG: database system is ready to accept connections
I20260809 19:11:29.337292 7324 mini_postgres.cc:96] Postgres bound to 37999
2026-08-09 19:11:29.360 UTC [26314] FATAL: database "slave" does not exist
127.7.39.20:37999 - accepting connections
I20260809 19:11:29.360747 7324 mini_ranger.cc:161] Starting Ranger...
I20260809 19:11:29.385082 7324 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 19:11:29.779137 7324 mini_ranger.cc:87] Created ranger Postgres database
I20260809 19:11:29.779233 7324 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ranger-admin
2026-08-09 19:11:30,075 [I] DB FLAVOR :POSTGRES
2026-08-09 19:11:30,075 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 19:11:30,075 [I] Checking connection..
2026-08-09 19:11:30,075 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:37999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 19:11:30,333 [I] Checking connection passed.
2026-08-09 19:11:30,333 [I] --------- Verifying version history table ---------
2026-08-09 19:11:30,333 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:37999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 19:11:30,581 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 19:11:30,581 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:37999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 19:11:30,829 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 19:11:30,830 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 19:11:30,830 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:37999/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 19:11:31.071 UTC [26422] WARNING: there is no transaction in progress
2026-08-09 19:11:31,080 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 19:11:31,080 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:37999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 19:11:31,346 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 19:11:31,347 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 19:11:31,347 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:37999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 19:11:31,608 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:37999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 19:11:31,861 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:37999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-4tdj.c.gcp-upstream.internal','N') ;"
2026-08-09 19:11:32,097 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:37999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 19:11:32,333 [I] Table x_portal_user does not exist in database ranger
2026-08-09 19:11:32,334 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:37999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 19:11:32,566 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 19:11:32,567 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:37999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 19:11:32,798 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:37999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 19:11:33,046 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 19:11:33,046 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:37999/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 19:11:33.906 UTC [26622] WARNING: there is no transaction in progress
2026-08-09 19:11:33.921 UTC [26622] WARNING: there is no transaction in progress
2026-08-09 19:11:33.935 UTC [26622] WARNING: there is no transaction in progress
2026-08-09 19:11:33.948 UTC [26622] WARNING: there is no transaction in progress
2026-08-09 19:11:33.962 UTC [26622] WARNING: there is no transaction in progress
2026-08-09 19:11:33.977 UTC [26622] WARNING: there is no transaction in progress
2026-08-09 19:11:34.025 UTC [26622] WARNING: there is no transaction in progress
2026-08-09 19:11:34.030 UTC [26622] WARNING: there is no transaction in progress
2026-08-09 19:11:34.043 UTC [26622] WARNING: there is no transaction in progress
2026-08-09 19:11:34.052 UTC [26622] WARNING: there is no transaction in progress
2026-08-09 19:11:34.061 UTC [26622] WARNING: there is no transaction in progress
2026-08-09 19:11:34.073 UTC [26622] WARNING: there is no transaction in progress
2026-08-09 19:11:34.081 UTC [26622] WARNING: there is no transaction in progress
2026-08-09 19:11:34.086 UTC [26622] WARNING: there is no transaction in progress
2026-08-09 19:11:34.092 UTC [26622] WARNING: there is no transaction in progress
2026-08-09 19:11:34.097 UTC [26622] WARNING: there is no transaction in progress
2026-08-09 19:11:34,629 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 19:11:34,629 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:37999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 19:11:34,882 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 19:11:34,882 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:37999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 19:11:35,141 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 19:11:35,141 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:37999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 19:11:35,385 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 19:11:35,385 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:37999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 19:11:35,619 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:37999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 19:11:35,864 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:37999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-4tdj.c.gcp-upstream.internal';"
2026-08-09 19:11:36,107 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 19:11:36,108 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:37999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 19:11:36,350 [I] DB_PATCHES have already been applied
I20260809 19:11:36.355999 7324 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ranger-admin:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskP6iNI4/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 19:11:36.356086 7324 mini_ranger.cc:193] Using host: 127.7.39.20
I20260809 19:11:36.373369 7324 mini_ranger.cc:227] Ranger admin URL: http://127.7.39.20:58537
Aug 09, 2026 7:11:36 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 7:11:36 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 7:11:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 7:11:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 7:11:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 7:11:37 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 7:11:37 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 19:11:37.588523 7324 mini_ranger.cc:160] Time spent starting Ranger: real 8.228s user 0.000s sys 0.044s
Aug 09, 2026 7:11:56 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 7:11:56 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 09, 2026 7:11:56 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 7:11:56 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 7:11:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 7:11:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 7:11:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 7:11:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 7:11:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 7:11:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 7:11:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 7:11:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 7:11:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 7:11:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 7:11:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 7:11:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 7:11:56 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 7:11:57 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 19:11:58.132565 7324 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.7.39.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.7.39.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.7.39.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/rangerkms_127.7.39.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.7.39.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/rangerkms_127.7.39.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.7.39.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.7.39.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.7.39.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/HTTP_127.7.39.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.7.39.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/HTTP_127.7.39.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 19:11:58 dist-test-slave-4tdj krb5kdc[26250](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302718, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 19:11:58.288440 7324 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 19:11:58.306908 7324 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 19:11:58.995949 7324 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 19:11:58.996059 7324 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ranger-kms
I20260809 19:11:58.996101 7324 mini_ranger_kms.cc:227] Using postgres at 127.7.39.20:37999
2026-08-09 19:11:59,326 [I] DB FLAVOR :POSTGRES
2026-08-09 19:11:59,326 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 19:11:59,326 [I] Checking connection
2026-08-09 19:11:59,326 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:37999/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 19:11:59,549 [I] connection success
2026-08-09 19:11:59,549 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 19:11:59,550 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 19:11:59,550 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:37999/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 19:11:59,769 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 19:11:59,769 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 19:11:59,769 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 19:11:59,769 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.39.20:37999/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 19:12:00,017 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 19:12:00.426064 7324 mini_ranger_kms.cc:310] Created kms service
I20260809 19:12:00.637995 7324 mini_ranger_kms.cc:326] Created kudu user
I20260809 19:12:00.679016 7324 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 19:12:00 dist-test-slave-4tdj krb5kdc[26250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302718, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.7.39.20@KRBTEST.COM
I20260809 19:12:01.090822 7324 mini_ranger_kms.cc:384] Added ranger policy
I20260809 19:12:01.091157 7324 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ranger-kms:/tmp/dist-test-taskP6iNI4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskP6iNI4/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 19:12:01.091213 7324 mini_ranger_kms.cc:240] Using host: 127.7.39.20
I20260809 19:12:01.110939 7324 mini_ranger_kms.cc:276] Ranger KMS PID: 26914
I20260809 19:12:01.111089 7324 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.7.39.20:39401
Aug 09, 2026 7:12:02 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 7:12:02 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 7:12:02 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 7:12:02 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 7:12:02 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 7:12:02 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 09 19:12:03 dist-test-slave-4tdj krb5kdc[26250](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786302723, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.7.39.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:12:03.611847 7324 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.323s user 0.071s sys 0.281s
I20260809 19:12:03.612080 7324 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 19:12:03.612241 7324 mini_ranger_kms.cc:401] 127.7.39.20:39401/kms/v1/keys
Aug 09 19:12:03 dist-test-slave-4tdj krb5kdc[26250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302723, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.7.39.20@KRBTEST.COM for HTTP/127.7.39.20@KRBTEST.COM
Aug 09 19:12:04 dist-test-slave-4tdj krb5kdc[26250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302723, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.7.39.20@KRBTEST.COM for HTTP/127.7.39.20@KRBTEST.COM
Aug 09 19:12:06 dist-test-slave-4tdj krb5kdc[26250](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302726, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.7.39.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
I20260809 19:12:06.527587 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:41999
--webserver_interface=127.7.39.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:39363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:41999
--ranger_config_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.39.20:39401/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:12:06.850441 27000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:12:06.850705 27000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:12:06.850816 27000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:12:06.857915 27000 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:12:06.858011 27000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:12:06.858073 27000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:12:06.858148 27000 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:12:06.858212 27000 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:12:06.868029 27000 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:39363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/master-0/wal
--ranger_kms_url=127.7.39.20:39401/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:41999
--ranger_config_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:41999
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:12:06.869222 27000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:12:06.870661 27000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:12:06.882424 27006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:06.882732 27005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:06.883188 27009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:12:06.883742 27000 server_base.cc:1034] running on GCE node
I20260809 19:12:06.884443 27000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:12:06.885833 27000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:12:06.887080 27000 hybrid_clock.cc:648] HybridClock initialized: now 1786302726887023 us; error 45 us; skew 500 ppm
I20260809 19:12:06.887437 27000 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:12:06 dist-test-slave-4tdj krb5kdc[26250](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302726, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:12:06.896268 27000 init.cc:377] Logged in from keytab as kudu/127.7.39.62@KRBTEST.COM (short username kudu)
I20260809 19:12:06.897742 27000 webserver.cc:460] Webserver started at http://127.7.39.62:35755/ using document root <none> and password file <none>
I20260809 19:12:06.898403 27000 fs_manager.cc:359] Metadata directory not provided
I20260809 19:12:06.898514 27000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:12:06.898810 27000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 19:12:06 dist-test-slave-4tdj krb5kdc[26250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302726, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for HTTP/127.7.39.20@KRBTEST.COM
I20260809 19:12:06.962985 27000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "841e0dd854d34cb4aec81c033bcd0e27"
format_stamp: "Formatted at 2026-08-09 19:12:06 on dist-test-slave-4tdj"
server_key: "f19f9a621c80c5ec064f9afb82fe1909"
server_key_iv: "d47c8fe38684635e329aa0ea0a2b53b0"
server_key_version: "kuduclusterkey@0"
I20260809 19:12:06.963917 27000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "841e0dd854d34cb4aec81c033bcd0e27"
format_stamp: "Formatted at 2026-08-09 19:12:06 on dist-test-slave-4tdj"
server_key: "f19f9a621c80c5ec064f9afb82fe1909"
server_key_iv: "d47c8fe38684635e329aa0ea0a2b53b0"
server_key_version: "kuduclusterkey@0"
I20260809 19:12:06.969498 27000 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 19:12:06.989056 27020 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:06.990577 27000 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 19:12:06.990743 27000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "841e0dd854d34cb4aec81c033bcd0e27"
format_stamp: "Formatted at 2026-08-09 19:12:06 on dist-test-slave-4tdj"
server_key: "f19f9a621c80c5ec064f9afb82fe1909"
server_key_iv: "d47c8fe38684635e329aa0ea0a2b53b0"
server_key_version: "kuduclusterkey@0"
I20260809 19:12:06.990953 27000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:12:07.009773 27000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:12:07.013597 27000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:12:07.013888 27000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:12:07.045663 27000 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:41999
I20260809 19:12:07.045670 27102 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:41999 every 8 connection(s)
I20260809 19:12:07.047442 27000 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:12:07.050617 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 27000
I20260809 19:12:07.050839 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:12:07.051697 27103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:12:07.051693 7324 external_mini_cluster.cc:1428] Setting key dbb5b04836aaefc62c65b0d1a8d43323
I20260809 19:12:07.063995 27103 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27: Bootstrap starting.
Aug 09 19:12:07 dist-test-slave-4tdj krb5kdc[26250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302726, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:12:07.067001 27103 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27: Neither blocks nor log segments found. Creating new log.
I20260809 19:12:07.068168 27103 log.cc:824] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27: Log is configured to *not* fsync() on all Append() calls
I20260809 19:12:07.071230 27103 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27: No bootstrap required, opened a new log
I20260809 19:12:07.074646 27106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:07.053782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45370 (local address 127.7.39.62:41999)
0809 19:12:07.056208 (+ 2426us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:07.056220 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:07.056259 (+ 39us) server_negotiation.cc:407] Connection header received
0809 19:12:07.058224 (+ 1965us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:07.058245 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:07.058685 (+ 440us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:07.059034 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:07.060358 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:07.061655 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:07.062941 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:07.063572 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:07.063736 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:07.067546 (+ 3810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:07.067556 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:07.067569 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:07.067607 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:07.070651 (+ 3044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:07.071418 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:07.071424 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:07.071430 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:07.071604 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:07.072030 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:07.072033 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:07.072035 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:07.072498 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:07.072723 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:07.073189 (+ 466us) server_negotiation.cc:299] Negotiation successful
0809 19:12:07.073468 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2184,"thread_start_us":1950,"threads_started":1}
I20260809 19:12:07.079833 27103 raft_consensus.cc:348] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "841e0dd854d34cb4aec81c033bcd0e27" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 41999 } }
I20260809 19:12:07.080183 27103 raft_consensus.cc:374] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:12:07.080268 27103 raft_consensus.cc:729] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841e0dd854d34cb4aec81c033bcd0e27, State: Initialized, Role: FOLLOWER
I20260809 19:12:07.080765 27103 consensus_queue.cc:260] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "841e0dd854d34cb4aec81c033bcd0e27" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 41999 } }
I20260809 19:12:07.080968 27103 raft_consensus.cc:388] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:12:07.081146 27103 raft_consensus.cc:482] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:12:07.081346 27103 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:12:07.083590 27103 raft_consensus.cc:504] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "841e0dd854d34cb4aec81c033bcd0e27" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 41999 } }
I20260809 19:12:07.084033 27103 leader_election.cc:302] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 841e0dd854d34cb4aec81c033bcd0e27; no voters:
I20260809 19:12:07.084561 27103 leader_election.cc:288] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:12:07.084664 27109 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:12:07.085327 27109 raft_consensus.cc:686] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27 [term 1 LEADER]: Becoming Leader. State: Replica: 841e0dd854d34cb4aec81c033bcd0e27, State: Running, Role: LEADER
I20260809 19:12:07.085883 27109 consensus_queue.cc:237] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "841e0dd854d34cb4aec81c033bcd0e27" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 41999 } }
I20260809 19:12:07.086416 27103 sys_catalog.cc:564] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:12:07.088336 27112 sys_catalog.cc:455] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 841e0dd854d34cb4aec81c033bcd0e27. Latest consensus state: current_term: 1 leader_uuid: "841e0dd854d34cb4aec81c033bcd0e27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "841e0dd854d34cb4aec81c033bcd0e27" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 41999 } } }
I20260809 19:12:07.088625 27112 sys_catalog.cc:458] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27 [sys.catalog]: This master's current role is: LEADER
I20260809 19:12:07.090158 27115 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:12:07.089991 27110 sys_catalog.cc:455] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "841e0dd854d34cb4aec81c033bcd0e27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "841e0dd854d34cb4aec81c033bcd0e27" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 41999 } } }
I20260809 19:12:07.090363 27110 sys_catalog.cc:458] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27 [sys.catalog]: This master's current role is: LEADER
I20260809 19:12:07.095083 27115 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:12:07.097308 27103 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 19:12:07.110066 27115 catalog_manager.cc:1347] Generated new cluster ID: 4601bd119eaa482683b479d5cb9e4e9a
I20260809 19:12:07.110911 27115 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:12:07.131178 27115 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:12:07.133031 27115 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:12:07.152082 27115 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27: Generated new TSK 0
I20260809 19:12:07.153187 27115 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.39.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
I20260809 19:12:07.865453 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.39.20:39401/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.1:0
--local_ip_for_outbound_sockets=127.7.39.1
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:41999
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:39363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 19:12:08 dist-test-slave-4tdj krb5kdc[26250](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786302728, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260809 19:12:08.288913 27162 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:12:08.289300 27162 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:12:08.289525 27162 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:12:08.300962 27162 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:12:08.301121 27162 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:12:08.301316 27162 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.1
I20260809 19:12:08.316661 27162 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:39363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.7.39.20:39401/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:41999
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.1
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:12:08.318338 27162 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:12:08.320039 27162 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:12:08.339155 27180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:08.339123 27179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:08.343178 27188 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:12:08.344503 27162 server_base.cc:1034] running on GCE node
I20260809 19:12:08.345242 27162 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:12:08.346454 27162 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:12:08.347703 27162 hybrid_clock.cc:648] HybridClock initialized: now 1786302728347651 us; error 37 us; skew 500 ppm
I20260809 19:12:08.348070 27162 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:12:08 dist-test-slave-4tdj krb5kdc[26250](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302728, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:12:08.351800 27162 init.cc:377] Logged in from keytab as kudu/127.7.39.1@KRBTEST.COM (short username kudu)
I20260809 19:12:08.355469 27162 webserver.cc:460] Webserver started at http://127.7.39.1:33613/ using document root <none> and password file <none>
I20260809 19:12:08.356158 27162 fs_manager.cc:359] Metadata directory not provided
I20260809 19:12:08.356272 27162 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:12:08.356570 27162 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 19:12:08 dist-test-slave-4tdj krb5kdc[26250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302728, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for HTTP/127.7.39.20@KRBTEST.COM
I20260809 19:12:08.388464 27162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-0/data/instance:
uuid: "ac251c4c0b8e4d9fb76652ceccfe6c91"
format_stamp: "Formatted at 2026-08-09 19:12:08 on dist-test-slave-4tdj"
server_key: "0230aa5af411f6d8b22f720a9ceae0a4"
server_key_iv: "3df06648f6e708db053021fb5c61fecd"
server_key_version: "kuduclusterkey@0"
I20260809 19:12:08.389601 27162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance:
uuid: "ac251c4c0b8e4d9fb76652ceccfe6c91"
format_stamp: "Formatted at 2026-08-09 19:12:08 on dist-test-slave-4tdj"
server_key: "0230aa5af411f6d8b22f720a9ceae0a4"
server_key_iv: "3df06648f6e708db053021fb5c61fecd"
server_key_version: "kuduclusterkey@0"
I20260809 19:12:08.412256 27162 fs_manager.cc:691] Time spent creating directory manager: real 0.022s user 0.011s sys 0.007s
I20260809 19:12:08.439194 27204 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:08.441131 27162 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.004s sys 0.004s
I20260809 19:12:08.441417 27162 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-0/wal
uuid: "ac251c4c0b8e4d9fb76652ceccfe6c91"
format_stamp: "Formatted at 2026-08-09 19:12:08 on dist-test-slave-4tdj"
server_key: "0230aa5af411f6d8b22f720a9ceae0a4"
server_key_iv: "3df06648f6e708db053021fb5c61fecd"
server_key_version: "kuduclusterkey@0"
I20260809 19:12:08.441752 27162 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:12:08.491134 27162 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:12:08.496714 27162 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:12:08.497159 27162 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:12:08.514703 27162 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:12:08.528318 27162 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:12:08.528493 27162 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:08.528712 27162 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:12:08.528836 27162 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 19:12:08 dist-test-slave-4tdj krb5kdc[26250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302728, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for HTTP/127.7.39.20@KRBTEST.COM
I20260809 19:12:08.724355 27162 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.1:46401
I20260809 19:12:08.724375 27371 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.1:46401 every 8 connection(s)
I20260809 19:12:08.726043 27162 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
I20260809 19:12:08.735519 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 27162
I20260809 19:12:08.735767 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance
I20260809 19:12:08.736658 7324 external_mini_cluster.cc:1428] Setting key 281a8070de3bdcf298055820b6c0ca8e
Aug 09 19:12:08 dist-test-slave-4tdj krb5kdc[26250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302728, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:12:08.754602 27375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:08.728723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:46961 (local address 127.7.39.62:41999)
0809 19:12:08.729161 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:08.729165 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:08.730201 (+ 1036us) server_negotiation.cc:407] Connection header received
0809 19:12:08.732031 (+ 1830us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:08.732037 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:08.732127 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:08.732225 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:08.733653 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:08.734441 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:08.736076 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:08.736476 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:08.736597 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:08.747440 (+ 10843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:08.747447 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:08.747452 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:08.747504 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:08.750955 (+ 3451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:08.751875 (+ 920us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:08.751881 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:08.751885 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:08.752050 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:08.752566 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:08.752571 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:08.752573 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:08.752907 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:08.753033 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:08.754009 (+ 976us) server_negotiation.cc:299] Negotiation successful
0809 19:12:08.754222 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":226,"threads_started":1}
I20260809 19:12:08.757169 27377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:08.729299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:41999 (local address 127.7.39.1:46961)
0809 19:12:08.730052 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:08.730089 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:08.731768 (+ 1679us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:08.732467 (+ 699us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:08.732475 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:08.732920 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:12:08.733486 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:08.733503 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:08.734586 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:08.734589 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:08.735944 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:08.735957 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:08.736686 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:08.736694 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:08.736946 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:08.737630 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:12:08.737662 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:12:08.747134 (+ 9472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:12:08.751146 (+ 4012us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:08.751157 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:08.751175 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:08.751738 (+ 563us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:08.752197 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:08.752201 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:08.752204 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:08.752444 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:08.753144 (+ 700us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:12:08.753152 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:12:08.753569 (+ 417us) client_negotiation.cc:769] Sending connection context
0809 19:12:08.755228 (+ 1659us) client_negotiation.cc:240] Negotiation successful
0809 19:12:08.755776 (+ 548us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":313,"threads_started":1}
I20260809 19:12:08.759243 27372 heartbeater.cc:347] Connected to a master server at 127.7.39.62:41999
I20260809 19:12:08.759562 27372 heartbeater.cc:464] Registering TS with master...
I20260809 19:12:08.760401 27372 heartbeater.cc:511] Master 127.7.39.62:41999 requested a full tablet report, sending...
I20260809 19:12:08.763090 27048 ts_manager.cc:194] Registered new tserver with Master: ac251c4c0b8e4d9fb76652ceccfe6c91 (127.7.39.1:46401)
I20260809 19:12:08.765202 27048 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.1@KRBTEST.COM'} at 127.7.39.1:46961
WARNING: no policy specified for kudu/127.7.39.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
I20260809 19:12:08.805398 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.39.20:39401/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.2:0
--local_ip_for_outbound_sockets=127.7.39.2
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:41999
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:39363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 19:12:08 dist-test-slave-4tdj krb5kdc[26250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302728, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for HTTP/127.7.39.20@KRBTEST.COM
W20260809 19:12:09.256181 27381 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:12:09.256613 27381 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:12:09.256801 27381 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:12:09.264016 27381 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:12:09.264120 27381 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:12:09.264276 27381 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.2
I20260809 19:12:09.273564 27381 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:39363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.7.39.20:39401/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:41999
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.2
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:12:09.274755 27381 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:12:09.275979 27381 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:12:09.287837 27398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:09.287899 27406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:09.287878 27399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:12:09.288720 27381 server_base.cc:1034] running on GCE node
I20260809 19:12:09.289233 27381 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:12:09.290041 27381 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:12:09.291249 27381 hybrid_clock.cc:648] HybridClock initialized: now 1786302729291209 us; error 31 us; skew 500 ppm
I20260809 19:12:09.291566 27381 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:12:09 dist-test-slave-4tdj krb5kdc[26250](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302729, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:12:09.294452 27381 init.cc:377] Logged in from keytab as kudu/127.7.39.2@KRBTEST.COM (short username kudu)
I20260809 19:12:09.295771 27381 webserver.cc:460] Webserver started at http://127.7.39.2:45087/ using document root <none> and password file <none>
I20260809 19:12:09.296381 27381 fs_manager.cc:359] Metadata directory not provided
I20260809 19:12:09.296487 27381 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:12:09.296773 27381 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 19:12:09 dist-test-slave-4tdj krb5kdc[26250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302729, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for HTTP/127.7.39.20@KRBTEST.COM
I20260809 19:12:09.312342 27381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-1/data/instance:
uuid: "04c45893059249d3b00fd98ac4e99daa"
format_stamp: "Formatted at 2026-08-09 19:12:09 on dist-test-slave-4tdj"
server_key: "6c73f0099d93c05946c0d0326607e87c"
server_key_iv: "d09b0d300cf3497823ee5d9ff1203a96"
server_key_version: "kuduclusterkey@0"
I20260809 19:12:09.313105 27381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance:
uuid: "04c45893059249d3b00fd98ac4e99daa"
format_stamp: "Formatted at 2026-08-09 19:12:09 on dist-test-slave-4tdj"
server_key: "6c73f0099d93c05946c0d0326607e87c"
server_key_iv: "d09b0d300cf3497823ee5d9ff1203a96"
server_key_version: "kuduclusterkey@0"
I20260809 19:12:09.318267 27381 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.006s
I20260809 19:12:09.333288 27427 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:09.334718 27381 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:12:09.334860 27381 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-1/wal
uuid: "04c45893059249d3b00fd98ac4e99daa"
format_stamp: "Formatted at 2026-08-09 19:12:09 on dist-test-slave-4tdj"
server_key: "6c73f0099d93c05946c0d0326607e87c"
server_key_iv: "d09b0d300cf3497823ee5d9ff1203a96"
server_key_version: "kuduclusterkey@0"
I20260809 19:12:09.335059 27381 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:12:09.358805 27381 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:12:09.362462 27381 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:12:09.362739 27381 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:12:09.363685 27381 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:12:09.365006 27381 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:12:09.365084 27381 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:09.365182 27381 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:12:09.365242 27381 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:09.403858 27381 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.2:40331
I20260809 19:12:09.403899 27604 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.2:40331 every 8 connection(s)
I20260809 19:12:09.405098 27381 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
I20260809 19:12:09.407922 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 27381
I20260809 19:12:09.408104 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance
I20260809 19:12:09.408627 7324 external_mini_cluster.cc:1428] Setting key 4659da23b7b9ea736ceafa184c2dc256
Aug 09 19:12:09 dist-test-slave-4tdj krb5kdc[26250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302729, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.7.39.3@KRBTEST.COM; defaulting to no policy
I20260809 19:12:09.438413 27607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:09.407664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:46247 (local address 127.7.39.62:41999)
0809 19:12:09.418665 (+ 11001us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:09.418671 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:09.421102 (+ 2431us) server_negotiation.cc:407] Connection header received
0809 19:12:09.421168 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:09.421172 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:09.421234 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:09.421325 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:09.422997 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:09.424213 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:09.426386 (+ 2173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:09.427037 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:09.427164 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:09.431188 (+ 4024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:09.431195 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:09.431200 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:09.431241 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:09.434819 (+ 3578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:09.435727 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:09.435733 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:09.435737 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:09.435916 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:09.436458 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:09.436463 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:09.436467 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:09.436820 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:09.436962 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:09.437690 (+ 728us) server_negotiation.cc:299] Negotiation successful
0809 19:12:09.437963 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10876,"thread_start_us":10763,"threads_started":1}
I20260809 19:12:09.439296 27610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:09.408161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:41999 (local address 127.7.39.2:46247)
0809 19:12:09.419088 (+ 10927us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:09.419138 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:09.420814 (+ 1676us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:09.421592 (+ 778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:09.421600 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:09.422002 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:12:09.422790 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:09.422816 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:09.424381 (+ 1565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:09.424386 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:09.426221 (+ 1835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:09.426235 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:09.427280 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:09.427286 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:09.427561 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:09.428351 (+ 790us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:12:09.428383 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:12:09.430923 (+ 2540us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:12:09.434979 (+ 4056us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:09.434987 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:09.435005 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:09.435586 (+ 581us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:09.436048 (+ 462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:09.436053 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:09.436057 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:09.436321 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:09.436948 (+ 627us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:12:09.436956 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:12:09.437315 (+ 359us) client_negotiation.cc:769] Sending connection context
0809 19:12:09.437546 (+ 231us) client_negotiation.cc:240] Negotiation successful
0809 19:12:09.438020 (+ 474us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10642,"thread_start_us":10405,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.3@KRBTEST.COM" created.
I20260809 19:12:09.441038 27605 heartbeater.cc:347] Connected to a master server at 127.7.39.62:41999
I20260809 19:12:09.441372 27605 heartbeater.cc:464] Registering TS with master...
I20260809 19:12:09.442237 27605 heartbeater.cc:511] Master 127.7.39.62:41999 requested a full tablet report, sending...
I20260809 19:12:09.443953 27048 ts_manager.cc:194] Registered new tserver with Master: 04c45893059249d3b00fd98ac4e99daa (127.7.39.2:40331)
I20260809 19:12:09.444962 27048 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.2@KRBTEST.COM'} at 127.7.39.2:46247
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
I20260809 19:12:09.467064 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.39.20:39401/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.3:0
--local_ip_for_outbound_sockets=127.7.39.3
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:41999
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:39363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 19:12:09.769039 27372 heartbeater.cc:503] Master 127.7.39.62:41999 was elected leader, sending a full tablet report...
W20260809 19:12:09.786278 27615 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:12:09.786540 27615 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:12:09.786654 27615 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:12:09.793998 27615 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:12:09.794085 27615 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:12:09.794217 27615 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.3
I20260809 19:12:09.804016 27615 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:39363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.7.39.20:39401/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:41999
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.3
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:12:09.805153 27615 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:12:09.806434 27615 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:12:09.818559 27620 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:09.818591 27624 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:09.818634 27621 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:12:09.819254 27615 server_base.cc:1034] running on GCE node
I20260809 19:12:09.819790 27615 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:12:09.820648 27615 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:12:09.821844 27615 hybrid_clock.cc:648] HybridClock initialized: now 1786302729821803 us; error 31 us; skew 500 ppm
I20260809 19:12:09.822139 27615 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:12:09 dist-test-slave-4tdj krb5kdc[26250](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302729, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:12:09.825026 27615 init.cc:377] Logged in from keytab as kudu/127.7.39.3@KRBTEST.COM (short username kudu)
I20260809 19:12:09.826336 27615 webserver.cc:460] Webserver started at http://127.7.39.3:45505/ using document root <none> and password file <none>
I20260809 19:12:09.826970 27615 fs_manager.cc:359] Metadata directory not provided
I20260809 19:12:09.827068 27615 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:12:09.827307 27615 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 19:12:09 dist-test-slave-4tdj krb5kdc[26250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302729, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for HTTP/127.7.39.20@KRBTEST.COM
I20260809 19:12:09.843329 27615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-2/data/instance:
uuid: "006e73927243438ea7eae081e34d7f88"
format_stamp: "Formatted at 2026-08-09 19:12:09 on dist-test-slave-4tdj"
server_key: "4198161b9ace1b0cac2a97826b4ab222"
server_key_iv: "0ab1104ccdcd7c5e35aef64144b802af"
server_key_version: "kuduclusterkey@0"
I20260809 19:12:09.844372 27615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance:
uuid: "006e73927243438ea7eae081e34d7f88"
format_stamp: "Formatted at 2026-08-09 19:12:09 on dist-test-slave-4tdj"
server_key: "4198161b9ace1b0cac2a97826b4ab222"
server_key_iv: "0ab1104ccdcd7c5e35aef64144b802af"
server_key_version: "kuduclusterkey@0"
I20260809 19:12:09.851138 27615 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260809 19:12:09.865262 27636 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:09.866865 27615 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:12:09.867048 27615 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-2/wal
uuid: "006e73927243438ea7eae081e34d7f88"
format_stamp: "Formatted at 2026-08-09 19:12:09 on dist-test-slave-4tdj"
server_key: "4198161b9ace1b0cac2a97826b4ab222"
server_key_iv: "0ab1104ccdcd7c5e35aef64144b802af"
server_key_version: "kuduclusterkey@0"
I20260809 19:12:09.867245 27615 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:12:09.890750 27615 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:12:09.894662 27615 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:12:09.894937 27615 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:12:09.895864 27615 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:12:09.897197 27615 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:12:09.897269 27615 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:09.897356 27615 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:12:09.897408 27615 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:09.927816 27615 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.3:36867
I20260809 19:12:09.927857 27817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.3:36867 every 8 connection(s)
I20260809 19:12:09.929021 27615 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
I20260809 19:12:09.938364 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 27615
I20260809 19:12:09.938512 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance
I20260809 19:12:09.938972 7324 external_mini_cluster.cc:1428] Setting key 6bb23c31b0e431268600bda841609808
Aug 09 19:12:09 dist-test-slave-4tdj krb5kdc[26250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302729, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:12:09.947430 27607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:09.931411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:45423 (local address 127.7.39.62:41999)
0809 19:12:09.931571 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:09.931575 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:09.932676 (+ 1101us) server_negotiation.cc:407] Connection header received
0809 19:12:09.934421 (+ 1745us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:09.934427 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:09.934527 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:09.934618 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:09.936078 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:09.936793 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:09.938334 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:09.938847 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:09.938956 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:09.942407 (+ 3451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:09.942412 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:09.942415 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:09.942446 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:09.944631 (+ 2185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:09.945275 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:09.945281 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:09.945285 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:09.945412 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:09.945819 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:09.945824 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:09.945828 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:09.946095 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:09.946222 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:09.946896 (+ 674us) server_negotiation.cc:299] Negotiation successful
0809 19:12:09.947129 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 19:12:09.948246 27821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:09.931835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:41999 (local address 127.7.39.3:45423)
0809 19:12:09.932513 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:09.932556 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:09.934151 (+ 1595us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:09.934844 (+ 693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:09.934851 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:09.935359 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:12:09.935907 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:09.935924 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:09.936945 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:09.936948 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:09.938174 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:09.938192 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:09.939070 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:09.939077 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:09.939288 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:09.939978 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:12:09.940013 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:12:09.942186 (+ 2173us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:12:09.944755 (+ 2569us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:09.944763 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:09.944778 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:09.945163 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:09.945512 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:09.945517 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:09.945521 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:09.945717 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:09.946213 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:12:09.946221 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:12:09.946560 (+ 339us) client_negotiation.cc:769] Sending connection context
0809 19:12:09.946791 (+ 231us) client_negotiation.cc:240] Negotiation successful
0809 19:12:09.947231 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":272,"threads_started":1}
I20260809 19:12:09.949451 27819 heartbeater.cc:347] Connected to a master server at 127.7.39.62:41999
I20260809 19:12:09.949705 27819 heartbeater.cc:464] Registering TS with master...
I20260809 19:12:09.950320 27819 heartbeater.cc:511] Master 127.7.39.62:41999 requested a full tablet report, sending...
I20260809 19:12:09.951611 27048 ts_manager.cc:194] Registered new tserver with Master: 006e73927243438ea7eae081e34d7f88 (127.7.39.3:36867)
I20260809 19:12:09.952419 27048 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.3@KRBTEST.COM'} at 127.7.39.3:45423
I20260809 19:12:09.954084 7324 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 19:12:09.955763 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 27162
Aug 09 19:12:09 dist-test-slave-4tdj krb5kdc[26250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302726, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.1@KRBTEST.COM
I20260809 19:12:09.970285 27825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:09.956586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36982 (local address 127.7.39.1:46401)
0809 19:12:09.957139 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:09.957145 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:09.957168 (+ 23us) server_negotiation.cc:407] Connection header received
0809 19:12:09.957217 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:09.957223 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:09.957402 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:09.957508 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:09.958863 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:09.959812 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:09.961202 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:09.961700 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:09.961791 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:09.965641 (+ 3850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:09.965651 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:09.965662 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:09.965696 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:09.968122 (+ 2426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:09.968701 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:09.968706 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:09.968708 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:09.968845 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:09.969102 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:09.969105 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:09.969107 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:09.969392 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:09.969614 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:09.969810 (+ 196us) server_negotiation.cc:299] Negotiation successful
0809 19:12:09.969993 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":251,"threads_started":1}
I20260809 19:12:09.971519 27366 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:12:10.051723 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 27162
I20260809 19:12:10.078230 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 27381
Aug 09 19:12:10 dist-test-slave-4tdj krb5kdc[26250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302726, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.2@KRBTEST.COM
I20260809 19:12:10.093201 27827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:10.079113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53504 (local address 127.7.39.2:40331)
0809 19:12:10.079622 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:10.079629 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:10.079655 (+ 26us) server_negotiation.cc:407] Connection header received
0809 19:12:10.079728 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:10.079734 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:10.079931 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:10.080055 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:10.081328 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:10.082350 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:10.083567 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:10.084126 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:10.084222 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:10.088186 (+ 3964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:10.088196 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:10.088210 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:10.088241 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:10.090929 (+ 2688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:10.091493 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:10.091499 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:10.091501 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:10.091634 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:10.091909 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:10.091912 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:10.091914 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:10.092214 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:10.092435 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:10.092669 (+ 234us) server_negotiation.cc:299] Negotiation successful
0809 19:12:10.092856 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":243,"threads_started":1}
I20260809 19:12:10.094477 27595 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:12:10.173794 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 27381
I20260809 19:12:10.196627 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 27615
Aug 09 19:12:10 dist-test-slave-4tdj krb5kdc[26250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302726, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.3@KRBTEST.COM
I20260809 19:12:10.212033 27830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:10.197515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40588 (local address 127.7.39.3:36867)
0809 19:12:10.198069 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:10.198078 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:10.198108 (+ 30us) server_negotiation.cc:407] Connection header received
0809 19:12:10.198167 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:10.198173 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:10.198436 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:10.198592 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:10.199983 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:10.201002 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:10.202346 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:10.202900 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:10.203013 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:10.207180 (+ 4167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:10.207191 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:10.207205 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:10.207238 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:10.209687 (+ 2449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:10.210273 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:10.210280 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:10.210282 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:10.210440 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:10.210768 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:10.210771 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:10.210772 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:10.211096 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:10.211333 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:10.211557 (+ 224us) server_negotiation.cc:299] Negotiation successful
0809 19:12:10.211761 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":415,"thread_start_us":250,"threads_started":1}
I20260809 19:12:10.213250 27809 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:12:10.295183 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 27615
I20260809 19:12:10.315356 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 27000
I20260809 19:12:10.316691 27096 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:12:10.420286 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 27000
I20260809 19:12:10.445399 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:41999
--webserver_interface=127.7.39.62
--webserver_port=35755
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:39363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:41999
--ranger_config_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.39.20:39401/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.7.39.20:39401/kms with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:12:10.765070 27835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:12:10.765349 27835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:12:10.765482 27835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:12:10.772552 27835 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:12:10.772648 27835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:12:10.772720 27835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:12:10.772789 27835 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:12:10.772852 27835 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:12:10.782557 27835 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:39363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.7.39.20:39401/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:41999
--ranger_config_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:41999
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=35755
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:12:10.783730 27835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:12:10.785182 27835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:12:10.796041 27844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:10.796070 27845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:10.796111 27848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:12:10.797206 27835 server_base.cc:1034] running on GCE node
I20260809 19:12:10.797958 27835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:12:10.799280 27835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:12:10.800486 27835 hybrid_clock.cc:648] HybridClock initialized: now 1786302730800441 us; error 35 us; skew 500 ppm
I20260809 19:12:10.800814 27835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:12:10 dist-test-slave-4tdj krb5kdc[26250](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302730, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:12:10.803699 27835 init.cc:377] Logged in from keytab as kudu/127.7.39.62@KRBTEST.COM (short username kudu)
I20260809 19:12:10.805017 27835 webserver.cc:460] Webserver started at http://127.7.39.62:35755/ using document root <none> and password file <none>
I20260809 19:12:10.805629 27835 fs_manager.cc:359] Metadata directory not provided
I20260809 19:12:10.805748 27835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 19:12:10 dist-test-slave-4tdj krb5kdc[26250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302730, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for HTTP/127.7.39.20@KRBTEST.COM
I20260809 19:12:10.852396 27835 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 19:12:10.855885 27865 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:10.857170 27835 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260809 19:12:10.857329 27835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "841e0dd854d34cb4aec81c033bcd0e27"
format_stamp: "Formatted at 2026-08-09 19:12:06 on dist-test-slave-4tdj"
server_key: "f19f9a621c80c5ec064f9afb82fe1909"
server_key_iv: "d47c8fe38684635e329aa0ea0a2b53b0"
server_key_version: "kuduclusterkey@0"
I20260809 19:12:10.858237 27835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:12:10.872853 27835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:12:10.876219 27835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:12:10.876480 27835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:12:10.893491 27835 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:41999
I20260809 19:12:10.893510 27963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:41999 every 8 connection(s)
I20260809 19:12:10.894941 27835 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:12:10.899184 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 27835
I20260809 19:12:10.899986 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.39.20:39401/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.1:46401
--local_ip_for_outbound_sockets=127.7.39.1
--tserver_master_addrs=127.7.39.62:41999
--webserver_port=33613
--webserver_interface=127.7.39.1
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:39363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.7.39.20:39401/kms with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 19:12:10.901669 27965 sys_catalog.cc:263] Verifying existing consensus state
I20260809 19:12:10.904870 27965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27: Bootstrap starting.
I20260809 19:12:10.923255 27965 log.cc:824] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27: Log is configured to *not* fsync() on all Append() calls
I20260809 19:12:10.932034 27965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 19:12:10.932529 27965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27: Bootstrap complete.
I20260809 19:12:10.940987 27965 raft_consensus.cc:348] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "841e0dd854d34cb4aec81c033bcd0e27" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 41999 } }
I20260809 19:12:10.941826 27965 raft_consensus.cc:729] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841e0dd854d34cb4aec81c033bcd0e27, State: Initialized, Role: FOLLOWER
I20260809 19:12:10.942445 27965 consensus_queue.cc:260] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "841e0dd854d34cb4aec81c033bcd0e27" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 41999 } }
I20260809 19:12:10.942687 27965 raft_consensus.cc:388] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:12:10.942795 27965 raft_consensus.cc:482] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:12:10.942948 27965 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27 [term 1 FOLLOWER]: Advancing to term 2
I20260809 19:12:10.946583 27965 raft_consensus.cc:504] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "841e0dd854d34cb4aec81c033bcd0e27" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 41999 } }
I20260809 19:12:10.947027 27965 leader_election.cc:302] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 841e0dd854d34cb4aec81c033bcd0e27; no voters:
I20260809 19:12:10.947628 27965 leader_election.cc:288] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 19:12:10.947779 27969 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 19:12:10.949740 27969 raft_consensus.cc:686] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27 [term 2 LEADER]: Becoming Leader. State: Replica: 841e0dd854d34cb4aec81c033bcd0e27, State: Running, Role: LEADER
I20260809 19:12:10.950400 27969 consensus_queue.cc:237] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "841e0dd854d34cb4aec81c033bcd0e27" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 41999 } }
I20260809 19:12:10.950682 27965 sys_catalog.cc:564] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:12:10.953039 27970 sys_catalog.cc:455] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "841e0dd854d34cb4aec81c033bcd0e27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "841e0dd854d34cb4aec81c033bcd0e27" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 41999 } } }
I20260809 19:12:10.953409 27970 sys_catalog.cc:458] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27 [sys.catalog]: This master's current role is: LEADER
I20260809 19:12:10.953871 27971 sys_catalog.cc:455] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 841e0dd854d34cb4aec81c033bcd0e27. Latest consensus state: current_term: 2 leader_uuid: "841e0dd854d34cb4aec81c033bcd0e27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "841e0dd854d34cb4aec81c033bcd0e27" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 41999 } } }
I20260809 19:12:10.954144 27971 sys_catalog.cc:458] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27 [sys.catalog]: This master's current role is: LEADER
I20260809 19:12:10.965513 27976 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:12:10.973618 27976 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:12:10.975186 27976 catalog_manager.cc:1259] Loaded cluster ID: 4601bd119eaa482683b479d5cb9e4e9a
I20260809 19:12:10.975296 27976 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:12:10.979543 27976 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:12:10.981379 27976 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27: Loaded TSK: 0
I20260809 19:12:10.983026 27976 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:12:10.985529 27965 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260809 19:12:11.324590 27967 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:12:11.324869 27967 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:12:11.325016 27967 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:12:11.335240 27967 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:12:11.335362 27967 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:12:11.335518 27967 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.1
I20260809 19:12:11.348852 27967 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:39363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.7.39.20:39401/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.1:46401
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.39.1
--webserver_port=33613
--tserver_master_addrs=127.7.39.62:41999
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.1
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:12:11.350476 27967 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:12:11.352255 27967 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:12:11.371109 28016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:11.374501 28017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:11.375274 28019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:12:11.376776 27967 server_base.cc:1034] running on GCE node
I20260809 19:12:11.377621 27967 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:12:11.379305 27967 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:12:11.389112 27967 hybrid_clock.cc:648] HybridClock initialized: now 1786302731389029 us; error 63 us; skew 500 ppm
I20260809 19:12:11.389518 27967 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:12:11 dist-test-slave-4tdj krb5kdc[26250](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302731, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:12:11.393791 27967 init.cc:377] Logged in from keytab as kudu/127.7.39.1@KRBTEST.COM (short username kudu)
I20260809 19:12:11.398120 27967 webserver.cc:460] Webserver started at http://127.7.39.1:33613/ using document root <none> and password file <none>
I20260809 19:12:11.399084 27967 fs_manager.cc:359] Metadata directory not provided
I20260809 19:12:11.399246 27967 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 19:12:11 dist-test-slave-4tdj krb5kdc[26250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302731, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for HTTP/127.7.39.20@KRBTEST.COM
I20260809 19:12:11.445703 27967 fs_manager.cc:709] Time spent opening directory manager: real 0.017s user 0.006s sys 0.007s
I20260809 19:12:11.466184 28029 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:11.468267 27967 fs_manager.cc:725] Time spent opening block manager: real 0.021s user 0.004s sys 0.014s
I20260809 19:12:11.468544 27967 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-0/wal
uuid: "ac251c4c0b8e4d9fb76652ceccfe6c91"
format_stamp: "Formatted at 2026-08-09 19:12:08 on dist-test-slave-4tdj"
server_key: "0230aa5af411f6d8b22f720a9ceae0a4"
server_key_iv: "3df06648f6e708db053021fb5c61fecd"
server_key_version: "kuduclusterkey@0"
I20260809 19:12:11.470055 27967 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:12:11.535615 27967 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:12:11.540565 27967 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:12:11.540850 27967 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:12:11.542063 27967 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:12:11.543826 27967 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:12:11.543949 27967 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:11.544075 27967 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:12:11.544170 27967 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:11.606081 27967 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.1:46401
I20260809 19:12:11.606128 28196 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.1:46401 every 8 connection(s)
I20260809 19:12:11.608011 27967 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
I20260809 19:12:11.614611 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 27967
I20260809 19:12:11.615469 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.39.20:39401/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.2:40331
--local_ip_for_outbound_sockets=127.7.39.2
--tserver_master_addrs=127.7.39.62:41999
--webserver_port=45087
--webserver_interface=127.7.39.2
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:39363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.7.39.20:39401/kms with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 19:12:11 dist-test-slave-4tdj krb5kdc[26250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302731, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:12:11.675164 28204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:11.618881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:57277 (local address 127.7.39.62:41999)
0809 19:12:11.619643 (+ 762us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:11.619662 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:11.640639 (+ 20977us) server_negotiation.cc:407] Connection header received
0809 19:12:11.646203 (+ 5564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:11.646227 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:11.646773 (+ 546us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:11.647184 (+ 411us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:11.654491 (+ 7307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:11.656471 (+ 1980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:11.658968 (+ 2497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:11.659945 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:11.660129 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:11.664822 (+ 4693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:11.664834 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:11.664855 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:11.664908 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:11.669297 (+ 4389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:11.670267 (+ 970us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:11.670277 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:11.670286 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:11.670508 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:11.671086 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:11.671091 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:11.671095 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:11.671901 (+ 806us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:11.672090 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:11.673216 (+ 1126us) server_negotiation.cc:299] Negotiation successful
0809 19:12:11.673676 (+ 460us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":946,"threads_started":1}
I20260809 19:12:11.677834 28203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:11.611602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:41999 (local address 127.7.39.1:57277)
0809 19:12:11.639988 (+ 28386us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:11.640066 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:11.645415 (+ 5349us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:11.648045 (+ 2630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:11.648057 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:11.648776 (+ 719us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:12:11.649609 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:11.649633 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:11.656704 (+ 7071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:11.656710 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:11.658801 (+ 2091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:11.658817 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:11.660573 (+ 1756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:11.660582 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:11.660866 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:11.661677 (+ 811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:12:11.661711 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:12:11.664518 (+ 2807us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:12:11.669463 (+ 4945us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:11.669473 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:11.669488 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:11.670095 (+ 607us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:11.670666 (+ 571us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:11.670671 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:11.670675 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:11.670935 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:11.672217 (+ 1282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:12:11.672226 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:12:11.672613 (+ 387us) client_negotiation.cc:769] Sending connection context
0809 19:12:11.676093 (+ 3480us) client_negotiation.cc:240] Negotiation successful
0809 19:12:11.676619 (+ 526us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27976,"thread_start_us":30585,"threads_started":1}
I20260809 19:12:11.682015 28198 heartbeater.cc:347] Connected to a master server at 127.7.39.62:41999
I20260809 19:12:11.682389 28198 heartbeater.cc:464] Registering TS with master...
I20260809 19:12:11.683276 28198 heartbeater.cc:511] Master 127.7.39.62:41999 requested a full tablet report, sending...
W20260809 19:12:11.686770 28198 heartbeater.cc:644] Failed to heartbeat to 127.7.39.62:41999 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 19:12:11.687003 28198 heartbeater.cc:464] Registering TS with master...
I20260809 19:12:11.687261 28198 heartbeater.cc:511] Master 127.7.39.62:41999 requested a full tablet report, sending...
I20260809 19:12:11.688550 28198 heartbeater.cc:464] Registering TS with master...
I20260809 19:12:11.688874 28198 heartbeater.cc:511] Master 127.7.39.62:41999 requested a full tablet report, sending...
W20260809 19:12:11.689988 28198 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 19:12:11.845106 28213 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
W20260809 19:12:12.050562 28205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:12:12.051035 28205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:12:12.051280 28205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:12:12.058923 28205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:12:12.059037 28205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:12:12.059196 28205 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.2
I20260809 19:12:12.069026 28205 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:39363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.7.39.20:39401/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.2:40331
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.39.2
--webserver_port=45087
--tserver_master_addrs=127.7.39.62:41999
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.2
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:12:12.070250 28205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:12:12.071627 28205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:12:12.087153 28229 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:12.089143 28231 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:12.099583 28235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:12:12.100078 28205 server_base.cc:1034] running on GCE node
I20260809 19:12:12.100829 28205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:12:12.102025 28205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:12:12.103334 28205 hybrid_clock.cc:648] HybridClock initialized: now 1786302732103257 us; error 63 us; skew 500 ppm
I20260809 19:12:12.103766 28205 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:12:12 dist-test-slave-4tdj krb5kdc[26250](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302732, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:12:12.112771 28205 init.cc:377] Logged in from keytab as kudu/127.7.39.2@KRBTEST.COM (short username kudu)
I20260809 19:12:12.116469 28205 webserver.cc:460] Webserver started at http://127.7.39.2:45087/ using document root <none> and password file <none>
I20260809 19:12:12.117439 28205 fs_manager.cc:359] Metadata directory not provided
I20260809 19:12:12.117662 28205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 19:12:12 dist-test-slave-4tdj krb5kdc[26250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302732, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for HTTP/127.7.39.20@KRBTEST.COM
I20260809 19:12:12.147552 28205 fs_manager.cc:709] Time spent opening directory manager: real 0.011s user 0.009s sys 0.001s
I20260809 19:12:12.151322 28248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:12.153201 28205 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 19:12:12.153389 28205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-1/wal
uuid: "04c45893059249d3b00fd98ac4e99daa"
format_stamp: "Formatted at 2026-08-09 19:12:09 on dist-test-slave-4tdj"
server_key: "6c73f0099d93c05946c0d0326607e87c"
server_key_iv: "d09b0d300cf3497823ee5d9ff1203a96"
server_key_version: "kuduclusterkey@0"
I20260809 19:12:12.154793 28205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:12:12.180480 28205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:12:12.185454 28205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:12:12.185786 28205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:12:12.187036 28205 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:12:12.188822 28205 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:12:12.188941 28205 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:12.189069 28205 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:12:12.189189 28205 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
Aug 09 19:12:12 dist-test-slave-4tdj krb5kdc[26250](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786302732, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:12:12.270653 28205 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.2:40331
I20260809 19:12:12.270709 28421 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.2:40331 every 8 connection(s)
I20260809 19:12:12.272622 28205 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
I20260809 19:12:12.278354 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 28205
I20260809 19:12:12.279155 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.39.20:39401/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.3:36867
--local_ip_for_outbound_sockets=127.7.39.3
--tserver_master_addrs=127.7.39.62:41999
--webserver_port=45505
--webserver_interface=127.7.39.3
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:39363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.7.39.20:39401/kms with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 19:12:12 dist-test-slave-4tdj krb5kdc[26250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302732, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:12:12.315227 28428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:12.276136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:41999 (local address 127.7.39.2:59647)
0809 19:12:12.280618 (+ 4482us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:12.280661 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:12.282320 (+ 1659us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:12.296675 (+ 14355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:12.296688 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:12.297314 (+ 626us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:12:12.298117 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:12.298144 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:12.299706 (+ 1562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:12.299711 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:12.301618 (+ 1907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:12.301634 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:12.302895 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:12.302902 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:12.303179 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:12.303952 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:12:12.303995 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:12:12.306532 (+ 2537us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:12:12.310407 (+ 3875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:12.310416 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:12.310433 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:12.311007 (+ 574us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:12.311487 (+ 480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:12.311492 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:12.311496 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:12.311764 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:12.312499 (+ 735us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:12:12.312507 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:12:12.312918 (+ 411us) client_negotiation.cc:769] Sending connection context
0809 19:12:12.313244 (+ 326us) client_negotiation.cc:240] Negotiation successful
0809 19:12:12.313777 (+ 533us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4232,"thread_start_us":6176,"threads_started":1}
I20260809 19:12:12.316299 28429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:12.277485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:59647 (local address 127.7.39.62:41999)
0809 19:12:12.295917 (+ 18432us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:12.295923 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:12.295947 (+ 24us) server_negotiation.cc:407] Connection header received
0809 19:12:12.296016 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:12.296022 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:12.296107 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:12.297207 (+ 1100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:12.298354 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:12.299487 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:12.301793 (+ 2306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:12.302464 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:12.302583 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:12.306773 (+ 4190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:12.306780 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:12.306784 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:12.306826 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:12.310219 (+ 3393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:12.311159 (+ 940us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:12.311165 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:12.311169 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:12.311345 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:12.311906 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:12.311911 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:12.311915 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:12.312274 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:12.312408 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:12.315712 (+ 3304us) server_negotiation.cc:299] Negotiation successful
0809 19:12:12.315932 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18283,"thread_start_us":18710,"threads_started":1}
I20260809 19:12:12.318362 28425 heartbeater.cc:347] Connected to a master server at 127.7.39.62:41999
I20260809 19:12:12.318670 28425 heartbeater.cc:464] Registering TS with master...
I20260809 19:12:12.319502 28425 heartbeater.cc:511] Master 127.7.39.62:41999 requested a full tablet report, sending...
I20260809 19:12:12.321420 27893 ts_manager.cc:194] Registered new tserver with Master: 04c45893059249d3b00fd98ac4e99daa (127.7.39.2:40331)
I20260809 19:12:12.323575 27893 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.2@KRBTEST.COM'} at 127.7.39.2:59647
Aug 09 19:12:12 dist-test-slave-4tdj krb5kdc[26250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302732, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for HTTP/127.7.39.20@KRBTEST.COM
I20260809 19:12:12.690114 28198 heartbeater.cc:464] Registering TS with master...
I20260809 19:12:12.690550 28198 heartbeater.cc:511] Master 127.7.39.62:41999 requested a full tablet report, sending...
I20260809 19:12:12.691898 27893 ts_manager.cc:194] Registered new tserver with Master: ac251c4c0b8e4d9fb76652ceccfe6c91 (127.7.39.1:46401)
I20260809 19:12:12.693032 27893 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.1@KRBTEST.COM'} at 127.7.39.1:57277
W20260809 19:12:12.742098 28430 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:12:12.742596 28430 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:12:12.742794 28430 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:12:12.754472 28430 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:12:12.754662 28430 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:12:12.754895 28430 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.3
I20260809 19:12:12.770495 28430 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:39363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.7.39.20:39401/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.3:36867
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.39.3
--webserver_port=45505
--tserver_master_addrs=127.7.39.62:41999
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.3
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:12:12.772429 28430 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:12:12.774168 28430 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:12:12.809792 28441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:12.812954 28440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:12:12.826520 28430 server_base.cc:1034] running on GCE node
W20260809 19:12:12.832386 28443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:12:12.833283 28430 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:12:12.844686 28430 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:12:12.852180 28430 hybrid_clock.cc:648] HybridClock initialized: now 1786302732852056 us; error 112 us; skew 500 ppm
I20260809 19:12:12.852604 28430 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:12:12 dist-test-slave-4tdj krb5kdc[26250](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302732, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:12:12.856848 28430 init.cc:377] Logged in from keytab as kudu/127.7.39.3@KRBTEST.COM (short username kudu)
I20260809 19:12:12.880920 28430 webserver.cc:460] Webserver started at http://127.7.39.3:45505/ using document root <none> and password file <none>
I20260809 19:12:12.881858 28430 fs_manager.cc:359] Metadata directory not provided
I20260809 19:12:12.882038 28430 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 19:12:12 dist-test-slave-4tdj krb5kdc[26250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302732, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for HTTP/127.7.39.20@KRBTEST.COM
I20260809 19:12:12.918850 28430 fs_manager.cc:709] Time spent opening directory manager: real 0.014s user 0.005s sys 0.009s
I20260809 19:12:12.922583 28459 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:12.924458 28430 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260809 19:12:12.924654 28430 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-2/wal
uuid: "006e73927243438ea7eae081e34d7f88"
format_stamp: "Formatted at 2026-08-09 19:12:09 on dist-test-slave-4tdj"
server_key: "4198161b9ace1b0cac2a97826b4ab222"
server_key_iv: "0ab1104ccdcd7c5e35aef64144b802af"
server_key_version: "kuduclusterkey@0"
I20260809 19:12:12.926024 28430 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:12:12.956136 28430 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:12:12.961251 28430 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:12:12.961601 28430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:12:12.962805 28430 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:12:12.964557 28430 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:12:12.964668 28430 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:12.964769 28430 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:12:12.964843 28430 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 19:12:13 dist-test-slave-4tdj krb5kdc[26250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302732, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for HTTP/127.7.39.20@KRBTEST.COM
I20260809 19:12:13.086082 28430 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.3:36867
I20260809 19:12:13.086129 28640 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.3:36867 every 8 connection(s)
I20260809 19:12:13.087764 28430 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
I20260809 19:12:13.098742 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 28430
Aug 09 19:12:13 dist-test-slave-4tdj krb5kdc[26250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302732, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:12:13.176872 28644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:13.099853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52104 (local address 127.7.39.62:41999)
0809 19:12:13.148762 (+ 48909us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:13.148768 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:13.148786 (+ 18us) server_negotiation.cc:407] Connection header received
0809 19:12:13.148843 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:13.148848 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:13.148916 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:13.149036 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:13.151749 (+ 2713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:13.153020 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:13.156403 (+ 3383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:13.157082 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:13.157196 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:13.165123 (+ 7927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:13.165130 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:13.165135 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:13.165176 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:13.171658 (+ 6482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:13.172758 (+ 1100us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:13.172764 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:13.172768 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:13.172930 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:13.174431 (+ 1501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:13.174436 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:13.174438 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:13.174810 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:13.176110 (+ 1300us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:13.176239 (+ 129us) server_negotiation.cc:299] Negotiation successful
0809 19:12:13.176460 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48781,"thread_start_us":39123,"threads_started":1}
I20260809 19:12:13.181087 28645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:13.091372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:41999 (local address 127.7.39.3:43213)
0809 19:12:13.134964 (+ 43592us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:13.135035 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:13.137606 (+ 2571us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:13.146668 (+ 9062us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:13.146682 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:13.147369 (+ 687us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:12:13.148220 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:13.148248 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:13.150697 (+ 2449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:13.150702 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:13.154417 (+ 3715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:13.154433 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:13.155692 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:13.155699 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:13.155982 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:13.166081 (+ 10099us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:12:13.166111 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:12:13.169772 (+ 3661us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:12:13.174657 (+ 4885us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:13.174666 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:13.174685 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:13.175274 (+ 589us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:13.175690 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:13.175695 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:13.175699 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:13.176149 (+ 450us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:13.176827 (+ 678us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:12:13.176835 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:12:13.178416 (+ 1581us) client_negotiation.cc:769] Sending connection context
0809 19:12:13.178724 (+ 308us) client_negotiation.cc:240] Negotiation successful
0809 19:12:13.179283 (+ 559us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43203,"thread_start_us":46556,"threads_started":1}
I20260809 19:12:13.182154 28647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:13.090889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:43213 (local address 127.7.39.62:41999)
0809 19:12:13.139234 (+ 48345us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:13.139240 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:13.139263 (+ 23us) server_negotiation.cc:407] Connection header received
0809 19:12:13.139345 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:13.139350 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:13.139435 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:13.139544 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:13.149274 (+ 9730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:13.150437 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:13.154580 (+ 4143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:13.155243 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:13.155335 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:13.170111 (+ 14776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:13.170119 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:13.170123 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:13.170178 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:13.174487 (+ 4309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:13.175421 (+ 934us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:13.175426 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:13.175430 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:13.175564 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:13.176291 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:13.176296 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:13.176299 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:13.176624 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:13.176746 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:13.181559 (+ 4813us) server_negotiation.cc:299] Negotiation successful
0809 19:12:13.181773 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48205,"thread_start_us":57589,"threads_started":1}
I20260809 19:12:13.184156 28641 heartbeater.cc:347] Connected to a master server at 127.7.39.62:41999
I20260809 19:12:13.184471 28641 heartbeater.cc:464] Registering TS with master...
I20260809 19:12:13.185346 28641 heartbeater.cc:511] Master 127.7.39.62:41999 requested a full tablet report, sending...
I20260809 19:12:13.186988 27893 ts_manager.cc:194] Registered new tserver with Master: 006e73927243438ea7eae081e34d7f88 (127.7.39.3:36867)
I20260809 19:12:13.188133 27893 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.3@KRBTEST.COM'} at 127.7.39.3:43213
I20260809 19:12:13.193298 7324 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 19:12:13.311730 28647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:13.252221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52116 (local address 127.7.39.62:41999)
0809 19:12:13.252438 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:13.252445 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:13.279275 (+ 26830us) server_negotiation.cc:407] Connection header received
0809 19:12:13.279769 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:13.279776 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:13.279867 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:13.279949 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:13.283456 (+ 3507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:13.284906 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:13.287693 (+ 2787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:13.288616 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:13.288714 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:13.302056 (+ 13342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:13.302066 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:13.302071 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:13.302155 (+ 84us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:13.307201 (+ 5046us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:13.308283 (+ 1082us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:13.308290 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:13.308294 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:13.308509 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:13.309165 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:13.309170 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:13.309173 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:13.309722 (+ 549us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:13.310078 (+ 356us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:13.310871 (+ 793us) server_negotiation.cc:299] Negotiation successful
0809 19:12:13.311170 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 19:12:13.327550 28425 heartbeater.cc:503] Master 127.7.39.62:41999 was elected leader, sending a full tablet report...
I20260809 19:12:13.318885 27893 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52116:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:12:13.334568 27893 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:12:13.415225 28664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:13.376435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:36867 (local address 127.0.0.1:40594)
0809 19:12:13.378398 (+ 1963us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:13.378443 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:13.378665 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:13.380841 (+ 2176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:13.380849 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:13.380881 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:12:13.381913 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:13.381929 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:13.385939 (+ 4010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:13.385945 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:13.389788 (+ 3843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:13.389804 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:13.413555 (+ 23751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:13.413568 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:13.413886 (+ 318us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:13.413961 (+ 75us) client_negotiation.cc:769] Sending connection context
0809 19:12:13.414123 (+ 162us) client_negotiation.cc:240] Negotiation successful
0809 19:12:13.414402 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1624,"thread_start_us":1815,"threads_started":1}
I20260809 19:12:13.415416 28666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:13.377079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40594 (local address 127.7.39.3:36867)
0809 19:12:13.380049 (+ 2970us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:13.380058 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:13.380116 (+ 58us) server_negotiation.cc:407] Connection header received
0809 19:12:13.380214 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:13.380222 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:13.380517 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:13.382580 (+ 2063us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:12:13.383256 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:13.385788 (+ 2532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:13.402600 (+ 16812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:13.404796 (+ 2196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:13.412238 (+ 7442us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:13.412755 (+ 517us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:13.414631 (+ 1876us) server_negotiation.cc:299] Negotiation successful
0809 19:12:13.414839 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2703,"thread_start_us":3846,"threads_started":1}
I20260809 19:12:13.426075 28534 tablet_service.cc:1467] Processing CreateTablet for tablet 259eff040dcd4d30b36f80fd5d551bc6 (DEFAULT_TABLE table=test-table [id=bbca01bc4a41449493c5c912bf172276]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:12:13.428004 28534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 259eff040dcd4d30b36f80fd5d551bc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:12:13.430753 28670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:13.379443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:40331 (local address 127.0.0.1:53516)
0809 19:12:13.416713 (+ 37270us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:13.416733 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:13.416893 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:13.419108 (+ 2215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:13.419112 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:13.419141 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:12:13.420048 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:13.420062 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:13.422901 (+ 2839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:13.422907 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:13.425179 (+ 2272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:13.425192 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:13.429436 (+ 4244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:13.429446 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:13.429728 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:13.429819 (+ 91us) client_negotiation.cc:769] Sending connection context
0809 19:12:13.429919 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 19:12:13.430057 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37066,"mutex_wait_us":40,"thread_start_us":13688,"threads_started":1}
I20260809 19:12:13.430946 28664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:13.380395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:46401 (local address 127.0.0.1:36988)
0809 19:12:13.416759 (+ 36364us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:13.416773 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:13.416900 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:13.417858 (+ 958us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:13.417864 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:13.417892 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:12:13.418202 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:13.418215 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:13.422901 (+ 4686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:13.422907 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:13.427194 (+ 4287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:13.427211 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:13.429725 (+ 2514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:13.429732 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:13.430060 (+ 328us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:13.430091 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 19:12:13.430152 (+ 61us) client_negotiation.cc:240] Negotiation successful
0809 19:12:13.430382 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36191,"mutex_wait_us":2368,"spinlock_wait_cycles":100224,"thread_start_us":35701,"threads_started":1}
I20260809 19:12:13.432601 28676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:13.381548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36988 (local address 127.7.39.1:46401)
0809 19:12:13.412130 (+ 30582us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:13.412141 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:13.417115 (+ 4974us) server_negotiation.cc:407] Connection header received
0809 19:12:13.417276 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:13.417286 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:13.417604 (+ 318us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:13.418412 (+ 808us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:12:13.419085 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:13.421452 (+ 2367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:13.427410 (+ 5958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:13.429523 (+ 2113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:13.431337 (+ 1814us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:13.431694 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:13.431772 (+ 78us) server_negotiation.cc:299] Negotiation successful
0809 19:12:13.431986 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30338,"thread_start_us":30584,"threads_started":1}
I20260809 19:12:13.436290 28671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:13.380326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53516 (local address 127.7.39.2:40331)
0809 19:12:13.418208 (+ 37882us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:13.418217 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:13.418246 (+ 29us) server_negotiation.cc:407] Connection header received
0809 19:12:13.418404 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:13.418412 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:13.418635 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:13.420338 (+ 1703us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:12:13.420790 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:13.422717 (+ 1927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:13.426491 (+ 3774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:13.428665 (+ 2174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:13.428792 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:13.429126 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:13.435571 (+ 6445us) server_negotiation.cc:299] Negotiation successful
0809 19:12:13.435795 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37660,"thread_start_us":38499,"threads_started":1}
I20260809 19:12:13.437590 28102 tablet_service.cc:1467] Processing CreateTablet for tablet 259eff040dcd4d30b36f80fd5d551bc6 (DEFAULT_TABLE table=test-table [id=bbca01bc4a41449493c5c912bf172276]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:12:13.439703 28102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 259eff040dcd4d30b36f80fd5d551bc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:12:13.440948 28325 tablet_service.cc:1467] Processing CreateTablet for tablet 259eff040dcd4d30b36f80fd5d551bc6 (DEFAULT_TABLE table=test-table [id=bbca01bc4a41449493c5c912bf172276]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:12:13.442813 28325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 259eff040dcd4d30b36f80fd5d551bc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:12:13.475490 28685 tablet_bootstrap.cc:492] T 259eff040dcd4d30b36f80fd5d551bc6 P 006e73927243438ea7eae081e34d7f88: Bootstrap starting.
I20260809 19:12:13.481673 28685 tablet_bootstrap.cc:654] T 259eff040dcd4d30b36f80fd5d551bc6 P 006e73927243438ea7eae081e34d7f88: Neither blocks nor log segments found. Creating new log.
I20260809 19:12:13.485379 28684 tablet_bootstrap.cc:492] T 259eff040dcd4d30b36f80fd5d551bc6 P ac251c4c0b8e4d9fb76652ceccfe6c91: Bootstrap starting.
I20260809 19:12:13.489985 28685 log.cc:824] T 259eff040dcd4d30b36f80fd5d551bc6 P 006e73927243438ea7eae081e34d7f88: Log is configured to *not* fsync() on all Append() calls
I20260809 19:12:13.491773 28684 tablet_bootstrap.cc:654] T 259eff040dcd4d30b36f80fd5d551bc6 P ac251c4c0b8e4d9fb76652ceccfe6c91: Neither blocks nor log segments found. Creating new log.
I20260809 19:12:13.494031 28684 log.cc:824] T 259eff040dcd4d30b36f80fd5d551bc6 P ac251c4c0b8e4d9fb76652ceccfe6c91: Log is configured to *not* fsync() on all Append() calls
I20260809 19:12:13.497097 28687 tablet_bootstrap.cc:492] T 259eff040dcd4d30b36f80fd5d551bc6 P 04c45893059249d3b00fd98ac4e99daa: Bootstrap starting.
I20260809 19:12:13.501938 28685 tablet_bootstrap.cc:492] T 259eff040dcd4d30b36f80fd5d551bc6 P 006e73927243438ea7eae081e34d7f88: No bootstrap required, opened a new log
I20260809 19:12:13.503204 28687 tablet_bootstrap.cc:654] T 259eff040dcd4d30b36f80fd5d551bc6 P 04c45893059249d3b00fd98ac4e99daa: Neither blocks nor log segments found. Creating new log.
I20260809 19:12:13.505461 28687 log.cc:824] T 259eff040dcd4d30b36f80fd5d551bc6 P 04c45893059249d3b00fd98ac4e99daa: Log is configured to *not* fsync() on all Append() calls
I20260809 19:12:13.510783 28685 ts_tablet_manager.cc:1397] T 259eff040dcd4d30b36f80fd5d551bc6 P 006e73927243438ea7eae081e34d7f88: Time spent bootstrapping tablet: real 0.036s user 0.000s sys 0.017s
I20260809 19:12:13.517357 28684 tablet_bootstrap.cc:492] T 259eff040dcd4d30b36f80fd5d551bc6 P ac251c4c0b8e4d9fb76652ceccfe6c91: No bootstrap required, opened a new log
I20260809 19:12:13.517853 28684 ts_tablet_manager.cc:1397] T 259eff040dcd4d30b36f80fd5d551bc6 P ac251c4c0b8e4d9fb76652ceccfe6c91: Time spent bootstrapping tablet: real 0.033s user 0.010s sys 0.016s
I20260809 19:12:13.526058 28685 raft_consensus.cc:348] T 259eff040dcd4d30b36f80fd5d551bc6 P 006e73927243438ea7eae081e34d7f88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006e73927243438ea7eae081e34d7f88" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36867 } } peers { permanent_uuid: "04c45893059249d3b00fd98ac4e99daa" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 40331 } } peers { permanent_uuid: "ac251c4c0b8e4d9fb76652ceccfe6c91" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 46401 } }
I20260809 19:12:13.526966 28685 raft_consensus.cc:374] T 259eff040dcd4d30b36f80fd5d551bc6 P 006e73927243438ea7eae081e34d7f88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:12:13.527211 28685 raft_consensus.cc:729] T 259eff040dcd4d30b36f80fd5d551bc6 P 006e73927243438ea7eae081e34d7f88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 006e73927243438ea7eae081e34d7f88, State: Initialized, Role: FOLLOWER
I20260809 19:12:13.528167 28685 consensus_queue.cc:260] T 259eff040dcd4d30b36f80fd5d551bc6 P 006e73927243438ea7eae081e34d7f88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006e73927243438ea7eae081e34d7f88" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36867 } } peers { permanent_uuid: "04c45893059249d3b00fd98ac4e99daa" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 40331 } } peers { permanent_uuid: "ac251c4c0b8e4d9fb76652ceccfe6c91" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 46401 } }
I20260809 19:12:13.529394 28687 tablet_bootstrap.cc:492] T 259eff040dcd4d30b36f80fd5d551bc6 P 04c45893059249d3b00fd98ac4e99daa: No bootstrap required, opened a new log
I20260809 19:12:13.529711 28687 ts_tablet_manager.cc:1397] T 259eff040dcd4d30b36f80fd5d551bc6 P 04c45893059249d3b00fd98ac4e99daa: Time spent bootstrapping tablet: real 0.033s user 0.010s sys 0.006s
I20260809 19:12:13.536445 28685 ts_tablet_manager.cc:1428] T 259eff040dcd4d30b36f80fd5d551bc6 P 006e73927243438ea7eae081e34d7f88: Time spent starting tablet: real 0.026s user 0.009s sys 0.014s
I20260809 19:12:13.536859 28641 heartbeater.cc:503] Master 127.7.39.62:41999 was elected leader, sending a full tablet report...
I20260809 19:12:13.540627 28687 raft_consensus.cc:348] T 259eff040dcd4d30b36f80fd5d551bc6 P 04c45893059249d3b00fd98ac4e99daa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006e73927243438ea7eae081e34d7f88" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36867 } } peers { permanent_uuid: "04c45893059249d3b00fd98ac4e99daa" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 40331 } } peers { permanent_uuid: "ac251c4c0b8e4d9fb76652ceccfe6c91" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 46401 } }
I20260809 19:12:13.541092 28687 raft_consensus.cc:374] T 259eff040dcd4d30b36f80fd5d551bc6 P 04c45893059249d3b00fd98ac4e99daa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:12:13.541188 28687 raft_consensus.cc:729] T 259eff040dcd4d30b36f80fd5d551bc6 P 04c45893059249d3b00fd98ac4e99daa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04c45893059249d3b00fd98ac4e99daa, State: Initialized, Role: FOLLOWER
I20260809 19:12:13.541811 28687 consensus_queue.cc:260] T 259eff040dcd4d30b36f80fd5d551bc6 P 04c45893059249d3b00fd98ac4e99daa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006e73927243438ea7eae081e34d7f88" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36867 } } peers { permanent_uuid: "04c45893059249d3b00fd98ac4e99daa" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 40331 } } peers { permanent_uuid: "ac251c4c0b8e4d9fb76652ceccfe6c91" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 46401 } }
I20260809 19:12:13.547047 28684 raft_consensus.cc:348] T 259eff040dcd4d30b36f80fd5d551bc6 P ac251c4c0b8e4d9fb76652ceccfe6c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006e73927243438ea7eae081e34d7f88" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36867 } } peers { permanent_uuid: "04c45893059249d3b00fd98ac4e99daa" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 40331 } } peers { permanent_uuid: "ac251c4c0b8e4d9fb76652ceccfe6c91" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 46401 } }
I20260809 19:12:13.547614 28687 ts_tablet_manager.cc:1428] T 259eff040dcd4d30b36f80fd5d551bc6 P 04c45893059249d3b00fd98ac4e99daa: Time spent starting tablet: real 0.018s user 0.009s sys 0.005s
I20260809 19:12:13.547642 28684 raft_consensus.cc:374] T 259eff040dcd4d30b36f80fd5d551bc6 P ac251c4c0b8e4d9fb76652ceccfe6c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:12:13.547770 28684 raft_consensus.cc:729] T 259eff040dcd4d30b36f80fd5d551bc6 P ac251c4c0b8e4d9fb76652ceccfe6c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac251c4c0b8e4d9fb76652ceccfe6c91, State: Initialized, Role: FOLLOWER
I20260809 19:12:13.548532 28684 consensus_queue.cc:260] T 259eff040dcd4d30b36f80fd5d551bc6 P ac251c4c0b8e4d9fb76652ceccfe6c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006e73927243438ea7eae081e34d7f88" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36867 } } peers { permanent_uuid: "04c45893059249d3b00fd98ac4e99daa" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 40331 } } peers { permanent_uuid: "ac251c4c0b8e4d9fb76652ceccfe6c91" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 46401 } }
I20260809 19:12:13.550529 28198 heartbeater.cc:503] Master 127.7.39.62:41999 was elected leader, sending a full tablet report...
I20260809 19:12:13.551018 28684 ts_tablet_manager.cc:1428] T 259eff040dcd4d30b36f80fd5d551bc6 P ac251c4c0b8e4d9fb76652ceccfe6c91: Time spent starting tablet: real 0.033s user 0.015s sys 0.001s
W20260809 19:12:13.591224 28643 tablet.cc:2369] T 259eff040dcd4d30b36f80fd5d551bc6 P 006e73927243438ea7eae081e34d7f88: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 19:12:13.651825 28202 tablet.cc:2369] T 259eff040dcd4d30b36f80fd5d551bc6 P ac251c4c0b8e4d9fb76652ceccfe6c91: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:12:13.683133 28697 raft_consensus.cc:482] T 259eff040dcd4d30b36f80fd5d551bc6 P ac251c4c0b8e4d9fb76652ceccfe6c91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:12:13.683514 28697 raft_consensus.cc:504] T 259eff040dcd4d30b36f80fd5d551bc6 P ac251c4c0b8e4d9fb76652ceccfe6c91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006e73927243438ea7eae081e34d7f88" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36867 } } peers { permanent_uuid: "04c45893059249d3b00fd98ac4e99daa" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 40331 } } peers { permanent_uuid: "ac251c4c0b8e4d9fb76652ceccfe6c91" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 46401 } }
I20260809 19:12:13.686008 28697 leader_election.cc:288] T 259eff040dcd4d30b36f80fd5d551bc6 P ac251c4c0b8e4d9fb76652ceccfe6c91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 006e73927243438ea7eae081e34d7f88 (127.7.39.3:36867), 04c45893059249d3b00fd98ac4e99daa (127.7.39.2:40331)
I20260809 19:12:13.701085 28666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:13.686619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:48347 (local address 127.7.39.3:36867)
0809 19:12:13.686828 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:13.686834 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:13.693641 (+ 6807us) server_negotiation.cc:407] Connection header received
0809 19:12:13.693928 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:13.693933 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:13.694007 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:13.694073 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:12:13.695031 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:13.696126 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:13.698785 (+ 2659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:13.699941 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:13.700047 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:13.700149 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:13.700694 (+ 545us) server_negotiation.cc:299] Negotiation successful
0809 19:12:13.700828 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 19:12:13.702015 28700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:13.686109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:36867 (local address 127.7.39.1:48347)
0809 19:12:13.693529 (+ 7420us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:13.693550 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:13.693760 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:13.694336 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:13.694341 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:13.694374 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:12:13.694851 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:13.694866 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:13.696303 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:13.696308 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:13.698618 (+ 2310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:13.698632 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:13.700324 (+ 1692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:13.700330 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:13.700518 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:13.700549 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 19:12:13.701527 (+ 978us) client_negotiation.cc:240] Negotiation successful
0809 19:12:13.701659 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7235,"mutex_wait_us":4,"thread_start_us":6734,"threads_started":1}
I20260809 19:12:13.703182 28569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "259eff040dcd4d30b36f80fd5d551bc6" candidate_uuid: "ac251c4c0b8e4d9fb76652ceccfe6c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "006e73927243438ea7eae081e34d7f88" is_pre_election: true
I20260809 19:12:13.703749 28569 raft_consensus.cc:2454] T 259eff040dcd4d30b36f80fd5d551bc6 P 006e73927243438ea7eae081e34d7f88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac251c4c0b8e4d9fb76652ceccfe6c91 in term 0.
I20260809 19:12:13.704481 28671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:13.687298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:34333 (local address 127.7.39.2:40331)
0809 19:12:13.687506 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:13.687513 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:13.693748 (+ 6235us) server_negotiation.cc:407] Connection header received
0809 19:12:13.694065 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:13.694071 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:13.694155 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:13.694223 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:12:13.695309 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:13.696440 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:13.699119 (+ 2679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:13.703212 (+ 4093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:13.703344 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:13.703443 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:13.704128 (+ 685us) server_negotiation.cc:299] Negotiation successful
0809 19:12:13.704258 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 19:12:13.704587 28031 leader_election.cc:302] T 259eff040dcd4d30b36f80fd5d551bc6 P ac251c4c0b8e4d9fb76652ceccfe6c91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 006e73927243438ea7eae081e34d7f88, ac251c4c0b8e4d9fb76652ceccfe6c91; no voters:
I20260809 19:12:13.705063 28697 raft_consensus.cc:2781] T 259eff040dcd4d30b36f80fd5d551bc6 P ac251c4c0b8e4d9fb76652ceccfe6c91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:12:13.705228 28697 raft_consensus.cc:482] T 259eff040dcd4d30b36f80fd5d551bc6 P ac251c4c0b8e4d9fb76652ceccfe6c91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:12:13.705328 28697 raft_consensus.cc:3037] T 259eff040dcd4d30b36f80fd5d551bc6 P ac251c4c0b8e4d9fb76652ceccfe6c91 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:12:13.705461 28698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:13.686768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:40331 (local address 127.7.39.1:34333)
0809 19:12:13.693628 (+ 6860us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:13.693649 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:13.693862 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:13.694494 (+ 632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:13.694498 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:13.694548 (+ 50us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:12:13.695099 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:13.695112 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:13.696668 (+ 1556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:13.696673 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:13.698923 (+ 2250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:13.698939 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:13.703587 (+ 4648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:13.703594 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:13.703927 (+ 333us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:13.703959 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 19:12:13.704705 (+ 746us) client_negotiation.cc:240] Negotiation successful
0809 19:12:13.704831 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6721,"mutex_wait_us":56,"thread_start_us":6380,"threads_started":1}
I20260809 19:12:13.706564 28358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "259eff040dcd4d30b36f80fd5d551bc6" candidate_uuid: "ac251c4c0b8e4d9fb76652ceccfe6c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04c45893059249d3b00fd98ac4e99daa" is_pre_election: true
I20260809 19:12:13.707116 28358 raft_consensus.cc:2454] T 259eff040dcd4d30b36f80fd5d551bc6 P 04c45893059249d3b00fd98ac4e99daa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac251c4c0b8e4d9fb76652ceccfe6c91 in term 0.
I20260809 19:12:13.708355 28697 raft_consensus.cc:504] T 259eff040dcd4d30b36f80fd5d551bc6 P ac251c4c0b8e4d9fb76652ceccfe6c91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006e73927243438ea7eae081e34d7f88" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36867 } } peers { permanent_uuid: "04c45893059249d3b00fd98ac4e99daa" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 40331 } } peers { permanent_uuid: "ac251c4c0b8e4d9fb76652ceccfe6c91" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 46401 } }
I20260809 19:12:13.708968 28697 leader_election.cc:288] T 259eff040dcd4d30b36f80fd5d551bc6 P ac251c4c0b8e4d9fb76652ceccfe6c91 [CANDIDATE]: Term 1 election: Requested vote from peers 006e73927243438ea7eae081e34d7f88 (127.7.39.3:36867), 04c45893059249d3b00fd98ac4e99daa (127.7.39.2:40331)
I20260809 19:12:13.709374 28569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "259eff040dcd4d30b36f80fd5d551bc6" candidate_uuid: "ac251c4c0b8e4d9fb76652ceccfe6c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "006e73927243438ea7eae081e34d7f88"
I20260809 19:12:13.709511 28358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "259eff040dcd4d30b36f80fd5d551bc6" candidate_uuid: "ac251c4c0b8e4d9fb76652ceccfe6c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04c45893059249d3b00fd98ac4e99daa"
I20260809 19:12:13.709600 28569 raft_consensus.cc:3037] T 259eff040dcd4d30b36f80fd5d551bc6 P 006e73927243438ea7eae081e34d7f88 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:12:13.709704 28358 raft_consensus.cc:3037] T 259eff040dcd4d30b36f80fd5d551bc6 P 04c45893059249d3b00fd98ac4e99daa [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:12:13.712704 28569 raft_consensus.cc:2454] T 259eff040dcd4d30b36f80fd5d551bc6 P 006e73927243438ea7eae081e34d7f88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac251c4c0b8e4d9fb76652ceccfe6c91 in term 1.
I20260809 19:12:13.712707 28358 raft_consensus.cc:2454] T 259eff040dcd4d30b36f80fd5d551bc6 P 04c45893059249d3b00fd98ac4e99daa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac251c4c0b8e4d9fb76652ceccfe6c91 in term 1.
I20260809 19:12:13.713119 28031 leader_election.cc:302] T 259eff040dcd4d30b36f80fd5d551bc6 P ac251c4c0b8e4d9fb76652ceccfe6c91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 006e73927243438ea7eae081e34d7f88, 04c45893059249d3b00fd98ac4e99daa, ac251c4c0b8e4d9fb76652ceccfe6c91; no voters:
I20260809 19:12:13.713389 28697 raft_consensus.cc:2781] T 259eff040dcd4d30b36f80fd5d551bc6 P ac251c4c0b8e4d9fb76652ceccfe6c91 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:12:13.713937 28697 raft_consensus.cc:686] T 259eff040dcd4d30b36f80fd5d551bc6 P ac251c4c0b8e4d9fb76652ceccfe6c91 [term 1 LEADER]: Becoming Leader. State: Replica: ac251c4c0b8e4d9fb76652ceccfe6c91, State: Running, Role: LEADER
I20260809 19:12:13.714498 28697 consensus_queue.cc:237] T 259eff040dcd4d30b36f80fd5d551bc6 P ac251c4c0b8e4d9fb76652ceccfe6c91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006e73927243438ea7eae081e34d7f88" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36867 } } peers { permanent_uuid: "04c45893059249d3b00fd98ac4e99daa" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 40331 } } peers { permanent_uuid: "ac251c4c0b8e4d9fb76652ceccfe6c91" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 46401 } }
I20260809 19:12:13.718824 27893 catalog_manager.cc:5495] T 259eff040dcd4d30b36f80fd5d551bc6 P ac251c4c0b8e4d9fb76652ceccfe6c91 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac251c4c0b8e4d9fb76652ceccfe6c91 (127.7.39.1). New cstate: current_term: 1 leader_uuid: "ac251c4c0b8e4d9fb76652ceccfe6c91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006e73927243438ea7eae081e34d7f88" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04c45893059249d3b00fd98ac4e99daa" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac251c4c0b8e4d9fb76652ceccfe6c91" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 46401 } health_report { overall_health: HEALTHY } } }
I20260809 19:12:13.761220 28676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:13.755954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36998 (local address 127.7.39.1:46401)
0809 19:12:13.756158 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:13.756162 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:13.756177 (+ 15us) server_negotiation.cc:407] Connection header received
0809 19:12:13.756257 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:13.756261 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:13.756342 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:13.756469 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:12:13.756861 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:13.757585 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:13.759004 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:13.759446 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:13.759562 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:13.760077 (+ 515us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:12:13.760651 (+ 574us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:12:13.760786 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:13.760873 (+ 87us) server_negotiation.cc:299] Negotiation successful
0809 19:12:13.760952 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 19:12:13.771695 28358 raft_consensus.cc:1261] T 259eff040dcd4d30b36f80fd5d551bc6 P 04c45893059249d3b00fd98ac4e99daa [term 1 FOLLOWER]: Refusing update from remote peer ac251c4c0b8e4d9fb76652ceccfe6c91: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:12:13.771736 28569 raft_consensus.cc:1261] T 259eff040dcd4d30b36f80fd5d551bc6 P 006e73927243438ea7eae081e34d7f88 [term 1 FOLLOWER]: Refusing update from remote peer ac251c4c0b8e4d9fb76652ceccfe6c91: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:12:13.772773 28703 consensus_queue.cc:1035] T 259eff040dcd4d30b36f80fd5d551bc6 P ac251c4c0b8e4d9fb76652ceccfe6c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "006e73927243438ea7eae081e34d7f88" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 36867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:12:13.774076 28697 consensus_queue.cc:1035] T 259eff040dcd4d30b36f80fd5d551bc6 P ac251c4c0b8e4d9fb76652ceccfe6c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04c45893059249d3b00fd98ac4e99daa" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 19:12:13.781096 28427 tablet.cc:2369] T 259eff040dcd4d30b36f80fd5d551bc6 P 04c45893059249d3b00fd98ac4e99daa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:12:13.808615 28709 mvcc.cc:205] Tried to move back new op lower bound from 7316695997517426688 to 7316695997298270208. Current Snapshot: MvccSnapshot[applied={T|T < 7316695997517426688}]
I20260809 19:12:13.865058 27890 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52116:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:12:13.865533 27890 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52116:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:12:13.876950 27890 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 841e0dd854d34cb4aec81c033bcd0e27: Sending DeleteTablet for 3 replicas of tablet 259eff040dcd4d30b36f80fd5d551bc6
I20260809 19:12:13.878479 28534 tablet_service.cc:1514] Processing DeleteTablet for tablet 259eff040dcd4d30b36f80fd5d551bc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:12:13 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:40594
I20260809 19:12:13.879876 28325 tablet_service.cc:1514] Processing DeleteTablet for tablet 259eff040dcd4d30b36f80fd5d551bc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:12:13 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:53516
I20260809 19:12:13.880101 28720 tablet_replica.cc:330] T 259eff040dcd4d30b36f80fd5d551bc6 P 006e73927243438ea7eae081e34d7f88: stopping tablet replica
I20260809 19:12:13.880650 28720 raft_consensus.cc:2229] T 259eff040dcd4d30b36f80fd5d551bc6 P 006e73927243438ea7eae081e34d7f88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:12:13.881613 28720 raft_consensus.cc:2258] T 259eff040dcd4d30b36f80fd5d551bc6 P 006e73927243438ea7eae081e34d7f88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:12:13.881880 28102 tablet_service.cc:1514] Processing DeleteTablet for tablet 259eff040dcd4d30b36f80fd5d551bc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:12:13 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:36988
I20260809 19:12:13.883977 28720 ts_tablet_manager.cc:1905] T 259eff040dcd4d30b36f80fd5d551bc6 P 006e73927243438ea7eae081e34d7f88: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:12:13.893762 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 27967
I20260809 19:12:13.902580 28720 ts_tablet_manager.cc:1918] T 259eff040dcd4d30b36f80fd5d551bc6 P 006e73927243438ea7eae081e34d7f88: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:12:13.914417 28720 log.cc:1196] T 259eff040dcd4d30b36f80fd5d551bc6 P 006e73927243438ea7eae081e34d7f88: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-2/wal/wals/259eff040dcd4d30b36f80fd5d551bc6
I20260809 19:12:13.915130 28720 ts_tablet_manager.cc:1939] T 259eff040dcd4d30b36f80fd5d551bc6 P 006e73927243438ea7eae081e34d7f88: Deleting consensus metadata
I20260809 19:12:13.917201 27868 catalog_manager.cc:4841] TS 006e73927243438ea7eae081e34d7f88 (127.7.39.3:36867): tablet 259eff040dcd4d30b36f80fd5d551bc6 (table test-table [id=bbca01bc4a41449493c5c912bf172276]) successfully deleted
I20260809 19:12:13.923619 28676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:13.906554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37004 (local address 127.7.39.1:46401)
0809 19:12:13.906765 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:13.906773 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:13.906797 (+ 24us) server_negotiation.cc:407] Connection header received
0809 19:12:13.906869 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:13.906876 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:13.906988 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:13.907117 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:13.908632 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:13.909867 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:13.911712 (+ 1845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:13.912410 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:13.912519 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:13.915795 (+ 3276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:13.915810 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:13.915827 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:13.915865 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:13.919748 (+ 3883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:13.920547 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:13.920556 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:13.920560 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:13.920726 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:13.921166 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:13.921171 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:13.921175 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:13.921610 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:13.921873 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:13.923054 (+ 1181us) server_negotiation.cc:299] Negotiation successful
0809 19:12:13.923271 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 19:12:13.924939 28192 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:12:13.929315 28723 tablet_replica.cc:330] T 259eff040dcd4d30b36f80fd5d551bc6 P 04c45893059249d3b00fd98ac4e99daa: stopping tablet replica
I20260809 19:12:13.929877 28723 raft_consensus.cc:2229] T 259eff040dcd4d30b36f80fd5d551bc6 P 04c45893059249d3b00fd98ac4e99daa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:12:13.930620 28723 raft_consensus.cc:2258] T 259eff040dcd4d30b36f80fd5d551bc6 P 04c45893059249d3b00fd98ac4e99daa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:12:13.933840 28723 ts_tablet_manager.cc:1905] T 259eff040dcd4d30b36f80fd5d551bc6 P 04c45893059249d3b00fd98ac4e99daa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:12:13.947706 28723 ts_tablet_manager.cc:1918] T 259eff040dcd4d30b36f80fd5d551bc6 P 04c45893059249d3b00fd98ac4e99daa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:12:13.947957 28723 log.cc:1196] T 259eff040dcd4d30b36f80fd5d551bc6 P 04c45893059249d3b00fd98ac4e99daa: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786302538618573-7324-0/minicluster-data/ts-1/wal/wals/259eff040dcd4d30b36f80fd5d551bc6
I20260809 19:12:13.948621 28723 ts_tablet_manager.cc:1939] T 259eff040dcd4d30b36f80fd5d551bc6 P 04c45893059249d3b00fd98ac4e99daa: Deleting consensus metadata
I20260809 19:12:13.950846 27870 catalog_manager.cc:4841] TS 04c45893059249d3b00fd98ac4e99daa (127.7.39.2:40331): tablet 259eff040dcd4d30b36f80fd5d551bc6 (table test-table [id=bbca01bc4a41449493c5c912bf172276]) successfully deleted
I20260809 19:12:14.121493 28726 tablet_replica.cc:330] T 259eff040dcd4d30b36f80fd5d551bc6 P ac251c4c0b8e4d9fb76652ceccfe6c91: stopping tablet replica
I20260809 19:12:14.121759 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 27967
I20260809 19:12:14.146507 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 28205
W20260809 19:12:14.146409 27869 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.39.1:46401 (error 108)
I20260809 19:12:14.148722 28734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:14.147942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:46401 (local address 127.0.0.1:37006)
0809 19:12:14.148367 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:14.148498 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:46401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":213,"threads_started":1}
W20260809 19:12:14.149010 27869 catalog_manager.cc:4584] TS ac251c4c0b8e4d9fb76652ceccfe6c91 (127.7.39.1:46401): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 259eff040dcd4d30b36f80fd5d551bc6: Network error: Client connection negotiation failed: client connection to 127.7.39.1:46401: connect: Connection refused (error 111)
I20260809 19:12:14.162696 28671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:14.147719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53532 (local address 127.7.39.2:40331)
0809 19:12:14.147919 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:14.147926 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:14.147948 (+ 22us) server_negotiation.cc:407] Connection header received
0809 19:12:14.148021 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:14.148027 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:14.148111 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:14.148231 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:14.149944 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:14.151103 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:14.152559 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:14.153252 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:14.153397 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:14.155799 (+ 2402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:14.155818 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:14.155838 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:14.155881 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:14.159716 (+ 3835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:14.160499 (+ 783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:14.160509 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:14.160513 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:14.160705 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:14.161067 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:14.161071 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:14.161074 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:14.161506 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:14.161800 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:14.162107 (+ 307us) server_negotiation.cc:299] Negotiation successful
0809 19:12:14.162341 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 19:12:14.163332 28417 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:12:14.203143 28734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:14.202588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:46401 (local address 127.0.0.1:37020)
0809 19:12:14.202830 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:14.202956 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:46401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260809 19:12:14.204444 28734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:14.203958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:46401 (local address 127.0.0.1:37034)
0809 19:12:14.204141 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:14.204256 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:46401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 19:12:14.251250 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 28205
I20260809 19:12:14.264998 28734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:14.264471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:46401 (local address 127.0.0.1:37038)
0809 19:12:14.264712 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:14.264822 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:46401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260809 19:12:14.266116 28734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:14.265697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:46401 (local address 127.0.0.1:37042)
0809 19:12:14.265852 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:14.265944 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:46401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260809 19:12:14.274583 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 28430
I20260809 19:12:14.287519 28737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:14.275306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40596 (local address 127.7.39.3:36867)
0809 19:12:14.275757 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:14.275762 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:14.275777 (+ 15us) server_negotiation.cc:407] Connection header received
0809 19:12:14.275837 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:14.275840 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:14.275898 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:14.276002 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:14.277293 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:14.278029 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:14.279318 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:14.279719 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:14.279828 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:14.282224 (+ 2396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:14.282238 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:14.282256 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:14.282308 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:14.284859 (+ 2551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:14.285487 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:14.285497 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:14.285500 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:14.285632 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:14.285970 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:14.285975 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:14.285979 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:14.286379 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:14.286752 (+ 373us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:14.286973 (+ 221us) server_negotiation.cc:299] Negotiation successful
0809 19:12:14.287194 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":224,"threads_started":1}
I20260809 19:12:14.288102 28620 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:12:14.346524 28734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:14.345990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:46401 (local address 127.0.0.1:37046)
0809 19:12:14.346222 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:14.346356 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:46401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260809 19:12:14.347620 28734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:14.347149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:46401 (local address 127.0.0.1:37050)
0809 19:12:14.347370 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:14.347470 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:46401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260809 19:12:14.374425 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 28430
I20260809 19:12:14.395973 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 27835
I20260809 19:12:14.397065 27958 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:12:14.504714 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 27835
I20260809 19:12:14.533937 7324 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 19:12:14.877691 7324 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 19:12:14.877918 7324 mini_ranger.cc:66] Stopping Ranger...
I20260809 19:12:15.222210 7324 mini_ranger.cc:68] Stopped Ranger
2026-08-09 19:12:15.222 UTC [26301] LOG: received smart shutdown request
2026-08-09 19:12:15.225 UTC [26301] LOG: background worker "logical replication launcher" (PID 26311) exited with exit code 1
2026-08-09 19:12:15.225 UTC [26305] LOG: shutting down
2026-08-09 19:12:15.352 UTC [26301] LOG: database system is shut down
2026-08-09T19:12:15Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (50939 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:12:15 dist-test-slave-4tdj krb5kdc[28754](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:12:15 dist-test-slave-4tdj krb5kdc[28754](info): set up 2 sockets
Aug 09 19:12:15 dist-test-slave-4tdj krb5kdc[28754](info): commencing operation
krb5kdc: starting...
W20260809 19:12:16.660933 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.168s user 0.000s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:12:16 dist-test-slave-4tdj krb5kdc[28754](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302736, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:12:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:12:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.39.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
I20260809 19:12:16.871717 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:44923
--webserver_interface=127.7.39.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:35491
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:44923,127.7.39.61:40687,127.7.39.60:45015
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:12:17.195297 28778 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:12:17.195597 28778 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:12:17.195744 28778 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:12:17.202648 28778 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:12:17.202764 28778 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:12:17.202840 28778 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:12:17.202920 28778 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:12:17.202982 28778 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:12:17.212276 28778 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:35491
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:44923,127.7.39.61:40687,127.7.39.60:45015
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:44923
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:12:17.213495 28778 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:12:17.214805 28778 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:12:17.225782 28785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:17.225829 28787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:17.225857 28791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:12:17.226577 28778 server_base.cc:1034] running on GCE node
I20260809 19:12:17.227295 28778 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:12:17.228533 28778 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:12:17.229724 28778 hybrid_clock.cc:648] HybridClock initialized: now 1786302737229671 us; error 45 us; skew 500 ppm
I20260809 19:12:17.230032 28778 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:12:17 dist-test-slave-4tdj krb5kdc[28754](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302737, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:12:17.235313 28778 init.cc:377] Logged in from keytab as kudu/127.7.39.62@KRBTEST.COM (short username kudu)
I20260809 19:12:17.236619 28778 webserver.cc:460] Webserver started at http://127.7.39.62:41293/ using document root <none> and password file <none>
I20260809 19:12:17.237246 28778 fs_manager.cc:359] Metadata directory not provided
I20260809 19:12:17.237360 28778 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:12:17.237643 28778 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:12:17.240515 28778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "e90044f250724503aac3466f571db20e"
format_stamp: "Formatted at 2026-08-09 19:12:17 on dist-test-slave-4tdj"
server_key: "56ff9639224418f0a87f55ebf0699071"
server_key_iv: "8787f5d6e94d06ebedfb9a72e01dc28f"
server_key_version: "encryptionkey@0"
I20260809 19:12:17.241279 28778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "e90044f250724503aac3466f571db20e"
format_stamp: "Formatted at 2026-08-09 19:12:17 on dist-test-slave-4tdj"
server_key: "56ff9639224418f0a87f55ebf0699071"
server_key_iv: "8787f5d6e94d06ebedfb9a72e01dc28f"
server_key_version: "encryptionkey@0"
I20260809 19:12:17.245965 28778 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 19:12:17.249143 28800 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:17.250408 28778 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260809 19:12:17.250557 28778 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "e90044f250724503aac3466f571db20e"
format_stamp: "Formatted at 2026-08-09 19:12:17 on dist-test-slave-4tdj"
server_key: "56ff9639224418f0a87f55ebf0699071"
server_key_iv: "8787f5d6e94d06ebedfb9a72e01dc28f"
server_key_version: "encryptionkey@0"
I20260809 19:12:17.250723 28778 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:12:17.268306 28778 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:12:17.271872 28778 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:12:17.272113 28778 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:12:17.289199 28778 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:44923
I20260809 19:12:17.289242 28874 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:44923 every 8 connection(s)
I20260809 19:12:17.290438 28778 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:12:17.293926 28875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:12:17.300570 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 28778
I20260809 19:12:17.300796 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:12:17.300069 28875 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.39.62" port: 44923 } has no permanent_uuid. Determining permanent_uuid...
I20260809 19:12:17.301630 7324 external_mini_cluster.cc:1428] Setting key 7cd5bc13086e32da82557fc1da43ba5b
Aug 09 19:12:17 dist-test-slave-4tdj krb5kdc[28754](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302737, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:12:17.322664 28878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:17.303525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60894 (local address 127.7.39.62:44923)
0809 19:12:17.305247 (+ 1722us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:17.305256 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:17.305299 (+ 43us) server_negotiation.cc:407] Connection header received
0809 19:12:17.307018 (+ 1719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:17.307023 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:17.307233 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:17.307384 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:17.308757 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:17.309906 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:17.311693 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:17.312464 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:17.312674 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:17.316100 (+ 3426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:17.316108 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:17.316118 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:17.316151 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:17.318640 (+ 2489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:17.319442 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:17.319448 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:17.319451 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:17.319606 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:17.320011 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:17.320015 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:17.320017 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:17.320429 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:17.320643 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:17.321243 (+ 600us) server_negotiation.cc:299] Negotiation successful
0809 19:12:17.321525 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1531,"spinlock_wait_cycles":47360,"thread_start_us":1284,"threads_started":1}
I20260809 19:12:17.322727 28877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:17.303525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:44923 (local address 127.0.0.1:60894)
0809 19:12:17.304365 (+ 840us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:17.304417 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:17.306676 (+ 2259us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:17.307453 (+ 777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:17.307460 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:17.308132 (+ 672us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:12:17.308557 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:17.308579 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:17.310052 (+ 1473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:17.310057 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:17.311561 (+ 1504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:17.311574 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:17.312694 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:17.312698 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:17.312809 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:17.313381 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:12:17.313408 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:12:17.315893 (+ 2485us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:12:17.318767 (+ 2874us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:17.318779 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:17.318790 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:17.319327 (+ 537us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:17.319709 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:17.319713 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:17.319717 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:17.319913 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:17.320622 (+ 709us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:12:17.320629 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:12:17.320844 (+ 215us) client_negotiation.cc:769] Sending connection context
0809 19:12:17.321083 (+ 239us) client_negotiation.cc:240] Negotiation successful
0809 19:12:17.321703 (+ 620us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"mutex_wait_us":157,"thread_start_us":359,"threads_started":1}
I20260809 19:12:17.325316 28875 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.39.61" port: 40687 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.7.39.61@KRBTEST.COM; defaulting to no policy
I20260809 19:12:17.326449 28877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:17.326014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:40687 (local address 127.0.0.1:48788)
0809 19:12:17.326201 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:17.326337 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.61:40687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260809 19:12:17.326686 28805 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.39.61:40687: connect: Connection refused (error 111)
I20260809 19:12:17.328022 28877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:17.327716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:40687 (local address 127.0.0.1:48794)
0809 19:12:17.327838 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:17.327900 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.61:40687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 19:12:17.328204 28875 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.61:40687: Network error: Client connection negotiation failed: client connection to 127.7.39.61:40687: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.61.keytab.
Entry for principal kudu/127.7.39.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.61.keytab.
I20260809 19:12:17.350828 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.61:40687
--webserver_interface=127.7.39.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.61.keytab
--principal=kudu/127.7.39.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:35491
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:44923,127.7.39.61:40687,127.7.39.60:45015
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 19:12:17.377523 28875 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.61" port: 40687 } attempt: 1
I20260809 19:12:17.378696 28877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:17.378183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:40687 (local address 127.0.0.1:48804)
0809 19:12:17.378418 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:17.378523 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.61:40687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260809 19:12:17.379663 28877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:17.379293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:40687 (local address 127.0.0.1:48814)
0809 19:12:17.379425 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:17.379508 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.61:40687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260809 19:12:17.379850 28875 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.61:40687: Network error: Client connection negotiation failed: client connection to 127.7.39.61:40687: connect: Connection refused (error 111)
I20260809 19:12:17.448100 28875 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.61" port: 40687 } attempt: 2
I20260809 19:12:17.449394 28877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:17.448781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:40687 (local address 127.0.0.1:48828)
0809 19:12:17.449066 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:17.449205 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.61:40687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260809 19:12:17.450438 28877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:17.449994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:40687 (local address 127.0.0.1:48836)
0809 19:12:17.450128 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:17.450237 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.61:40687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260809 19:12:17.450691 28875 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.61:40687: Network error: Client connection negotiation failed: client connection to 127.7.39.61:40687: connect: Connection refused (error 111)
I20260809 19:12:17.541967 28875 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.61" port: 40687 } attempt: 3
I20260809 19:12:17.543339 28877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:17.542796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:40687 (local address 127.0.0.1:48846)
0809 19:12:17.543030 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:17.543146 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.61:40687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260809 19:12:17.544431 28877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:17.544018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:40687 (local address 127.0.0.1:48858)
0809 19:12:17.544168 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:17.544267 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.61:40687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 19:12:17.544636 28875 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.61:40687: Network error: Client connection negotiation failed: client connection to 127.7.39.61:40687: connect: Connection refused (error 111)
W20260809 19:12:17.667845 28882 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:12:17.668093 28882 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:12:17.668183 28882 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:12:17.674988 28882 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:12:17.675073 28882 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:12:17.675124 28882 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:12:17.675177 28882 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:12:17.675220 28882 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:12:17.684283 28882 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:35491
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:44923,127.7.39.61:40687,127.7.39.60:45015
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.61.keytab
--principal=kudu/127.7.39.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.61:40687
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.7.39.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:12:17.685396 28882 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:12:17.686609 28882 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 19:12:17.687889 28875 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.61" port: 40687 } attempt: 4
I20260809 19:12:17.689109 28877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:17.688506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:40687 (local address 127.0.0.1:48874)
0809 19:12:17.688837 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:17.688945 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.61:40687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175}
I20260809 19:12:17.690176 28877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:17.689756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:40687 (local address 127.0.0.1:48884)
0809 19:12:17.689898 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:17.690012 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.61:40687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 19:12:17.690398 28875 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.61:40687: Network error: Client connection negotiation failed: client connection to 127.7.39.61:40687: connect: Connection refused (error 111)
W20260809 19:12:17.698094 28894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:17.698333 28893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:17.698135 28896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:12:17.699088 28882 server_base.cc:1034] running on GCE node
I20260809 19:12:17.699749 28882 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:12:17.700896 28882 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:12:17.702095 28882 hybrid_clock.cc:648] HybridClock initialized: now 1786302737702045 us; error 38 us; skew 500 ppm
I20260809 19:12:17.702435 28882 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:12:17 dist-test-slave-4tdj krb5kdc[28754](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302737, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:12:17.705273 28882 init.cc:377] Logged in from keytab as kudu/127.7.39.61@KRBTEST.COM (short username kudu)
I20260809 19:12:17.706593 28882 webserver.cc:460] Webserver started at http://127.7.39.61:40567/ using document root <none> and password file <none>
I20260809 19:12:17.707165 28882 fs_manager.cc:359] Metadata directory not provided
I20260809 19:12:17.707260 28882 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:12:17.707543 28882 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:12:17.710279 28882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-1/data/instance:
uuid: "fa332bd803ef4314801fdd1887f9b8a0"
format_stamp: "Formatted at 2026-08-09 19:12:17 on dist-test-slave-4tdj"
server_key: "15073e7f01f2bb7424ca4e9213e1aa14"
server_key_iv: "e7a0d691272e3cf41e911947736a95d7"
server_key_version: "encryptionkey@0"
I20260809 19:12:17.711035 28882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-1/wal/instance:
uuid: "fa332bd803ef4314801fdd1887f9b8a0"
format_stamp: "Formatted at 2026-08-09 19:12:17 on dist-test-slave-4tdj"
server_key: "15073e7f01f2bb7424ca4e9213e1aa14"
server_key_iv: "e7a0d691272e3cf41e911947736a95d7"
server_key_version: "encryptionkey@0"
I20260809 19:12:17.715662 28882 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 19:12:17.718880 28906 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:17.720088 28882 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 19:12:17.720225 28882 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-1/wal
uuid: "fa332bd803ef4314801fdd1887f9b8a0"
format_stamp: "Formatted at 2026-08-09 19:12:17 on dist-test-slave-4tdj"
server_key: "15073e7f01f2bb7424ca4e9213e1aa14"
server_key_iv: "e7a0d691272e3cf41e911947736a95d7"
server_key_version: "encryptionkey@0"
I20260809 19:12:17.720387 28882 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:12:17.731389 28882 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:12:17.734809 28882 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:12:17.735036 28882 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:12:17.751724 28882 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.61:40687
I20260809 19:12:17.751760 28983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.61:40687 every 8 connection(s)
I20260809 19:12:17.752974 28882 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-1/data/info.pb
I20260809 19:12:17.756393 28984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:12:17.758275 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 28882
I20260809 19:12:17.758476 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-1/wal/instance
I20260809 19:12:17.758910 7324 external_mini_cluster.cc:1428] Setting key 3f2d14552bd8915e0ee064b839cb803e
I20260809 19:12:17.762647 28984 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.39.62" port: 44923 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 19:12:17 dist-test-slave-4tdj krb5kdc[28754](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302737, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.61@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.7.39.60@KRBTEST.COM; defaulting to no policy
I20260809 19:12:17.781713 28878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:17.765267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32896 (local address 127.7.39.62:44923)
0809 19:12:17.765450 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:17.765456 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:17.766566 (+ 1110us) server_negotiation.cc:407] Connection header received
0809 19:12:17.768623 (+ 2057us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:17.768628 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:17.768711 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:17.768801 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:17.770199 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:17.770918 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:17.772393 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:17.772813 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:17.772925 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:17.776346 (+ 3421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:17.776352 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:17.776355 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:17.776389 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:17.778960 (+ 2571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:17.779771 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:17.779775 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:17.779777 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:17.779883 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:17.780305 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:17.780308 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:17.780310 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:17.780579 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:17.780692 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:17.781273 (+ 581us) server_negotiation.cc:299] Negotiation successful
0809 19:12:17.781475 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 19:12:17.782503 28986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:17.765622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:44923 (local address 127.0.0.1:32896)
0809 19:12:17.766404 (+ 782us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:17.766459 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:17.768352 (+ 1893us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:17.769030 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:17.769038 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:17.769505 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:12:17.770025 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:17.770041 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:17.771075 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:17.771079 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:17.772248 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:17.772261 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:17.773027 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:17.773035 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:17.773232 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:17.773849 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:12:17.773875 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:12:17.776126 (+ 2251us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:12:17.779105 (+ 2979us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:17.779114 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:17.779127 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:17.779670 (+ 543us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:17.779985 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:17.779989 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:17.780001 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:17.780218 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:17.780699 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:12:17.780705 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:12:17.780981 (+ 276us) client_negotiation.cc:769] Sending connection context
0809 19:12:17.781199 (+ 218us) client_negotiation.cc:240] Negotiation successful
0809 19:12:17.781536 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":289,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.60@KRBTEST.COM" created.
I20260809 19:12:17.784049 28984 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.39.61" port: 40687 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 19:12:17 dist-test-slave-4tdj krb5kdc[28754](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302737, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.61@KRBTEST.COM for kudu/127.7.39.61@KRBTEST.COM
I20260809 19:12:17.797387 28986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:17.784745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:40687 (local address 127.0.0.1:45830)
0809 19:12:17.784920 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:17.784938 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:17.785027 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:17.785730 (+ 703us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:17.785735 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:17.786121 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:12:17.786277 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:17.786307 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:17.787577 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:17.787582 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:17.788742 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:17.788756 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:17.789475 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:17.789484 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:17.789676 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:17.790158 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:12:17.790178 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:12:17.792240 (+ 2062us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:12:17.795156 (+ 2916us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:17.795162 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:17.795166 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:17.795482 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:17.795818 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:17.795822 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:17.795826 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:17.795957 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:17.796500 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:12:17.796505 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:12:17.796665 (+ 160us) client_negotiation.cc:769] Sending connection context
0809 19:12:17.796776 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 19:12:17.797017 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 19:12:17.797497 28988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:17.784809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45830 (local address 127.7.39.61:40687)
0809 19:12:17.785358 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:17.785364 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:17.785387 (+ 23us) server_negotiation.cc:407] Connection header received
0809 19:12:17.785425 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:17.785431 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:17.785572 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:17.785684 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:17.786435 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:17.787419 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:17.788861 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:17.789341 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:17.789430 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:17.792420 (+ 2990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:17.792430 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:17.792441 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:17.792473 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:17.795042 (+ 2569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:17.795602 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:17.795608 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:17.795610 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:17.795719 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:17.796050 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:17.796055 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:17.796058 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:17.796389 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:17.796580 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:17.796941 (+ 361us) server_negotiation.cc:299] Negotiation successful
0809 19:12:17.797133 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":271,"threads_started":1}
I20260809 19:12:17.799481 28984 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.39.60" port: 45015 } has no permanent_uuid. Determining permanent_uuid...
I20260809 19:12:17.800673 28986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:17.800164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:45015 (local address 127.0.0.1:51942)
0809 19:12:17.800342 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:17.800480 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:45015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260809 19:12:17.800948 28909 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.39.60:45015: connect: Connection refused (error 111)
I20260809 19:12:17.802474 28986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:17.802104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:45015 (local address 127.0.0.1:51948)
0809 19:12:17.802235 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:17.802344 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:45015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 19:12:17.802719 28984 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.60:45015: Network error: Client connection negotiation failed: client connection to 127.7.39.60:45015: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.60.keytab.
Entry for principal kudu/127.7.39.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.60.keytab.
I20260809 19:12:17.808633 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.60:45015
--webserver_interface=127.7.39.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.60.keytab
--principal=kudu/127.7.39.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:35491
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:44923,127.7.39.61:40687,127.7.39.60:45015
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 19:12:17.851991 28984 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.60" port: 45015 } attempt: 1
I20260809 19:12:17.852995 28986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:17.852604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:45015 (local address 127.0.0.1:51954)
0809 19:12:17.852765 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:17.852859 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:45015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260809 19:12:17.853967 28986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:17.853670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:45015 (local address 127.0.0.1:51958)
0809 19:12:17.853788 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:17.853865 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:45015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260809 19:12:17.854166 28984 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.60:45015: Network error: Client connection negotiation failed: client connection to 127.7.39.60:45015: connect: Connection refused (error 111)
I20260809 19:12:17.922375 28984 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.60" port: 45015 } attempt: 2
I20260809 19:12:17.923558 28986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:17.923113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:45015 (local address 127.0.0.1:51964)
0809 19:12:17.923295 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:17.923389 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:45015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260809 19:12:17.924482 28986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:17.924190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:45015 (local address 127.0.0.1:51968)
0809 19:12:17.924306 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:17.924374 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:45015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260809 19:12:17.924697 28984 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.60:45015: Network error: Client connection negotiation failed: client connection to 127.7.39.60:45015: connect: Connection refused (error 111)
I20260809 19:12:17.989681 28875 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.61" port: 40687 } attempt: 5
Aug 09 19:12:17 dist-test-slave-4tdj krb5kdc[28754](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302737, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for kudu/127.7.39.61@KRBTEST.COM
I20260809 19:12:18.002508 28877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:17.990466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:40687 (local address 127.0.0.1:45846)
0809 19:12:17.990688 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:17.990710 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:17.990845 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:17.991204 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:17.991209 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:17.991633 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:12:17.991814 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:17.991824 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:17.992834 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:17.992838 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:17.993714 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:17.993728 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:17.994511 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:17.994517 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:17.994726 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:17.995343 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:12:17.995369 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:12:17.997412 (+ 2043us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:12:18.000205 (+ 2793us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:18.000211 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:18.000215 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:18.000564 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:18.000897 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:18.000903 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:18.000907 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:18.001046 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:18.001557 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:12:18.001562 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:12:18.001711 (+ 149us) client_negotiation.cc:769] Sending connection context
0809 19:12:18.001828 (+ 117us) client_negotiation.cc:240] Negotiation successful
0809 19:12:18.002125 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75}
I20260809 19:12:18.002517 28988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:17.990560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45846 (local address 127.7.39.61:40687)
0809 19:12:17.990736 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:17.990742 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:17.990766 (+ 24us) server_negotiation.cc:407] Connection header received
0809 19:12:17.990975 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:17.990981 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:17.991059 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:17.991145 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:17.991967 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:17.992678 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:17.993890 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:17.994375 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:17.994498 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:17.997598 (+ 3100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:17.997603 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:17.997606 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:17.997637 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:18.000076 (+ 2439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:18.000672 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:18.000676 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:18.000678 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:18.000794 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:18.001146 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:18.001151 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:18.001155 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:18.001429 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:18.001574 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:18.001949 (+ 375us) server_negotiation.cc:299] Negotiation successful
0809 19:12:18.002154 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 19:12:18.003734 28875 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.39.60" port: 45015 } has no permanent_uuid. Determining permanent_uuid...
I20260809 19:12:18.004777 28877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:18.004395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:45015 (local address 127.0.0.1:51976)
0809 19:12:18.004565 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:18.004643 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:45015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260809 19:12:18.005686 28877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:18.005377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:45015 (local address 127.0.0.1:51986)
0809 19:12:18.005515 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:18.005595 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:45015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 19:12:18.005867 28875 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.60:45015: Network error: Client connection negotiation failed: client connection to 127.7.39.60:45015: connect: Connection refused (error 111)
I20260809 19:12:18.015923 28984 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.60" port: 45015 } attempt: 3
I20260809 19:12:18.016806 28986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:18.016427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:45015 (local address 127.0.0.1:52000)
0809 19:12:18.016599 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:18.016674 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:45015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260809 19:12:18.017738 28986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:18.017349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:45015 (local address 127.0.0.1:52008)
0809 19:12:18.017560 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:18.017635 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:45015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
W20260809 19:12:18.017938 28984 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.60:45015: Network error: Client connection negotiation failed: client connection to 127.7.39.60:45015: connect: Connection refused (error 111)
I20260809 19:12:18.057060 28875 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.60" port: 45015 } attempt: 1
I20260809 19:12:18.058065 28877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:18.057628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:45015 (local address 127.0.0.1:52022)
0809 19:12:18.057821 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:18.057904 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:45015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260809 19:12:18.059000 28877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:18.058682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:45015 (local address 127.0.0.1:52036)
0809 19:12:18.058825 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:18.058892 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:45015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 19:12:18.059190 28875 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.60:45015: Network error: Client connection negotiation failed: client connection to 127.7.39.60:45015: connect: Connection refused (error 111)
W20260809 19:12:18.126633 28992 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:12:18.126912 28992 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:12:18.127040 28992 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260809 19:12:18.127411 28875 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.60" port: 45015 } attempt: 2
I20260809 19:12:18.128608 28877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:18.128093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:45015 (local address 127.0.0.1:52038)
0809 19:12:18.128314 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:18.128409 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:45015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260809 19:12:18.129791 28877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:18.129391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:45015 (local address 127.0.0.1:52044)
0809 19:12:18.129551 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:18.129643 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:45015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 19:12:18.130039 28875 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.60:45015: Network error: Client connection negotiation failed: client connection to 127.7.39.60:45015: connect: Connection refused (error 111)
W20260809 19:12:18.134470 28992 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:12:18.134567 28992 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:12:18.134637 28992 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:12:18.134717 28992 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:12:18.134771 28992 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:12:18.144276 28992 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:35491
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:44923,127.7.39.61:40687,127.7.39.60:45015
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.60.keytab
--principal=kudu/127.7.39.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.60:45015
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.7.39.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:12:18.145560 28992 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:12:18.146852 28992 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:12:18.157599 28997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:18.157653 29002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:18.157689 28998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:12:18.159024 28992 server_base.cc:1034] running on GCE node
I20260809 19:12:18.159729 28992 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:12:18.161023 28992 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:12:18.161134 28984 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.60" port: 45015 } attempt: 4
I20260809 19:12:18.162079 28986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:18.161629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:45015 (local address 127.0.0.1:52052)
0809 19:12:18.161854 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:18.161932 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:45015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260809 19:12:18.162400 28992 hybrid_clock.cc:648] HybridClock initialized: now 1786302738162340 us; error 41 us; skew 500 ppm
I20260809 19:12:18.162741 28992 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:12:18.163149 28986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:18.162720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:45015 (local address 127.0.0.1:52066)
0809 19:12:18.162909 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:18.163014 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:45015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260809 19:12:18.163396 28984 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.60:45015: Network error: Client connection negotiation failed: client connection to 127.7.39.60:45015: connect: Connection refused (error 111)
Aug 09 19:12:18 dist-test-slave-4tdj krb5kdc[28754](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302738, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:12:18.165817 28992 init.cc:377] Logged in from keytab as kudu/127.7.39.60@KRBTEST.COM (short username kudu)
I20260809 19:12:18.167205 28992 webserver.cc:460] Webserver started at http://127.7.39.60:44959/ using document root <none> and password file <none>
I20260809 19:12:18.167858 28992 fs_manager.cc:359] Metadata directory not provided
I20260809 19:12:18.167972 28992 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:12:18.168243 28992 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:12:18.171115 28992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-2/data/instance:
uuid: "06fac03957a34f07a3a00e247b36de7e"
format_stamp: "Formatted at 2026-08-09 19:12:18 on dist-test-slave-4tdj"
server_key: "7f3330313735b67bffd562ef68ea5264"
server_key_iv: "d56561b4274169d3f0176a0c98da52fc"
server_key_version: "encryptionkey@0"
I20260809 19:12:18.171876 28992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-2/wal/instance:
uuid: "06fac03957a34f07a3a00e247b36de7e"
format_stamp: "Formatted at 2026-08-09 19:12:18 on dist-test-slave-4tdj"
server_key: "7f3330313735b67bffd562ef68ea5264"
server_key_iv: "d56561b4274169d3f0176a0c98da52fc"
server_key_version: "encryptionkey@0"
I20260809 19:12:18.176695 28992 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 19:12:18.179867 29012 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:18.181082 28992 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 19:12:18.181238 28992 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-2/wal
uuid: "06fac03957a34f07a3a00e247b36de7e"
format_stamp: "Formatted at 2026-08-09 19:12:18 on dist-test-slave-4tdj"
server_key: "7f3330313735b67bffd562ef68ea5264"
server_key_iv: "d56561b4274169d3f0176a0c98da52fc"
server_key_version: "encryptionkey@0"
I20260809 19:12:18.181401 28992 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:12:18.199067 28992 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:12:18.202922 28992 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:12:18.203166 28992 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:12:18.220099 28992 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.60:45015
I20260809 19:12:18.220158 29090 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.60:45015 every 8 connection(s)
I20260809 19:12:18.221319 28992 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-2/data/info.pb
I20260809 19:12:18.225041 29091 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:12:18.226766 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 28992
I20260809 19:12:18.226927 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786302538618573-7324-0/minicluster-data/master-2/wal/instance
I20260809 19:12:18.227331 7324 external_mini_cluster.cc:1428] Setting key 55191a1b1d1f9c51d5ff48c542c0784e
I20260809 19:12:18.233192 29091 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.39.62" port: 44923 } has no permanent_uuid. Determining permanent_uuid...
I20260809 19:12:18.236253 28875 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.60" port: 45015 } attempt: 3
Aug 09 19:12:18 dist-test-slave-4tdj krb5kdc[28754](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302736, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.60@KRBTEST.COM
Aug 09 19:12:18 dist-test-slave-4tdj krb5kdc[28754](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302738, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.60@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
Aug 09 19:12:18 dist-test-slave-4tdj krb5kdc[28754](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302737, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for kudu/127.7.39.60@KRBTEST.COM
I20260809 19:12:18.250313 29095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:18.229041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52068 (local address 127.7.39.60:45015)
0809 19:12:18.229769 (+ 728us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:18.229779 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:18.229824 (+ 45us) server_negotiation.cc:407] Connection header received
0809 19:12:18.231367 (+ 1543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:18.231388 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:18.231736 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:18.232063 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:18.233468 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:18.234793 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:18.236338 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:18.237523 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:18.237750 (+ 227us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:18.242410 (+ 4660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:18.242418 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:18.242432 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:18.242471 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:18.245759 (+ 3288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:18.246431 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:18.246439 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:18.246446 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:18.246919 (+ 473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:18.247354 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:18.247359 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:18.247363 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:18.247892 (+ 529us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:18.248181 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:18.248615 (+ 434us) server_negotiation.cc:299] Negotiation successful
0809 19:12:18.248982 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":35,"server-negotiator.queue_time_us":546,"thread_start_us":334,"threads_started":1}
I20260809 19:12:18.251070 28878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:18.235437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32910 (local address 127.7.39.62:44923)
0809 19:12:18.235649 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:18.235654 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:18.236097 (+ 443us) server_negotiation.cc:407] Connection header received
0809 19:12:18.236319 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:18.236325 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:18.236389 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:18.236474 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:18.238184 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:18.239105 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:18.240558 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:18.241102 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:18.241209 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:18.244737 (+ 3528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:18.244743 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:18.244746 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:18.244779 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:18.248105 (+ 3326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:18.248919 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:18.248925 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:18.248928 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:18.249064 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:18.249465 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:18.249470 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:18.249473 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:18.249864 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:18.250035 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:18.250620 (+ 585us) server_negotiation.cc:299] Negotiation successful
0809 19:12:18.250821 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 19:12:18.251866 29096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:18.235345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:44923 (local address 127.0.0.1:32910)
0809 19:12:18.235952 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:18.236001 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:18.236162 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:18.236606 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:18.236614 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:18.237530 (+ 916us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:12:18.238024 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:18.238038 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:18.239252 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:18.239257 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:18.240401 (+ 1144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:18.240414 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:18.241312 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:18.241319 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:18.241477 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:18.242000 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:12:18.242028 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:12:18.244555 (+ 2527us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:12:18.248263 (+ 3708us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:18.248274 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:18.248280 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:18.248803 (+ 523us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:18.249165 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:18.249170 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:18.249173 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:18.249353 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:18.250003 (+ 650us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:12:18.250011 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:12:18.250234 (+ 223us) client_negotiation.cc:769] Sending connection context
0809 19:12:18.251228 (+ 994us) client_negotiation.cc:240] Negotiation successful
0809 19:12:18.251495 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":391,"mutex_wait_us":3,"thread_start_us":257,"threads_started":1}
I20260809 19:12:18.253434 29091 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.39.61" port: 40687 } has no permanent_uuid. Determining permanent_uuid...
I20260809 19:12:18.253873 28877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:18.236751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:45015 (local address 127.0.0.1:52082)
0809 19:12:18.236998 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:18.237016 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:18.237110 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:18.237999 (+ 889us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:18.238003 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:18.238509 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:12:18.238701 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:18.238712 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:18.240208 (+ 1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:18.240214 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:18.241569 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:18.241585 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:18.242775 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:18.242781 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:18.242944 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:18.243566 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:12:18.243590 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:12:18.246191 (+ 2601us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:12:18.250740 (+ 4549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:18.250745 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:18.250749 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:18.251229 (+ 480us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:18.251681 (+ 452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:18.251685 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:18.251687 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:18.251803 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:18.252666 (+ 863us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:12:18.252670 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:12:18.253125 (+ 455us) client_negotiation.cc:769] Sending connection context
0809 19:12:18.253258 (+ 133us) client_negotiation.cc:240] Negotiation successful
0809 19:12:18.253494 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129}
I20260809 19:12:18.254786 29098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:18.236954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52082 (local address 127.7.39.60:45015)
0809 19:12:18.237674 (+ 720us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:18.237679 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:18.237699 (+ 20us) server_negotiation.cc:407] Connection header received
0809 19:12:18.237739 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:18.237743 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:18.237807 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:18.238517 (+ 710us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:18.238872 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:18.240063 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:18.241937 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:18.242617 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:18.242751 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:18.246555 (+ 3804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:18.246561 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:18.246566 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:18.246600 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:18.250576 (+ 3976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:18.251364 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:18.251369 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:18.251372 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:18.251528 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:18.251915 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:18.251919 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:18.251922 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:18.252273 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:18.252408 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:18.254119 (+ 1711us) server_negotiation.cc:299] Negotiation successful
0809 19:12:18.254411 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":601,"thread_start_us":422,"threads_started":1}
I20260809 19:12:18.260382 28875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e90044f250724503aac3466f571db20e: Bootstrap starting.
Aug 09 19:12:18 dist-test-slave-4tdj krb5kdc[28754](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302738, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.60@KRBTEST.COM for kudu/127.7.39.61@KRBTEST.COM
Aug 09 19:12:18 dist-test-slave-4tdj krb5kdc[28754](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302736, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:12:18.264457 28875 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e90044f250724503aac3466f571db20e: Neither blocks nor log segments found. Creating new log.
I20260809 19:12:18.265926 28875 log.cc:824] T 00000000000000000000000000000000 P e90044f250724503aac3466f571db20e: Log is configured to *not* fsync() on all Append() calls
I20260809 19:12:18.267805 29096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:18.254198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:40687 (local address 127.0.0.1:45860)
0809 19:12:18.254687 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:18.254700 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:18.254799 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:18.255263 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:18.255267 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:18.255723 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:12:18.255906 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:18.255917 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:18.256905 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:18.256910 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:18.258054 (+ 1144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:18.258068 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:18.259002 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:18.259009 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:18.259217 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:18.259726 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:12:18.259747 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:12:18.261668 (+ 1921us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:12:18.265234 (+ 3566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:18.265239 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:18.265243 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:18.265738 (+ 495us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:18.266171 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:18.266176 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:18.266179 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:18.266363 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:18.266929 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:12:18.266934 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:12:18.267092 (+ 158us) client_negotiation.cc:769] Sending connection context
0809 19:12:18.267249 (+ 157us) client_negotiation.cc:240] Negotiation successful
0809 19:12:18.267496 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":411}
I20260809 19:12:18.267814 28988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:18.254278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45860 (local address 127.7.39.61:40687)
0809 19:12:18.254502 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:18.254507 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:18.254770 (+ 263us) server_negotiation.cc:407] Connection header received
0809 19:12:18.254941 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:18.254946 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:18.255030 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:18.255086 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:18.256090 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:18.256761 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:18.258206 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:18.258857 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:18.258990 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:18.261845 (+ 2855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:18.261850 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:18.261853 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:18.261885 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:18.265081 (+ 3196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:18.265867 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:18.265873 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:18.265875 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:18.266045 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:18.266478 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:18.266482 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:18.266485 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:18.266812 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:18.266954 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:18.267372 (+ 418us) server_negotiation.cc:299] Negotiation successful
0809 19:12:18.267535 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260809 19:12:18.268873 29091 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.39.60" port: 45015 } has no permanent_uuid. Determining permanent_uuid...
I20260809 19:12:18.269794 28878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:18.253881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32914 (local address 127.7.39.62:44923)
0809 19:12:18.254025 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:18.254030 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:18.254076 (+ 46us) server_negotiation.cc:407] Connection header received
0809 19:12:18.254119 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:18.254123 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:18.254188 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:18.254274 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:18.256024 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:18.257143 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:18.258754 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:18.259313 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:18.259683 (+ 370us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:18.263923 (+ 4240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:18.263928 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:18.263931 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:18.263959 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:18.266973 (+ 3014us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:18.267750 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:18.267756 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:18.267759 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:18.267899 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:18.268371 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:18.268376 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:18.268378 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:18.268728 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:18.268995 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:18.269281 (+ 286us) server_negotiation.cc:299] Negotiation successful
0809 19:12:18.269492 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 19:12:18.269912 28875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e90044f250724503aac3466f571db20e: No bootstrap required, opened a new log
Aug 09 19:12:18 dist-test-slave-4tdj krb5kdc[28754](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302738, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.60@KRBTEST.COM for kudu/127.7.39.60@KRBTEST.COM
Aug 09 19:12:18 dist-test-slave-4tdj krb5kdc[28754](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302736, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.61@KRBTEST.COM
I20260809 19:12:18.279692 28875 raft_consensus.cc:348] T 00000000000000000000000000000000 P e90044f250724503aac3466f571db20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e90044f250724503aac3466f571db20e" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 44923 } } peers { permanent_uuid: "fa332bd803ef4314801fdd1887f9b8a0" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 40687 } } peers { permanent_uuid: "06fac03957a34f07a3a00e247b36de7e" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 45015 } }
I20260809 19:12:18.280086 28875 raft_consensus.cc:374] T 00000000000000000000000000000000 P e90044f250724503aac3466f571db20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:12:18.280215 28875 raft_consensus.cc:729] T 00000000000000000000000000000000 P e90044f250724503aac3466f571db20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e90044f250724503aac3466f571db20e, State: Initialized, Role: FOLLOWER
I20260809 19:12:18.280864 28875 consensus_queue.cc:260] T 00000000000000000000000000000000 P e90044f250724503aac3466f571db20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e90044f250724503aac3466f571db20e" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 44923 } } peers { permanent_uuid: "fa332bd803ef4314801fdd1887f9b8a0" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 40687 } } peers { permanent_uuid: "06fac03957a34f07a3a00e247b36de7e" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 45015 } }
I20260809 19:12:18.281847 29107 sys_catalog.cc:455] T 00000000000000000000000000000000 P e90044f250724503aac3466f571db20e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e90044f250724503aac3466f571db20e" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 44923 } } peers { permanent_uuid: "fa332bd803ef4314801fdd1887f9b8a0" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 40687 } } peers { permanent_uuid: "06fac03957a34f07a3a00e247b36de7e" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 45015 } } }
I20260809 19:12:18.282425 29107 sys_catalog.cc:458] T 00000000000000000000000000000000 P e90044f250724503aac3466f571db20e [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:12:18.283171 28875 sys_catalog.cc:564] T 00000000000000000000000000000000 P e90044f250724503aac3466f571db20e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:12:18.283953 29096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:18.269652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:45015 (local address 127.0.0.1:52084)
0809 19:12:18.270256 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:18.270272 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:18.270387 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:18.270757 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:18.270761 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:18.271169 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:12:18.271335 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:18.271346 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:18.272642 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:18.272647 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:18.273942 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:18.273956 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:18.274968 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:18.274973 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:18.275141 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:18.275639 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:12:18.275658 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:12:18.278073 (+ 2415us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:12:18.281505 (+ 3432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:18.281509 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:18.281513 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:18.281961 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:18.282386 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:18.282390 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:18.282393 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:18.282576 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:18.283072 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:12:18.283076 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:12:18.283195 (+ 119us) client_negotiation.cc:769] Sending connection context
0809 19:12:18.283314 (+ 119us) client_negotiation.cc:240] Negotiation successful
0809 19:12:18.283589 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516}
I20260809 19:12:18.284081 29098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:18.270120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52084 (local address 127.7.39.60:45015)
0809 19:12:18.270460 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:18.270465 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:18.270482 (+ 17us) server_negotiation.cc:407] Connection header received
0809 19:12:18.270524 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:18.270528 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:18.270603 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:18.270723 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:18.271489 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:18.272493 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:18.274086 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:18.274827 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:18.275386 (+ 559us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:18.278249 (+ 2863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:18.278254 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:18.278259 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:18.278314 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:18.281355 (+ 3041us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:18.282107 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:18.282111 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:18.282114 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:18.282259 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:18.282696 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:18.282699 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:18.282701 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:18.282948 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:18.283065 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:18.283431 (+ 366us) server_negotiation.cc:299] Negotiation successful
0809 19:12:18.283730 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":98,"server-negotiator.queue_time_us":233}
I20260809 19:12:18.287228 28988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:18.271294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45864 (local address 127.7.39.61:40687)
0809 19:12:18.271442 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:18.271447 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:18.271504 (+ 57us) server_negotiation.cc:407] Connection header received
0809 19:12:18.271657 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:18.271662 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:18.271722 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:18.271797 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:18.273062 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:18.274067 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:18.275320 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:18.275847 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:18.275957 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:18.280017 (+ 4060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:18.280023 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:18.280026 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:18.280061 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:18.283377 (+ 3316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:18.284188 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:18.284193 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:18.284196 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:18.284414 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:18.284936 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:18.284941 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:18.284945 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:18.285284 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:18.286599 (+ 1315us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:18.286693 (+ 94us) server_negotiation.cc:299] Negotiation successful
0809 19:12:18.286892 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 19:12:18.291975 29091 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06fac03957a34f07a3a00e247b36de7e: Bootstrap starting.
I20260809 19:12:18.292094 7324 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:12:18.295974 29091 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 06fac03957a34f07a3a00e247b36de7e: Neither blocks nor log segments found. Creating new log.
I20260809 19:12:18.297310 29091 log.cc:824] T 00000000000000000000000000000000 P 06fac03957a34f07a3a00e247b36de7e: Log is configured to *not* fsync() on all Append() calls
I20260809 19:12:18.306684 29091 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06fac03957a34f07a3a00e247b36de7e: No bootstrap required, opened a new log
I20260809 19:12:18.319073 29091 raft_consensus.cc:348] T 00000000000000000000000000000000 P 06fac03957a34f07a3a00e247b36de7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e90044f250724503aac3466f571db20e" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 44923 } } peers { permanent_uuid: "fa332bd803ef4314801fdd1887f9b8a0" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 40687 } } peers { permanent_uuid: "06fac03957a34f07a3a00e247b36de7e" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 45015 } }
I20260809 19:12:18.319485 29091 raft_consensus.cc:374] T 00000000000000000000000000000000 P 06fac03957a34f07a3a00e247b36de7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:12:18.319622 29091 raft_consensus.cc:729] T 00000000000000000000000000000000 P 06fac03957a34f07a3a00e247b36de7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06fac03957a34f07a3a00e247b36de7e, State: Initialized, Role: FOLLOWER
I20260809 19:12:18.320354 29091 consensus_queue.cc:260] T 00000000000000000000000000000000 P 06fac03957a34f07a3a00e247b36de7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e90044f250724503aac3466f571db20e" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 44923 } } peers { permanent_uuid: "fa332bd803ef4314801fdd1887f9b8a0" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 40687 } } peers { permanent_uuid: "06fac03957a34f07a3a00e247b36de7e" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 45015 } }
W20260809 19:12:18.328766 29136 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e90044f250724503aac3466f571db20e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 19:12:18.328903 29136 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 19:12:18.330696 28878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:18.308541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32920 (local address 127.7.39.62:44923)
0809 19:12:18.308728 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:18.308734 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:18.311152 (+ 2418us) server_negotiation.cc:407] Connection header received
0809 19:12:18.311310 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:18.311316 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:18.311403 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:18.311504 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:18.313877 (+ 2373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:18.315006 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:18.317197 (+ 2191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:18.317812 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:18.317903 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:18.323005 (+ 5102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:18.323012 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:18.323016 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:18.323061 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:18.326911 (+ 3850us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:18.327994 (+ 1083us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:18.328001 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:18.328005 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:18.328211 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:18.328669 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:18.328674 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:18.328677 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:18.329078 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:18.329331 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:18.330023 (+ 692us) server_negotiation.cc:299] Negotiation successful
0809 19:12:18.330280 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 19:12:18.333743 29098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:18.309017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52100 (local address 127.7.39.60:45015)
0809 19:12:18.309173 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:18.309180 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:18.314860 (+ 5680us) server_negotiation.cc:407] Connection header received
0809 19:12:18.315083 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:18.315088 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:18.315176 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:18.315242 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:18.317602 (+ 2360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:18.318642 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:18.320649 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:18.321315 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:18.321411 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:18.325306 (+ 3895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:18.325313 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:18.325317 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:18.325356 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:18.328577 (+ 3221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:18.331410 (+ 2833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:18.331415 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:18.331419 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:18.331575 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:18.332133 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:18.332138 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:18.332142 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:18.332407 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:18.332590 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:18.333175 (+ 585us) server_negotiation.cc:299] Negotiation successful
0809 19:12:18.333421 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 19:12:18.334908 29138 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06fac03957a34f07a3a00e247b36de7e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e90044f250724503aac3466f571db20e" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 44923 } } peers { permanent_uuid: "fa332bd803ef4314801fdd1887f9b8a0" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 40687 } } peers { permanent_uuid: "06fac03957a34f07a3a00e247b36de7e" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 45015 } } }
I20260809 19:12:18.335327 29138 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06fac03957a34f07a3a00e247b36de7e [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:12:18.336980 29091 sys_catalog.cc:564] T 00000000000000000000000000000000 P 06fac03957a34f07a3a00e247b36de7e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:12:18.325440 28778 master_runner.cc:186] Error getting master registration for 127.7.39.61:40687: OK, instance_id { permanent_uuid: "fa332bd803ef4314801fdd1887f9b8a0" instance_seqno: 1786302737747036 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 19:12:18.337415 28778 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 19:12:18.344269 28988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:18.315020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45868 (local address 127.7.39.61:40687)
0809 19:12:18.315183 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:18.315188 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:18.325153 (+ 9965us) server_negotiation.cc:407] Connection header received
0809 19:12:18.329530 (+ 4377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:18.329535 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:18.329611 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:18.329681 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:18.333817 (+ 4136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:18.334749 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:18.336200 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:18.336601 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:18.336709 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:18.339298 (+ 2589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:18.339303 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:18.339306 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:18.339339 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:18.341736 (+ 2397us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:18.342409 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:18.342414 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:18.342416 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:18.342552 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:18.342897 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:18.342900 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:18.342902 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:18.343187 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:18.343413 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:18.343721 (+ 308us) server_negotiation.cc:299] Negotiation successful
0809 19:12:18.343939 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
W20260809 19:12:18.357342 29157 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 06fac03957a34f07a3a00e247b36de7e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 19:12:18.357542 29157 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 19:12:18.356122 28992 master_runner.cc:186] Error getting master registration for 127.7.39.61:40687: OK, instance_id { permanent_uuid: "fa332bd803ef4314801fdd1887f9b8a0" instance_seqno: 1786302737747036 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 19:12:18.367165 28992 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 19:12:18.410132 29107 raft_consensus.cc:482] T 00000000000000000000000000000000 P e90044f250724503aac3466f571db20e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:12:18.410455 29107 raft_consensus.cc:504] T 00000000000000000000000000000000 P e90044f250724503aac3466f571db20e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e90044f250724503aac3466f571db20e" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 44923 } } peers { permanent_uuid: "fa332bd803ef4314801fdd1887f9b8a0" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 40687 } } peers { permanent_uuid: "06fac03957a34f07a3a00e247b36de7e" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 45015 } }
I20260809 19:12:18.412149 29107 leader_election.cc:288] T 00000000000000000000000000000000 P e90044f250724503aac3466f571db20e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa332bd803ef4314801fdd1887f9b8a0 (127.7.39.61:40687), 06fac03957a34f07a3a00e247b36de7e (127.7.39.60:45015)
I20260809 19:12:18.413187 29051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e90044f250724503aac3466f571db20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fac03957a34f07a3a00e247b36de7e" is_pre_election: true
I20260809 19:12:18.413825 29051 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 06fac03957a34f07a3a00e247b36de7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e90044f250724503aac3466f571db20e in term 0.
I20260809 19:12:18.414770 28802 leader_election.cc:302] T 00000000000000000000000000000000 P e90044f250724503aac3466f571db20e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fac03957a34f07a3a00e247b36de7e, e90044f250724503aac3466f571db20e; no voters:
I20260809 19:12:18.415267 29107 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e90044f250724503aac3466f571db20e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:12:18.415416 29107 raft_consensus.cc:482] T 00000000000000000000000000000000 P e90044f250724503aac3466f571db20e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:12:18.415534 29107 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e90044f250724503aac3466f571db20e [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:12:18.418898 29107 raft_consensus.cc:504] T 00000000000000000000000000000000 P e90044f250724503aac3466f571db20e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e90044f250724503aac3466f571db20e" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 44923 } } peers { permanent_uuid: "fa332bd803ef4314801fdd1887f9b8a0" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 40687 } } peers { permanent_uuid: "06fac03957a34f07a3a00e247b36de7e" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 45015 } }
I20260809 19:12:18.421392 29107 leader_election.cc:288] T 00000000000000000000000000000000 P e90044f250724503aac3466f571db20e [CANDIDATE]: Term 1 election: Requested vote from peers fa332bd803ef4314801fdd1887f9b8a0 (127.7.39.61:40687), 06fac03957a34f07a3a00e247b36de7e (127.7.39.60:45015)
I20260809 19:12:18.421463 29051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e90044f250724503aac3466f571db20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fac03957a34f07a3a00e247b36de7e"
I20260809 19:12:18.421701 29051 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 06fac03957a34f07a3a00e247b36de7e [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:12:18.425101 29051 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 06fac03957a34f07a3a00e247b36de7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e90044f250724503aac3466f571db20e in term 1.
I20260809 19:12:18.425629 28802 leader_election.cc:302] T 00000000000000000000000000000000 P e90044f250724503aac3466f571db20e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fac03957a34f07a3a00e247b36de7e, e90044f250724503aac3466f571db20e; no voters:
I20260809 19:12:18.426219 29107 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e90044f250724503aac3466f571db20e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:12:18.427150 29107 raft_consensus.cc:686] T 00000000000000000000000000000000 P e90044f250724503aac3466f571db20e [term 1 LEADER]: Becoming Leader. State: Replica: e90044f250724503aac3466f571db20e, State: Running, Role: LEADER
I20260809 19:12:18.428370 29107 consensus_queue.cc:237] T 00000000000000000000000000000000 P e90044f250724503aac3466f571db20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e90044f250724503aac3466f571db20e" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 44923 } } peers { permanent_uuid: "fa332bd803ef4314801fdd1887f9b8a0" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 40687 } } peers { permanent_uuid: "06fac03957a34f07a3a00e247b36de7e" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 45015 } }
I20260809 19:12:18.436326 29159 sys_catalog.cc:455] T 00000000000000000000000000000000 P e90044f250724503aac3466f571db20e [sys.catalog]: SysCatalogTable state changed. Reason: New leader e90044f250724503aac3466f571db20e. Latest consensus state: current_term: 1 leader_uuid: "e90044f250724503aac3466f571db20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e90044f250724503aac3466f571db20e" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 44923 } } peers { permanent_uuid: "fa332bd803ef4314801fdd1887f9b8a0" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 40687 } } peers { permanent_uuid: "06fac03957a34f07a3a00e247b36de7e" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 45015 } } }
I20260809 19:12:18.436749 29159 sys_catalog.cc:458] T 00000000000000000000000000000000 P e90044f250724503aac3466f571db20e [sys.catalog]: This master's current role is: LEADER
I20260809 19:12:18.443447 29162 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:12:18.448108 29162 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260809 19:12:18.455099 29019 tablet.cc:2369] T 00000000000000000000000000000000 P 06fac03957a34f07a3a00e247b36de7e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:12:18.463038 29051 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 06fac03957a34f07a3a00e247b36de7e [term 1 FOLLOWER]: Refusing update from remote peer e90044f250724503aac3466f571db20e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:12:18.463523 28984 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.60" port: 45015 } attempt: 5
I20260809 19:12:18.464059 29159 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e90044f250724503aac3466f571db20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fac03957a34f07a3a00e247b36de7e" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 45015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Aug 09 19:12:18 dist-test-slave-4tdj krb5kdc[28754](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302737, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.61@KRBTEST.COM for kudu/127.7.39.60@KRBTEST.COM
I20260809 19:12:18.483918 29098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:18.464772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52102 (local address 127.7.39.60:45015)
0809 19:12:18.464929 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:18.464934 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:18.464950 (+ 16us) server_negotiation.cc:407] Connection header received
0809 19:12:18.465005 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:18.465010 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:18.465084 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:18.465173 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:18.466153 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:18.467272 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:18.469064 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:18.469838 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:18.469960 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:18.474940 (+ 4980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:18.474947 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:18.474952 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:18.474991 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:18.478834 (+ 3843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:18.480201 (+ 1367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:18.480207 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:18.480211 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:18.480372 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:18.481109 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:18.481113 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:18.481116 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:18.481466 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:18.481611 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:18.482694 (+ 1083us) server_negotiation.cc:299] Negotiation successful
0809 19:12:18.483111 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 19:12:18.485977 28986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:18.464098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:45015 (local address 127.0.0.1:52102)
0809 19:12:18.464428 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:18.464448 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:18.464573 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:18.465237 (+ 664us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:18.465243 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:18.465784 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:12:18.466019 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:18.466033 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:18.467447 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:18.467452 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:18.468885 (+ 1433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:18.468902 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:18.470162 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:18.470168 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:18.470387 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:18.471198 (+ 811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:12:18.471223 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:12:18.474707 (+ 3484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:12:18.479097 (+ 4390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:18.479103 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:18.479107 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:18.480011 (+ 904us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:18.480617 (+ 606us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:18.480622 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:18.480625 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:18.480905 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:18.481787 (+ 882us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:12:18.481792 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:12:18.482061 (+ 269us) client_negotiation.cc:769] Sending connection context
0809 19:12:18.484829 (+ 2768us) client_negotiation.cc:240] Negotiation successful
0809 19:12:18.485340 (+ 511us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210}
I20260809 19:12:18.490656 29138 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06fac03957a34f07a3a00e247b36de7e [sys.catalog]: SysCatalogTable state changed. Reason: New leader e90044f250724503aac3466f571db20e. Latest consensus state: current_term: 1 leader_uuid: "e90044f250724503aac3466f571db20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e90044f250724503aac3466f571db20e" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 44923 } } peers { permanent_uuid: "fa332bd803ef4314801fdd1887f9b8a0" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 40687 } } peers { permanent_uuid: "06fac03957a34f07a3a00e247b36de7e" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 45015 } } }
I20260809 19:12:18.490962 29138 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06fac03957a34f07a3a00e247b36de7e [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:12:18.492555 28984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa332bd803ef4314801fdd1887f9b8a0: Bootstrap starting.
I20260809 19:12:18.495211 29159 sys_catalog.cc:455] T 00000000000000000000000000000000 P e90044f250724503aac3466f571db20e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e90044f250724503aac3466f571db20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e90044f250724503aac3466f571db20e" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 44923 } } peers { permanent_uuid: "fa332bd803ef4314801fdd1887f9b8a0" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 40687 } } peers { permanent_uuid: "06fac03957a34f07a3a00e247b36de7e" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 45015 } } }
I20260809 19:12:18.495658 29159 sys_catalog.cc:458] T 00000000000000000000000000000000 P e90044f250724503aac3466f571db20e [sys.catalog]: This master's current role is: LEADER
I20260809 19:12:18.498530 29162 catalog_manager.cc:1347] Generated new cluster ID: 7d2a4a1aaf5643809391a04891e2d216
I20260809 19:12:18.498651 29162 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:12:18.502987 29164 mvcc.cc:205] Tried to move back new op lower bound from 7316696016734113792 to 7316696016620847104. Current Snapshot: MvccSnapshot[applied={T|T < 7316696016734113792}]
I20260809 19:12:18.503417 29163 mvcc.cc:205] Tried to move back new op lower bound from 7316696016734113792 to 7316696016620847104. Current Snapshot: MvccSnapshot[applied={T|T < 7316696016734113792 or (T in {7316696016734113792})}]
I20260809 19:12:18.506565 28984 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fa332bd803ef4314801fdd1887f9b8a0: Neither blocks nor log segments found. Creating new log.
I20260809 19:12:18.510926 29138 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06fac03957a34f07a3a00e247b36de7e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e90044f250724503aac3466f571db20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e90044f250724503aac3466f571db20e" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 44923 } } peers { permanent_uuid: "fa332bd803ef4314801fdd1887f9b8a0" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 40687 } } peers { permanent_uuid: "06fac03957a34f07a3a00e247b36de7e" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 45015 } } }
I20260809 19:12:18.511183 29138 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06fac03957a34f07a3a00e247b36de7e [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:12:18.512862 28984 log.cc:824] T 00000000000000000000000000000000 P fa332bd803ef4314801fdd1887f9b8a0: Log is configured to *not* fsync() on all Append() calls
I20260809 19:12:18.521737 29162 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:12:18.526039 29162 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:12:18.531153 28984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa332bd803ef4314801fdd1887f9b8a0: No bootstrap required, opened a new log
I20260809 19:12:18.544955 29162 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e90044f250724503aac3466f571db20e: Generated new TSK 0
I20260809 19:12:18.549662 29162 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:12:18.550730 28984 raft_consensus.cc:348] T 00000000000000000000000000000000 P fa332bd803ef4314801fdd1887f9b8a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e90044f250724503aac3466f571db20e" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 44923 } } peers { permanent_uuid: "fa332bd803ef4314801fdd1887f9b8a0" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 40687 } } peers { permanent_uuid: "06fac03957a34f07a3a00e247b36de7e" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 45015 } }
I20260809 19:12:18.551445 28984 raft_consensus.cc:374] T 00000000000000000000000000000000 P fa332bd803ef4314801fdd1887f9b8a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:12:18.551651 28984 raft_consensus.cc:729] T 00000000000000000000000000000000 P fa332bd803ef4314801fdd1887f9b8a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa332bd803ef4314801fdd1887f9b8a0, State: Initialized, Role: FOLLOWER
I20260809 19:12:18.552835 28984 consensus_queue.cc:260] T 00000000000000000000000000000000 P fa332bd803ef4314801fdd1887f9b8a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e90044f250724503aac3466f571db20e" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 44923 } } peers { permanent_uuid: "fa332bd803ef4314801fdd1887f9b8a0" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 40687 } } peers { permanent_uuid: "06fac03957a34f07a3a00e247b36de7e" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 45015 } }
I20260809 19:12:18.554455 29178 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa332bd803ef4314801fdd1887f9b8a0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e90044f250724503aac3466f571db20e" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 44923 } } peers { permanent_uuid: "fa332bd803ef4314801fdd1887f9b8a0" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 40687 } } peers { permanent_uuid: "06fac03957a34f07a3a00e247b36de7e" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 45015 } } }
I20260809 19:12:18.555190 29178 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa332bd803ef4314801fdd1887f9b8a0 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:12:18.556936 28945 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e90044f250724503aac3466f571db20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa332bd803ef4314801fdd1887f9b8a0"
I20260809 19:12:18.557281 28943 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fa332bd803ef4314801fdd1887f9b8a0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:12:18.557765 28946 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e90044f250724503aac3466f571db20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa332bd803ef4314801fdd1887f9b8a0" is_pre_election: true
I20260809 19:12:18.559022 28984 sys_catalog.cc:564] T 00000000000000000000000000000000 P fa332bd803ef4314801fdd1887f9b8a0 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:12:18.560870 28943 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fa332bd803ef4314801fdd1887f9b8a0 [term 1 FOLLOWER]: Refusing update from remote peer e90044f250724503aac3466f571db20e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:12:18.561703 29172 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e90044f250724503aac3466f571db20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa332bd803ef4314801fdd1887f9b8a0" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 40687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:12:18.602613 29178 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa332bd803ef4314801fdd1887f9b8a0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e90044f250724503aac3466f571db20e. Latest consensus state: current_term: 1 leader_uuid: "e90044f250724503aac3466f571db20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e90044f250724503aac3466f571db20e" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 44923 } } peers { permanent_uuid: "fa332bd803ef4314801fdd1887f9b8a0" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 40687 } } peers { permanent_uuid: "06fac03957a34f07a3a00e247b36de7e" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 45015 } } }
I20260809 19:12:18.602589 29185 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa332bd803ef4314801fdd1887f9b8a0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e90044f250724503aac3466f571db20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e90044f250724503aac3466f571db20e" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 44923 } } peers { permanent_uuid: "fa332bd803ef4314801fdd1887f9b8a0" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 40687 } } peers { permanent_uuid: "06fac03957a34f07a3a00e247b36de7e" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 45015 } } }
I20260809 19:12:18.602978 29178 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa332bd803ef4314801fdd1887f9b8a0 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:12:18.603020 29185 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa332bd803ef4314801fdd1887f9b8a0 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:12:18.661815 29208 catalog_manager.cc:1259] Loaded cluster ID: 7d2a4a1aaf5643809391a04891e2d216
I20260809 19:12:18.661926 29208 catalog_manager.cc:1552] T 00000000000000000000000000000000 P fa332bd803ef4314801fdd1887f9b8a0: loading cluster ID for follower catalog manager: success
I20260809 19:12:18.667279 29208 catalog_manager.cc:1574] T 00000000000000000000000000000000 P fa332bd803ef4314801fdd1887f9b8a0: acquiring CA information for follower catalog manager: success
I20260809 19:12:18.669726 29208 catalog_manager.cc:1602] T 00000000000000000000000000000000 P fa332bd803ef4314801fdd1887f9b8a0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 19:12:18.939756 29107 sys_catalog.cc:455] T 00000000000000000000000000000000 P e90044f250724503aac3466f571db20e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e90044f250724503aac3466f571db20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e90044f250724503aac3466f571db20e" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 44923 } } peers { permanent_uuid: "fa332bd803ef4314801fdd1887f9b8a0" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 40687 } } peers { permanent_uuid: "06fac03957a34f07a3a00e247b36de7e" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 45015 } } }
I20260809 19:12:18.940073 29107 sys_catalog.cc:458] T 00000000000000000000000000000000 P e90044f250724503aac3466f571db20e [sys.catalog]: This master's current role is: LEADER
I20260809 19:12:19.359745 29157 catalog_manager.cc:1259] Loaded cluster ID: 7d2a4a1aaf5643809391a04891e2d216
I20260809 19:12:19.359864 29157 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 06fac03957a34f07a3a00e247b36de7e: loading cluster ID for follower catalog manager: success
I20260809 19:12:19.362339 29157 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 06fac03957a34f07a3a00e247b36de7e: acquiring CA information for follower catalog manager: success
I20260809 19:12:19.364213 29157 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 06fac03957a34f07a3a00e247b36de7e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 19:12:19.699136 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 28778
I20260809 19:12:19.700376 28869 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:12:19.813397 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 28778
W20260809 19:12:19.838002 29016 connection.cc:535] server connection from 127.0.0.1:52082 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 19:12:19.838037 28909 connection.cc:535] server connection from 127.0.0.1:45846 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 19:12:19.838456 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 28882
I20260809 19:12:19.839440 28973 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:12:19.942196 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 28882
I20260809 19:12:19.965932 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 28992
I20260809 19:12:19.967032 29083 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:12:20.071527 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 28992
2026-08-09T19:12:20Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (4628 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:12:20 dist-test-slave-4tdj krb5kdc[29219](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:12:20 dist-test-slave-4tdj krb5kdc[29219](info): set up 2 sockets
Aug 09 19:12:20 dist-test-slave-4tdj krb5kdc[29219](info): commencing operation
krb5kdc: starting...
W20260809 19:12:21.288959 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.001s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:12:21 dist-test-slave-4tdj krb5kdc[29219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302741, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:12:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:12:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.39.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
I20260809 19:12:21.513118 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:36807
--webserver_interface=127.7.39.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:33769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:36807
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:12:21.837698 29233 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:12:21.837970 29233 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:12:21.838114 29233 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:12:21.844950 29233 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:12:21.845059 29233 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:12:21.845139 29233 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:12:21.845227 29233 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:12:21.845288 29233 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:12:21.854653 29233 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:33769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:36807
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:36807
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:12:21.855865 29233 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:12:21.857105 29233 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:12:21.868072 29240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:21.868012 29250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:21.868018 29245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:12:21.868826 29233 server_base.cc:1034] running on GCE node
I20260809 19:12:21.869551 29233 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:12:21.870890 29233 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:12:21.872092 29233 hybrid_clock.cc:648] HybridClock initialized: now 1786302741872052 us; error 26 us; skew 500 ppm
I20260809 19:12:21.872394 29233 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:12:21 dist-test-slave-4tdj krb5kdc[29219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302741, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:12:21.875320 29233 init.cc:377] Logged in from keytab as kudu/127.7.39.62@KRBTEST.COM (short username kudu)
I20260809 19:12:21.876684 29233 webserver.cc:460] Webserver started at http://127.7.39.62:33555/ using document root <none> and password file <none>
I20260809 19:12:21.877310 29233 fs_manager.cc:359] Metadata directory not provided
I20260809 19:12:21.877416 29233 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:12:21.877720 29233 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:12:21.880584 29233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "dbd29787319343c0b473f2f048aaa390"
format_stamp: "Formatted at 2026-08-09 19:12:21 on dist-test-slave-4tdj"
server_key: "862b975c8fb061d39acef83c397ae5b8"
server_key_iv: "e93a81e7a3c31dc1fc7c1c657ec2f9ee"
server_key_version: "encryptionkey@0"
I20260809 19:12:21.881291 29233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "dbd29787319343c0b473f2f048aaa390"
format_stamp: "Formatted at 2026-08-09 19:12:21 on dist-test-slave-4tdj"
server_key: "862b975c8fb061d39acef83c397ae5b8"
server_key_iv: "e93a81e7a3c31dc1fc7c1c657ec2f9ee"
server_key_version: "encryptionkey@0"
I20260809 19:12:21.886350 29233 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.007s
I20260809 19:12:21.889616 29257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:21.890863 29233 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260809 19:12:21.891016 29233 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "dbd29787319343c0b473f2f048aaa390"
format_stamp: "Formatted at 2026-08-09 19:12:21 on dist-test-slave-4tdj"
server_key: "862b975c8fb061d39acef83c397ae5b8"
server_key_iv: "e93a81e7a3c31dc1fc7c1c657ec2f9ee"
server_key_version: "encryptionkey@0"
I20260809 19:12:21.891203 29233 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:12:21.912480 29233 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:12:21.916574 29233 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:12:21.916833 29233 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:12:21.934340 29233 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:36807
I20260809 19:12:21.934392 29337 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:36807 every 8 connection(s)
I20260809 19:12:21.935676 29233 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:12:21.939330 29339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:12:21.940661 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 29233
I20260809 19:12:21.940908 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:12:21.941799 7324 external_mini_cluster.cc:1428] Setting key ac01bd76a59a4bf9b0e4d2161350cf92
I20260809 19:12:21.953606 29339 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbd29787319343c0b473f2f048aaa390: Bootstrap starting.
Aug 09 19:12:21 dist-test-slave-4tdj krb5kdc[29219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302741, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:12:21.957160 29339 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dbd29787319343c0b473f2f048aaa390: Neither blocks nor log segments found. Creating new log.
I20260809 19:12:21.958349 29339 log.cc:824] T 00000000000000000000000000000000 P dbd29787319343c0b473f2f048aaa390: Log is configured to *not* fsync() on all Append() calls
I20260809 19:12:21.961083 29339 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbd29787319343c0b473f2f048aaa390: No bootstrap required, opened a new log
I20260809 19:12:21.963749 29343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:21.943678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36716 (local address 127.7.39.62:36807)
0809 19:12:21.944549 (+ 871us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:21.944560 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:21.944606 (+ 46us) server_negotiation.cc:407] Connection header received
0809 19:12:21.946183 (+ 1577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:21.946210 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:21.946644 (+ 434us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:21.946950 (+ 306us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:21.948631 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:21.949873 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:21.951741 (+ 1868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:21.952372 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:21.952512 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:21.956997 (+ 4485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:21.957004 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:21.957018 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:21.957063 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:21.959986 (+ 2923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:21.960621 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:21.960627 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:21.960633 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:21.960794 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:21.961163 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:21.961167 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:21.961170 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:21.961673 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:21.961971 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:21.962395 (+ 424us) server_negotiation.cc:299] Negotiation successful
0809 19:12:21.962814 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":655,"thread_start_us":439,"threads_started":1}
I20260809 19:12:21.967268 7324 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:12:21.968765 29339 raft_consensus.cc:348] T 00000000000000000000000000000000 P dbd29787319343c0b473f2f048aaa390 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbd29787319343c0b473f2f048aaa390" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 36807 } }
I20260809 19:12:21.969108 29339 raft_consensus.cc:374] T 00000000000000000000000000000000 P dbd29787319343c0b473f2f048aaa390 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:12:21.969200 29339 raft_consensus.cc:729] T 00000000000000000000000000000000 P dbd29787319343c0b473f2f048aaa390 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd29787319343c0b473f2f048aaa390, State: Initialized, Role: FOLLOWER
I20260809 19:12:21.969797 29339 consensus_queue.cc:260] T 00000000000000000000000000000000 P dbd29787319343c0b473f2f048aaa390 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbd29787319343c0b473f2f048aaa390" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 36807 } }
I20260809 19:12:21.970031 29339 raft_consensus.cc:388] T 00000000000000000000000000000000 P dbd29787319343c0b473f2f048aaa390 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:12:21.970178 29339 raft_consensus.cc:482] T 00000000000000000000000000000000 P dbd29787319343c0b473f2f048aaa390 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:12:21.970369 29339 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dbd29787319343c0b473f2f048aaa390 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:12:21.972394 29339 raft_consensus.cc:504] T 00000000000000000000000000000000 P dbd29787319343c0b473f2f048aaa390 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbd29787319343c0b473f2f048aaa390" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 36807 } }
I20260809 19:12:21.972837 29339 leader_election.cc:302] T 00000000000000000000000000000000 P dbd29787319343c0b473f2f048aaa390 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dbd29787319343c0b473f2f048aaa390; no voters:
I20260809 19:12:21.973362 29339 leader_election.cc:288] T 00000000000000000000000000000000 P dbd29787319343c0b473f2f048aaa390 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:12:21.973471 29345 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dbd29787319343c0b473f2f048aaa390 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:12:21.974082 29345 raft_consensus.cc:686] T 00000000000000000000000000000000 P dbd29787319343c0b473f2f048aaa390 [term 1 LEADER]: Becoming Leader. State: Replica: dbd29787319343c0b473f2f048aaa390, State: Running, Role: LEADER
I20260809 19:12:21.974612 29345 consensus_queue.cc:237] T 00000000000000000000000000000000 P dbd29787319343c0b473f2f048aaa390 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbd29787319343c0b473f2f048aaa390" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 36807 } }
I20260809 19:12:21.975253 29339 sys_catalog.cc:564] T 00000000000000000000000000000000 P dbd29787319343c0b473f2f048aaa390 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:12:21.977085 29346 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbd29787319343c0b473f2f048aaa390 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dbd29787319343c0b473f2f048aaa390" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbd29787319343c0b473f2f048aaa390" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 36807 } } }
I20260809 19:12:21.977469 29346 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbd29787319343c0b473f2f048aaa390 [sys.catalog]: This master's current role is: LEADER
I20260809 19:12:21.977986 29347 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbd29787319343c0b473f2f048aaa390 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dbd29787319343c0b473f2f048aaa390. Latest consensus state: current_term: 1 leader_uuid: "dbd29787319343c0b473f2f048aaa390" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbd29787319343c0b473f2f048aaa390" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 36807 } } }
I20260809 19:12:21.978322 29347 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbd29787319343c0b473f2f048aaa390 [sys.catalog]: This master's current role is: LEADER
I20260809 19:12:21.979243 29356 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:12:21.983995 29356 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:12:21.993194 29356 catalog_manager.cc:1347] Generated new cluster ID: 4f882f54dd6949bea2bc714e5ace8e27
I20260809 19:12:21.993291 29356 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:12:22.007812 29356 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:12:22.008926 29356 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:12:22.014606 29356 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dbd29787319343c0b473f2f048aaa390: Generated new TSK 0
I20260809 19:12:22.015252 29356 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:12:22.027318 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 29233
I20260809 19:12:22.028401 29330 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:12:22.116496 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 29233
2026-08-09T19:12:22Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2035 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:12:22 dist-test-slave-4tdj krb5kdc[29381](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:12:22 dist-test-slave-4tdj krb5kdc[29381](info): set up 2 sockets
Aug 09 19:12:22 dist-test-slave-4tdj krb5kdc[29381](info): commencing operation
krb5kdc: starting...
W20260809 19:12:23.352813 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.196s user 0.000s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:12:23 dist-test-slave-4tdj krb5kdc[29381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302743, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:12:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:12:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.39.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
I20260809 19:12:23.577996 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:42585
--webserver_interface=127.7.39.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:32953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:42585
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:12:23.893540 29401 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:12:23.893810 29401 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:12:23.893939 29401 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:12:23.900898 29401 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:12:23.900990 29401 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:12:23.901063 29401 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:12:23.901137 29401 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:12:23.901199 29401 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:12:23.910645 29401 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:32953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:42585
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:42585
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:12:23.911855 29401 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:12:23.913087 29401 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:12:23.923799 29406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:23.923871 29407 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:23.923897 29411 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:12:23.924993 29401 server_base.cc:1034] running on GCE node
I20260809 19:12:23.925696 29401 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:12:23.926992 29401 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:12:23.928197 29401 hybrid_clock.cc:648] HybridClock initialized: now 1786302743928146 us; error 38 us; skew 500 ppm
I20260809 19:12:23.928512 29401 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:12:23 dist-test-slave-4tdj krb5kdc[29381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302743, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:12:23.935964 29401 init.cc:377] Logged in from keytab as kudu/127.7.39.62@KRBTEST.COM (short username kudu)
I20260809 19:12:23.937386 29401 webserver.cc:460] Webserver started at http://127.7.39.62:39657/ using document root <none> and password file <none>
I20260809 19:12:23.938030 29401 fs_manager.cc:359] Metadata directory not provided
I20260809 19:12:23.938146 29401 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:12:23.938463 29401 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:12:23.941306 29401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "4cafbefbc00f4a9db26e582141e6d80f"
format_stamp: "Formatted at 2026-08-09 19:12:23 on dist-test-slave-4tdj"
server_key: "4c5a5b5ad5a63fce8ff69382efd2b93c"
server_key_iv: "bc3d3c3af70f879eab5fd2f429eae3c7"
server_key_version: "encryptionkey@0"
I20260809 19:12:23.942042 29401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "4cafbefbc00f4a9db26e582141e6d80f"
format_stamp: "Formatted at 2026-08-09 19:12:23 on dist-test-slave-4tdj"
server_key: "4c5a5b5ad5a63fce8ff69382efd2b93c"
server_key_iv: "bc3d3c3af70f879eab5fd2f429eae3c7"
server_key_version: "encryptionkey@0"
I20260809 19:12:23.946875 29401 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260809 19:12:23.950007 29422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:23.951223 29401 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 19:12:23.951386 29401 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "4cafbefbc00f4a9db26e582141e6d80f"
format_stamp: "Formatted at 2026-08-09 19:12:23 on dist-test-slave-4tdj"
server_key: "4c5a5b5ad5a63fce8ff69382efd2b93c"
server_key_iv: "bc3d3c3af70f879eab5fd2f429eae3c7"
server_key_version: "encryptionkey@0"
I20260809 19:12:23.951550 29401 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:12:23.964098 29401 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:12:23.968367 29401 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:12:23.968662 29401 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:12:23.986797 29401 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:42585
I20260809 19:12:23.986861 29508 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:42585 every 8 connection(s)
I20260809 19:12:23.988083 29401 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:12:23.991971 29512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:12:23.997416 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 29401
I20260809 19:12:23.997649 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:12:23.998479 7324 external_mini_cluster.cc:1428] Setting key 66707170ff8c15e4a5dcb9a8c5f89316
I20260809 19:12:24.003135 29512 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f: Bootstrap starting.
I20260809 19:12:24.006696 29512 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f: Neither blocks nor log segments found. Creating new log.
I20260809 19:12:24.007892 29512 log.cc:824] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f: Log is configured to *not* fsync() on all Append() calls
I20260809 19:12:24.010839 29512 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f: No bootstrap required, opened a new log
Aug 09 19:12:24 dist-test-slave-4tdj krb5kdc[29381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302743, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:12:24.018204 29512 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cafbefbc00f4a9db26e582141e6d80f" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 42585 } }
I20260809 19:12:24.018579 29512 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:12:24.018682 29512 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cafbefbc00f4a9db26e582141e6d80f, State: Initialized, Role: FOLLOWER
I20260809 19:12:24.019268 29512 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cafbefbc00f4a9db26e582141e6d80f" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 42585 } }
I20260809 19:12:24.019579 29512 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:12:24.019717 29512 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:12:24.019941 29512 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:12:24.021034 29518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:24.000517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43480 (local address 127.7.39.62:42585)
0809 19:12:24.001325 (+ 808us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:24.001336 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:24.001377 (+ 41us) server_negotiation.cc:407] Connection header received
0809 19:12:24.003031 (+ 1654us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:24.003053 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:24.003451 (+ 398us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:24.003742 (+ 291us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:24.005486 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:24.006874 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:24.008646 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:24.009495 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:24.009620 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:24.013647 (+ 4027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:24.013654 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:24.013667 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:24.013705 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:24.016699 (+ 2994us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:24.017344 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:24.017350 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:24.017356 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:24.017517 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:24.017883 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:24.017887 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:24.017889 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:24.018413 (+ 524us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:24.018683 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:24.019134 (+ 451us) server_negotiation.cc:299] Negotiation successful
0809 19:12:24.019757 (+ 623us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":389,"threads_started":1}
I20260809 19:12:24.023293 29512 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cafbefbc00f4a9db26e582141e6d80f" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 42585 } }
I20260809 19:12:24.023883 29512 leader_election.cc:302] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4cafbefbc00f4a9db26e582141e6d80f; no voters:
I20260809 19:12:24.024573 29512 leader_election.cc:288] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:12:24.024658 29520 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:12:24.025451 29520 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [term 1 LEADER]: Becoming Leader. State: Replica: 4cafbefbc00f4a9db26e582141e6d80f, State: Running, Role: LEADER
I20260809 19:12:24.025979 29520 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cafbefbc00f4a9db26e582141e6d80f" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 42585 } }
I20260809 19:12:24.027117 29512 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:12:24.029173 29521 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4cafbefbc00f4a9db26e582141e6d80f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cafbefbc00f4a9db26e582141e6d80f" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 42585 } } }
I20260809 19:12:24.029543 29521 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [sys.catalog]: This master's current role is: LEADER
I20260809 19:12:24.029286 29523 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4cafbefbc00f4a9db26e582141e6d80f. Latest consensus state: current_term: 1 leader_uuid: "4cafbefbc00f4a9db26e582141e6d80f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cafbefbc00f4a9db26e582141e6d80f" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 42585 } } }
I20260809 19:12:24.030021 29523 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [sys.catalog]: This master's current role is: LEADER
I20260809 19:12:24.040990 29529 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:12:24.047164 29529 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:12:24.060428 29529 catalog_manager.cc:1347] Generated new cluster ID: 59b58d30c69b4209abb7d48fc6e3e821
I20260809 19:12:24.060537 29529 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:12:24.082258 29529 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:12:24.083480 29529 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:12:24.093705 29529 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f: Generated new TSK 0
I20260809 19:12:24.094487 29529 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.39.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
I20260809 19:12:24.167734 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.1:0
--local_ip_for_outbound_sockets=127.7.39.1
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:42585
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:32953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:12:24.497440 29552 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:12:24.497689 29552 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:12:24.497788 29552 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:12:24.504798 29552 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:12:24.504889 29552 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:12:24.505010 29552 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.1
I20260809 19:12:24.514227 29552 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:32953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:42585
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.1
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:12:24.515349 29552 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:12:24.516525 29552 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:12:24.528738 29560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:24.528769 29561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:24.528837 29566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:12:24.529754 29552 server_base.cc:1034] running on GCE node
I20260809 19:12:24.530359 29552 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:12:24.531193 29552 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:12:24.532378 29552 hybrid_clock.cc:648] HybridClock initialized: now 1786302744532338 us; error 34 us; skew 500 ppm
I20260809 19:12:24.532655 29552 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:12:24 dist-test-slave-4tdj krb5kdc[29381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302744, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:12:24.535557 29552 init.cc:377] Logged in from keytab as kudu/127.7.39.1@KRBTEST.COM (short username kudu)
I20260809 19:12:24.536883 29552 webserver.cc:460] Webserver started at http://127.7.39.1:33677/ using document root <none> and password file <none>
I20260809 19:12:24.537511 29552 fs_manager.cc:359] Metadata directory not provided
I20260809 19:12:24.537616 29552 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:12:24.537894 29552 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:12:24.540794 29552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/data/instance:
uuid: "ee9bb8e9c0824cc8937a25de0118a76c"
format_stamp: "Formatted at 2026-08-09 19:12:24 on dist-test-slave-4tdj"
server_key: "da540ae42911d9201eed7c254aeb5131"
server_key_iv: "c0f24b16e95e6baa27ca015284886dd6"
server_key_version: "encryptionkey@0"
I20260809 19:12:24.541507 29552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance:
uuid: "ee9bb8e9c0824cc8937a25de0118a76c"
format_stamp: "Formatted at 2026-08-09 19:12:24 on dist-test-slave-4tdj"
server_key: "da540ae42911d9201eed7c254aeb5131"
server_key_iv: "c0f24b16e95e6baa27ca015284886dd6"
server_key_version: "encryptionkey@0"
I20260809 19:12:24.546365 29552 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 19:12:24.549502 29581 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:24.550733 29552 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20260809 19:12:24.550879 29552 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/wal
uuid: "ee9bb8e9c0824cc8937a25de0118a76c"
format_stamp: "Formatted at 2026-08-09 19:12:24 on dist-test-slave-4tdj"
server_key: "da540ae42911d9201eed7c254aeb5131"
server_key_iv: "c0f24b16e95e6baa27ca015284886dd6"
server_key_version: "encryptionkey@0"
I20260809 19:12:24.551038 29552 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:12:24.570250 29552 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:12:24.573781 29552 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:12:24.573999 29552 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:12:24.574865 29552 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:12:24.576056 29552 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:12:24.576151 29552 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:24.576259 29552 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:12:24.576308 29552 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:24.605623 29552 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.1:40013
I20260809 19:12:24.605685 29764 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.1:40013 every 8 connection(s)
I20260809 19:12:24.606796 29552 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
I20260809 19:12:24.611281 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 29552
I20260809 19:12:24.611460 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance
I20260809 19:12:24.612082 7324 external_mini_cluster.cc:1428] Setting key f07e20ce033bf30a34c7560f60c17b1b
Aug 09 19:12:24 dist-test-slave-4tdj krb5kdc[29381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302744, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:12:24.624902 29772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:24.609127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:58793 (local address 127.7.39.62:42585)
0809 19:12:24.609506 (+ 379us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:24.609511 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:24.610481 (+ 970us) server_negotiation.cc:407] Connection header received
0809 19:12:24.612290 (+ 1809us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:24.612296 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:24.612380 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:24.612506 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:24.613842 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:24.614593 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:24.616076 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:24.616468 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:24.616577 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:24.619918 (+ 3341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:24.619922 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:24.619925 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:24.619958 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:24.622167 (+ 2209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:24.622854 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:24.622859 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:24.622861 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:24.622985 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:24.623441 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:24.623444 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:24.623446 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:24.623696 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:24.623806 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:24.624491 (+ 685us) server_negotiation.cc:299] Negotiation successful
0809 19:12:24.624657 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":189,"threads_started":1}
I20260809 19:12:24.625703 29773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:24.609629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.1:58793)
0809 19:12:24.610334 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:24.610378 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:24.612024 (+ 1646us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:24.612664 (+ 640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:24.612671 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:24.613150 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:12:24.613666 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:24.613693 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:24.614747 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:24.614751 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:24.615931 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:24.615943 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:24.616694 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:24.616702 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:24.616906 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:24.617493 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:12:24.617519 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:12:24.619722 (+ 2203us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:12:24.622316 (+ 2594us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:24.622325 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:24.622339 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:24.622731 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:24.623100 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:24.623104 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:24.623107 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:24.623348 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:24.623810 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:12:24.623817 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:12:24.624192 (+ 375us) client_negotiation.cc:769] Sending connection context
0809 19:12:24.624405 (+ 213us) client_negotiation.cc:240] Negotiation successful
0809 19:12:24.624740 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":264,"threads_started":1}
I20260809 19:12:24.627077 29768 heartbeater.cc:347] Connected to a master server at 127.7.39.62:42585
I20260809 19:12:24.627398 29768 heartbeater.cc:464] Registering TS with master...
I20260809 19:12:24.628268 29768 heartbeater.cc:511] Master 127.7.39.62:42585 requested a full tablet report, sending...
I20260809 19:12:24.630611 29454 ts_manager.cc:194] Registered new tserver with Master: ee9bb8e9c0824cc8937a25de0118a76c (127.7.39.1:40013)
I20260809 19:12:24.632459 29454 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.1@KRBTEST.COM'} at 127.7.39.1:58793
WARNING: no policy specified for kudu/127.7.39.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
I20260809 19:12:24.665302 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.2:0
--local_ip_for_outbound_sockets=127.7.39.2
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:42585
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:32953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:12:24.974020 29779 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:12:24.974267 29779 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:12:24.974399 29779 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:12:24.981230 29779 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:12:24.981319 29779 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:12:24.981453 29779 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.2
I20260809 19:12:24.990587 29779 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:32953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:42585
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.2
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:12:24.991711 29779 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:12:24.992937 29779 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:12:25.004913 29788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:25.004881 29791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:25.004952 29793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:12:25.005718 29779 server_base.cc:1034] running on GCE node
I20260809 19:12:25.006377 29779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:12:25.007226 29779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:12:25.008416 29779 hybrid_clock.cc:648] HybridClock initialized: now 1786302745008371 us; error 37 us; skew 500 ppm
I20260809 19:12:25.008708 29779 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:12:25 dist-test-slave-4tdj krb5kdc[29381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302745, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:12:25.011672 29779 init.cc:377] Logged in from keytab as kudu/127.7.39.2@KRBTEST.COM (short username kudu)
I20260809 19:12:25.013000 29779 webserver.cc:460] Webserver started at http://127.7.39.2:38387/ using document root <none> and password file <none>
I20260809 19:12:25.013613 29779 fs_manager.cc:359] Metadata directory not provided
I20260809 19:12:25.013707 29779 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:12:25.013945 29779 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:12:25.016705 29779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/data/instance:
uuid: "265511151d1b4ca5ab3b2e0a4e98cb54"
format_stamp: "Formatted at 2026-08-09 19:12:25 on dist-test-slave-4tdj"
server_key: "3b914c4b81671233a71c81f9b7fce572"
server_key_iv: "8fcfc7ba9d0c2eb6a37429178d89017b"
server_key_version: "encryptionkey@0"
I20260809 19:12:25.017373 29779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance:
uuid: "265511151d1b4ca5ab3b2e0a4e98cb54"
format_stamp: "Formatted at 2026-08-09 19:12:25 on dist-test-slave-4tdj"
server_key: "3b914c4b81671233a71c81f9b7fce572"
server_key_iv: "8fcfc7ba9d0c2eb6a37429178d89017b"
server_key_version: "encryptionkey@0"
I20260809 19:12:25.022552 29779 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 19:12:25.026477 29807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:25.027782 29779 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 19:12:25.027932 29779 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/wal
uuid: "265511151d1b4ca5ab3b2e0a4e98cb54"
format_stamp: "Formatted at 2026-08-09 19:12:25 on dist-test-slave-4tdj"
server_key: "3b914c4b81671233a71c81f9b7fce572"
server_key_iv: "8fcfc7ba9d0c2eb6a37429178d89017b"
server_key_version: "encryptionkey@0"
I20260809 19:12:25.028113 29779 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:12:25.052786 29779 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:12:25.056838 29779 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:12:25.057107 29779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:12:25.058039 29779 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:12:25.059403 29779 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:12:25.059484 29779 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:25.059603 29779 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:12:25.059657 29779 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:25.089395 29779 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.2:41131
I20260809 19:12:25.089452 29990 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.2:41131 every 8 connection(s)
I20260809 19:12:25.090674 29779 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
I20260809 19:12:25.093652 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 29779
I20260809 19:12:25.093861 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance
I20260809 19:12:25.094445 7324 external_mini_cluster.cc:1428] Setting key 11bb6661ab4d38198d36abd39dd6cf58
Aug 09 19:12:25 dist-test-slave-4tdj krb5kdc[29381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302745, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:12:25.110420 29772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:25.093098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:54455 (local address 127.7.39.62:42585)
0809 19:12:25.093275 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:25.093279 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:25.094640 (+ 1361us) server_negotiation.cc:407] Connection header received
0809 19:12:25.096557 (+ 1917us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:25.096562 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:25.096647 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:25.096739 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:25.098205 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.098951 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.100431 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.100860 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.100966 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:25.104414 (+ 3448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:25.104420 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:25.104425 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:25.104464 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:25.107212 (+ 2748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:25.108012 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:25.108016 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:25.108018 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:25.108159 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:25.108781 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:25.108785 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:25.108787 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:25.109055 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:25.109165 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:25.109945 (+ 780us) server_negotiation.cc:299] Negotiation successful
0809 19:12:25.110127 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 19:12:25.111690 29993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:25.093664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.2:54455)
0809 19:12:25.094483 (+ 819us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:25.094530 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:25.096313 (+ 1783us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:25.096971 (+ 658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:25.096979 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:25.097499 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:12:25.098034 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:25.098052 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.099093 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.099097 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:25.100293 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:25.100305 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.101067 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.101075 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:25.101301 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:25.101904 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:12:25.101925 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:12:25.104169 (+ 2244us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:12:25.107342 (+ 3173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:25.107351 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:25.107366 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:25.107915 (+ 549us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:25.108411 (+ 496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:25.108415 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:25.108418 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:25.108665 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:25.109180 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:12:25.109188 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:12:25.109555 (+ 367us) client_negotiation.cc:769] Sending connection context
0809 19:12:25.109876 (+ 321us) client_negotiation.cc:240] Negotiation successful
0809 19:12:25.110385 (+ 509us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":553,"thread_start_us":318,"threads_started":1}
I20260809 19:12:25.113010 29991 heartbeater.cc:347] Connected to a master server at 127.7.39.62:42585
I20260809 19:12:25.113318 29991 heartbeater.cc:464] Registering TS with master...
I20260809 19:12:25.114158 29991 heartbeater.cc:511] Master 127.7.39.62:42585 requested a full tablet report, sending...
I20260809 19:12:25.115757 29454 ts_manager.cc:194] Registered new tserver with Master: 265511151d1b4ca5ab3b2e0a4e98cb54 (127.7.39.2:41131)
I20260809 19:12:25.116626 29454 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.2@KRBTEST.COM'} at 127.7.39.2:54455
WARNING: no policy specified for kudu/127.7.39.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
I20260809 19:12:25.151410 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.3:0
--local_ip_for_outbound_sockets=127.7.39.3
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:42585
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:32953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:12:25.465204 29999 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:12:25.465466 29999 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:12:25.465595 29999 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:12:25.472383 29999 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:12:25.472486 29999 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:12:25.472635 29999 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.3
I20260809 19:12:25.481653 29999 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:32953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:42585
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.3
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:12:25.482759 29999 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:12:25.483952 29999 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:12:25.495832 30009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:25.495942 30008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:25.495838 30012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:12:25.496326 29999 server_base.cc:1034] running on GCE node
I20260809 19:12:25.496928 29999 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:12:25.497738 29999 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:12:25.498929 29999 hybrid_clock.cc:648] HybridClock initialized: now 1786302745498873 us; error 45 us; skew 500 ppm
I20260809 19:12:25.499233 29999 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:12:25 dist-test-slave-4tdj krb5kdc[29381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302745, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:12:25.502005 29999 init.cc:377] Logged in from keytab as kudu/127.7.39.3@KRBTEST.COM (short username kudu)
I20260809 19:12:25.503356 29999 webserver.cc:460] Webserver started at http://127.7.39.3:40621/ using document root <none> and password file <none>
I20260809 19:12:25.503954 29999 fs_manager.cc:359] Metadata directory not provided
I20260809 19:12:25.504069 29999 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:12:25.504346 29999 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:12:25.507095 29999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/data/instance:
uuid: "bcd9fcfcf5394392bd535606d932097b"
format_stamp: "Formatted at 2026-08-09 19:12:25 on dist-test-slave-4tdj"
server_key: "8641fd7861526374beb816fb90b1a8f3"
server_key_iv: "180ec943c6af84abafee0121d86e136c"
server_key_version: "encryptionkey@0"
I20260809 19:12:25.507808 29999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance:
uuid: "bcd9fcfcf5394392bd535606d932097b"
format_stamp: "Formatted at 2026-08-09 19:12:25 on dist-test-slave-4tdj"
server_key: "8641fd7861526374beb816fb90b1a8f3"
server_key_iv: "180ec943c6af84abafee0121d86e136c"
server_key_version: "encryptionkey@0"
I20260809 19:12:25.512614 29999 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 19:12:25.515744 30027 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:25.516927 29999 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 19:12:25.517069 29999 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/wal
uuid: "bcd9fcfcf5394392bd535606d932097b"
format_stamp: "Formatted at 2026-08-09 19:12:25 on dist-test-slave-4tdj"
server_key: "8641fd7861526374beb816fb90b1a8f3"
server_key_iv: "180ec943c6af84abafee0121d86e136c"
server_key_version: "encryptionkey@0"
I20260809 19:12:25.517246 29999 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:12:25.543628 29999 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:12:25.547016 29999 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:12:25.547266 29999 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:12:25.548070 29999 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:12:25.549259 29999 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:12:25.549335 29999 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:25.549448 29999 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:12:25.549502 29999 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:25.578572 29999 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.3:39983
I20260809 19:12:25.578636 30219 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.3:39983 every 8 connection(s)
I20260809 19:12:25.579741 29999 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
I20260809 19:12:25.581032 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 29999
I20260809 19:12:25.581209 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance
I20260809 19:12:25.581674 7324 external_mini_cluster.cc:1428] Setting key ac6bd7524b78495e94923cd1ba9b82d9
Aug 09 19:12:25 dist-test-slave-4tdj krb5kdc[29381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302745, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:12:25.597788 29772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:25.582104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:53557 (local address 127.7.39.62:42585)
0809 19:12:25.582323 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:25.582329 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:25.583499 (+ 1170us) server_negotiation.cc:407] Connection header received
0809 19:12:25.585362 (+ 1863us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:25.585366 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:25.585431 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:25.585513 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:25.586860 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.587599 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.588992 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.589375 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.589460 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:25.592447 (+ 2987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:25.592452 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:25.592455 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:25.592494 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:25.594903 (+ 2409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:25.595621 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:25.595626 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:25.595630 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:25.595799 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:25.596261 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:25.596265 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:25.596267 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:25.596624 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:25.596778 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:25.597385 (+ 607us) server_negotiation.cc:299] Negotiation successful
0809 19:12:25.597539 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 19:12:25.598598 30222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:25.582575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.3:53557)
0809 19:12:25.583339 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:25.583387 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:25.585109 (+ 1722us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:25.585666 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:25.585673 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:25.586137 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:12:25.586716 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:25.586733 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.587713 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.587717 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:25.588890 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:25.588902 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.589531 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.589535 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:25.589710 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:25.590231 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:12:25.590251 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:12:25.592270 (+ 2019us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:12:25.595014 (+ 2744us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:25.595019 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:25.595028 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:25.595498 (+ 470us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:25.595925 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:25.595929 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:25.595933 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:25.596137 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:25.596752 (+ 615us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:12:25.596758 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:12:25.597067 (+ 309us) client_negotiation.cc:769] Sending connection context
0809 19:12:25.597282 (+ 215us) client_negotiation.cc:240] Negotiation successful
0809 19:12:25.597601 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":371,"threads_started":1}
I20260809 19:12:25.599767 30220 heartbeater.cc:347] Connected to a master server at 127.7.39.62:42585
I20260809 19:12:25.600019 30220 heartbeater.cc:464] Registering TS with master...
I20260809 19:12:25.600664 30220 heartbeater.cc:511] Master 127.7.39.62:42585 requested a full tablet report, sending...
I20260809 19:12:25.601946 29454 ts_manager.cc:194] Registered new tserver with Master: bcd9fcfcf5394392bd535606d932097b (127.7.39.3:39983)
I20260809 19:12:25.602744 29454 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.3@KRBTEST.COM'} at 127.7.39.3:53557
I20260809 19:12:25.608757 7324 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 19:12:25.623747 29772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:25.612910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43496 (local address 127.7.39.62:42585)
0809 19:12:25.613080 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:25.613086 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:25.613490 (+ 404us) server_negotiation.cc:407] Connection header received
0809 19:12:25.613606 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:25.613611 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:25.613674 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:25.613749 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:25.615057 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.615713 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.616879 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.617239 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.617322 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:25.619369 (+ 2047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:25.619373 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:25.619376 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:25.619400 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:25.621680 (+ 2280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:25.622239 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:25.622242 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:25.622244 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:25.622381 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:25.622698 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:25.622701 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:25.622703 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:25.622969 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:25.623146 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:25.623354 (+ 208us) server_negotiation.cc:299] Negotiation successful
0809 19:12:25.623503 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 19:12:25.627197 29454 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43496:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:12:25.634785 29454 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:12:25.635665 29768 heartbeater.cc:503] Master 127.7.39.62:42585 was elected leader, sending a full tablet report...
I20260809 19:12:25.657068 30241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:25.646465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33160 (local address 127.7.39.2:41131)
0809 19:12:25.647311 (+ 846us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:25.647320 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:25.648043 (+ 723us) server_negotiation.cc:407] Connection header received
0809 19:12:25.648446 (+ 403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:25.648454 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:25.648702 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:25.648864 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:12:25.650648 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.651692 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.654762 (+ 3070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.655953 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.656067 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:25.656266 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:25.656604 (+ 338us) server_negotiation.cc:299] Negotiation successful
0809 19:12:25.656762 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":687,"thread_start_us":583,"threads_started":1}
I20260809 19:12:25.657151 30240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:25.646568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:39983 (local address 127.0.0.1:55740)
0809 19:12:25.648208 (+ 1640us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:25.648225 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:25.648323 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:25.649473 (+ 1150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:25.649480 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:25.649509 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:12:25.649965 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:25.649976 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.652076 (+ 2100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.652081 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:25.654500 (+ 2419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:25.654515 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.656218 (+ 1703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.656225 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:25.656420 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:25.656452 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 19:12:25.656516 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 19:12:25.656688 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1501,"mutex_wait_us":65,"thread_start_us":902,"threads_started":1}
I20260809 19:12:25.657725 30242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:25.646280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:41131 (local address 127.0.0.1:33160)
0809 19:12:25.647859 (+ 1579us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:25.647918 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:25.648208 (+ 290us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:25.649964 (+ 1756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:25.649968 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:25.649991 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:12:25.650435 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:25.650447 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.651815 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.651820 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:25.654633 (+ 2813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:25.654644 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.656162 (+ 1518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.656170 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:25.656359 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:25.656421 (+ 62us) client_negotiation.cc:769] Sending connection context
0809 19:12:25.656518 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 19:12:25.656696 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1296,"mutex_wait_us":117,"thread_start_us":1609,"threads_started":1}
I20260809 19:12:25.658123 30248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:25.648313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:40013 (local address 127.0.0.1:38978)
0809 19:12:25.649089 (+ 776us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:25.649105 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:25.649217 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:25.650257 (+ 1040us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:25.650261 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:25.650307 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:12:25.650724 (+ 417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:25.650737 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.652406 (+ 1669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.652410 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:25.654320 (+ 1910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:25.654335 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.657363 (+ 3028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.657372 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:25.657530 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:25.657563 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 19:12:25.657649 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 19:12:25.657785 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":659,"mutex_wait_us":1,"thread_start_us":696,"threads_started":1}
I20260809 19:12:25.658159 30250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:25.648858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38978 (local address 127.7.39.1:40013)
0809 19:12:25.649763 (+ 905us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:25.649770 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:25.649796 (+ 26us) server_negotiation.cc:407] Connection header received
0809 19:12:25.649883 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:25.649890 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:25.650083 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:25.650242 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:12:25.650907 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.652274 (+ 1367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.654495 (+ 2221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.655964 (+ 1469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.656223 (+ 259us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:25.656441 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:25.657722 (+ 1281us) server_negotiation.cc:299] Negotiation successful
0809 19:12:25.657872 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":762,"thread_start_us":602,"threads_started":1}
I20260809 19:12:25.658919 30247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:25.647153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55740 (local address 127.7.39.3:39983)
0809 19:12:25.648880 (+ 1727us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:25.648887 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:25.648918 (+ 31us) server_negotiation.cc:407] Connection header received
0809 19:12:25.649008 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:25.649014 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:25.649243 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:25.650159 (+ 916us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:12:25.650449 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.651945 (+ 1496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.654661 (+ 2716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.655964 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.658373 (+ 2409us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:25.658539 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:25.658587 (+ 48us) server_negotiation.cc:299] Negotiation successful
0809 19:12:25.658700 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1559,"thread_start_us":1404,"threads_started":1}
I20260809 19:12:25.661422 29659 tablet_service.cc:1467] Processing CreateTablet for tablet 95716ab4e92c4538b3a66a80da53c507 (DEFAULT_TABLE table=test-table [id=83ddf52f604b43afa20930e617e66eb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:12:25.661608 29885 tablet_service.cc:1467] Processing CreateTablet for tablet 95716ab4e92c4538b3a66a80da53c507 (DEFAULT_TABLE table=test-table [id=83ddf52f604b43afa20930e617e66eb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:12:25.662164 30110 tablet_service.cc:1467] Processing CreateTablet for tablet 95716ab4e92c4538b3a66a80da53c507 (DEFAULT_TABLE table=test-table [id=83ddf52f604b43afa20930e617e66eb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:12:25.662923 29659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95716ab4e92c4538b3a66a80da53c507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:12:25.662966 29885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95716ab4e92c4538b3a66a80da53c507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:12:25.663441 30110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95716ab4e92c4538b3a66a80da53c507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:12:25.673359 30253 tablet_bootstrap.cc:492] T 95716ab4e92c4538b3a66a80da53c507 P ee9bb8e9c0824cc8937a25de0118a76c: Bootstrap starting.
I20260809 19:12:25.676970 30255 tablet_bootstrap.cc:492] T 95716ab4e92c4538b3a66a80da53c507 P 265511151d1b4ca5ab3b2e0a4e98cb54: Bootstrap starting.
I20260809 19:12:25.677004 30253 tablet_bootstrap.cc:654] T 95716ab4e92c4538b3a66a80da53c507 P ee9bb8e9c0824cc8937a25de0118a76c: Neither blocks nor log segments found. Creating new log.
I20260809 19:12:25.678900 30253 log.cc:824] T 95716ab4e92c4538b3a66a80da53c507 P ee9bb8e9c0824cc8937a25de0118a76c: Log is configured to *not* fsync() on all Append() calls
I20260809 19:12:25.678977 30256 tablet_bootstrap.cc:492] T 95716ab4e92c4538b3a66a80da53c507 P bcd9fcfcf5394392bd535606d932097b: Bootstrap starting.
I20260809 19:12:25.680315 30255 tablet_bootstrap.cc:654] T 95716ab4e92c4538b3a66a80da53c507 P 265511151d1b4ca5ab3b2e0a4e98cb54: Neither blocks nor log segments found. Creating new log.
I20260809 19:12:25.681418 30255 log.cc:824] T 95716ab4e92c4538b3a66a80da53c507 P 265511151d1b4ca5ab3b2e0a4e98cb54: Log is configured to *not* fsync() on all Append() calls
I20260809 19:12:25.681818 30256 tablet_bootstrap.cc:654] T 95716ab4e92c4538b3a66a80da53c507 P bcd9fcfcf5394392bd535606d932097b: Neither blocks nor log segments found. Creating new log.
I20260809 19:12:25.682492 30253 tablet_bootstrap.cc:492] T 95716ab4e92c4538b3a66a80da53c507 P ee9bb8e9c0824cc8937a25de0118a76c: No bootstrap required, opened a new log
I20260809 19:12:25.682723 30253 ts_tablet_manager.cc:1397] T 95716ab4e92c4538b3a66a80da53c507 P ee9bb8e9c0824cc8937a25de0118a76c: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260809 19:12:25.682981 30256 log.cc:824] T 95716ab4e92c4538b3a66a80da53c507 P bcd9fcfcf5394392bd535606d932097b: Log is configured to *not* fsync() on all Append() calls
I20260809 19:12:25.684963 30255 tablet_bootstrap.cc:492] T 95716ab4e92c4538b3a66a80da53c507 P 265511151d1b4ca5ab3b2e0a4e98cb54: No bootstrap required, opened a new log
I20260809 19:12:25.685226 30255 ts_tablet_manager.cc:1397] T 95716ab4e92c4538b3a66a80da53c507 P 265511151d1b4ca5ab3b2e0a4e98cb54: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260809 19:12:25.685392 30256 tablet_bootstrap.cc:492] T 95716ab4e92c4538b3a66a80da53c507 P bcd9fcfcf5394392bd535606d932097b: No bootstrap required, opened a new log
I20260809 19:12:25.685613 30256 ts_tablet_manager.cc:1397] T 95716ab4e92c4538b3a66a80da53c507 P bcd9fcfcf5394392bd535606d932097b: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260809 19:12:25.692618 30256 raft_consensus.cc:348] T 95716ab4e92c4538b3a66a80da53c507 P bcd9fcfcf5394392bd535606d932097b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "265511151d1b4ca5ab3b2e0a4e98cb54" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 41131 } } peers { permanent_uuid: "bcd9fcfcf5394392bd535606d932097b" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 39983 } } peers { permanent_uuid: "ee9bb8e9c0824cc8937a25de0118a76c" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 40013 } }
I20260809 19:12:25.692948 30256 raft_consensus.cc:374] T 95716ab4e92c4538b3a66a80da53c507 P bcd9fcfcf5394392bd535606d932097b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:12:25.693044 30256 raft_consensus.cc:729] T 95716ab4e92c4538b3a66a80da53c507 P bcd9fcfcf5394392bd535606d932097b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcd9fcfcf5394392bd535606d932097b, State: Initialized, Role: FOLLOWER
I20260809 19:12:25.693109 30253 raft_consensus.cc:348] T 95716ab4e92c4538b3a66a80da53c507 P ee9bb8e9c0824cc8937a25de0118a76c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "265511151d1b4ca5ab3b2e0a4e98cb54" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 41131 } } peers { permanent_uuid: "bcd9fcfcf5394392bd535606d932097b" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 39983 } } peers { permanent_uuid: "ee9bb8e9c0824cc8937a25de0118a76c" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 40013 } }
I20260809 19:12:25.693524 30253 raft_consensus.cc:374] T 95716ab4e92c4538b3a66a80da53c507 P ee9bb8e9c0824cc8937a25de0118a76c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:12:25.693619 30253 raft_consensus.cc:729] T 95716ab4e92c4538b3a66a80da53c507 P ee9bb8e9c0824cc8937a25de0118a76c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9bb8e9c0824cc8937a25de0118a76c, State: Initialized, Role: FOLLOWER
I20260809 19:12:25.693812 30256 consensus_queue.cc:260] T 95716ab4e92c4538b3a66a80da53c507 P bcd9fcfcf5394392bd535606d932097b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "265511151d1b4ca5ab3b2e0a4e98cb54" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 41131 } } peers { permanent_uuid: "bcd9fcfcf5394392bd535606d932097b" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 39983 } } peers { permanent_uuid: "ee9bb8e9c0824cc8937a25de0118a76c" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 40013 } }
I20260809 19:12:25.694188 30253 consensus_queue.cc:260] T 95716ab4e92c4538b3a66a80da53c507 P ee9bb8e9c0824cc8937a25de0118a76c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "265511151d1b4ca5ab3b2e0a4e98cb54" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 41131 } } peers { permanent_uuid: "bcd9fcfcf5394392bd535606d932097b" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 39983 } } peers { permanent_uuid: "ee9bb8e9c0824cc8937a25de0118a76c" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 40013 } }
I20260809 19:12:25.695163 30220 heartbeater.cc:503] Master 127.7.39.62:42585 was elected leader, sending a full tablet report...
I20260809 19:12:25.695636 30256 ts_tablet_manager.cc:1428] T 95716ab4e92c4538b3a66a80da53c507 P bcd9fcfcf5394392bd535606d932097b: Time spent starting tablet: real 0.010s user 0.005s sys 0.005s
I20260809 19:12:25.695595 30255 raft_consensus.cc:348] T 95716ab4e92c4538b3a66a80da53c507 P 265511151d1b4ca5ab3b2e0a4e98cb54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "265511151d1b4ca5ab3b2e0a4e98cb54" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 41131 } } peers { permanent_uuid: "bcd9fcfcf5394392bd535606d932097b" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 39983 } } peers { permanent_uuid: "ee9bb8e9c0824cc8937a25de0118a76c" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 40013 } }
I20260809 19:12:25.695992 30255 raft_consensus.cc:374] T 95716ab4e92c4538b3a66a80da53c507 P 265511151d1b4ca5ab3b2e0a4e98cb54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:12:25.696089 30255 raft_consensus.cc:729] T 95716ab4e92c4538b3a66a80da53c507 P 265511151d1b4ca5ab3b2e0a4e98cb54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 265511151d1b4ca5ab3b2e0a4e98cb54, State: Initialized, Role: FOLLOWER
I20260809 19:12:25.696678 30255 consensus_queue.cc:260] T 95716ab4e92c4538b3a66a80da53c507 P 265511151d1b4ca5ab3b2e0a4e98cb54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "265511151d1b4ca5ab3b2e0a4e98cb54" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 41131 } } peers { permanent_uuid: "bcd9fcfcf5394392bd535606d932097b" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 39983 } } peers { permanent_uuid: "ee9bb8e9c0824cc8937a25de0118a76c" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 40013 } }
I20260809 19:12:25.700652 30253 ts_tablet_manager.cc:1428] T 95716ab4e92c4538b3a66a80da53c507 P ee9bb8e9c0824cc8937a25de0118a76c: Time spent starting tablet: real 0.018s user 0.009s sys 0.007s
I20260809 19:12:25.701700 29991 heartbeater.cc:503] Master 127.7.39.62:42585 was elected leader, sending a full tablet report...
I20260809 19:12:25.702399 30255 ts_tablet_manager.cc:1428] T 95716ab4e92c4538b3a66a80da53c507 P 265511151d1b4ca5ab3b2e0a4e98cb54: Time spent starting tablet: real 0.017s user 0.015s sys 0.001s
I20260809 19:12:25.718411 30264 raft_consensus.cc:482] T 95716ab4e92c4538b3a66a80da53c507 P ee9bb8e9c0824cc8937a25de0118a76c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:12:25.718652 30264 raft_consensus.cc:504] T 95716ab4e92c4538b3a66a80da53c507 P ee9bb8e9c0824cc8937a25de0118a76c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "265511151d1b4ca5ab3b2e0a4e98cb54" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 41131 } } peers { permanent_uuid: "bcd9fcfcf5394392bd535606d932097b" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 39983 } } peers { permanent_uuid: "ee9bb8e9c0824cc8937a25de0118a76c" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 40013 } }
I20260809 19:12:25.720206 30264 leader_election.cc:288] T 95716ab4e92c4538b3a66a80da53c507 P ee9bb8e9c0824cc8937a25de0118a76c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 265511151d1b4ca5ab3b2e0a4e98cb54 (127.7.39.2:41131), bcd9fcfcf5394392bd535606d932097b (127.7.39.3:39983)
I20260809 19:12:25.727982 30247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:25.720689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:34007 (local address 127.7.39.3:39983)
0809 19:12:25.720883 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:25.720889 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:25.721595 (+ 706us) server_negotiation.cc:407] Connection header received
0809 19:12:25.721831 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:25.721836 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:25.721913 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:25.721973 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:12:25.722852 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.723594 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.725962 (+ 2368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.727173 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.727312 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:25.727411 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:25.727622 (+ 211us) server_negotiation.cc:299] Negotiation successful
0809 19:12:25.727747 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 19:12:25.728006 30266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:25.720646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:39983 (local address 127.7.39.1:34007)
0809 19:12:25.721494 (+ 848us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:25.721512 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:25.721645 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:25.722172 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:25.722176 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:25.722218 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:12:25.722696 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:25.722709 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.723739 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.723744 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:25.725812 (+ 2068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:25.725827 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.727360 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.727365 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:25.727474 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:25.727503 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 19:12:25.727581 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 19:12:25.727669 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":718,"mutex_wait_us":24,"thread_start_us":417,"threads_started":1}
I20260809 19:12:25.728319 30241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:25.720471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:41001 (local address 127.7.39.2:41131)
0809 19:12:25.720697 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:25.720703 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:25.721494 (+ 791us) server_negotiation.cc:407] Connection header received
0809 19:12:25.721721 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:25.721726 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:25.721799 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:25.721881 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:12:25.722691 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.723392 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.725978 (+ 2586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.727173 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.727312 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:25.727404 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:25.727904 (+ 500us) server_negotiation.cc:299] Negotiation successful
0809 19:12:25.728047 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 19:12:25.728788 30268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:25.720336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:41131 (local address 127.7.39.1:41001)
0809 19:12:25.721395 (+ 1059us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:25.721412 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:25.721545 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:25.722034 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:25.722038 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:25.722084 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:12:25.722504 (+ 420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:25.722518 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.723514 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.723519 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:25.725816 (+ 2297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:25.725827 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.727546 (+ 1719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.727551 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:25.727734 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:25.727768 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 19:12:25.727860 (+ 92us) client_negotiation.cc:240] Negotiation successful
0809 19:12:25.727981 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":926,"mutex_wait_us":50,"spinlock_wait_cycles":15232,"thread_start_us":759,"threads_started":1}
I20260809 19:12:25.729012 30145 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95716ab4e92c4538b3a66a80da53c507" candidate_uuid: "ee9bb8e9c0824cc8937a25de0118a76c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcd9fcfcf5394392bd535606d932097b" is_pre_election: true
I20260809 19:12:25.729462 30145 raft_consensus.cc:2454] T 95716ab4e92c4538b3a66a80da53c507 P bcd9fcfcf5394392bd535606d932097b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9bb8e9c0824cc8937a25de0118a76c in term 0.
I20260809 19:12:25.729566 29917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95716ab4e92c4538b3a66a80da53c507" candidate_uuid: "ee9bb8e9c0824cc8937a25de0118a76c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "265511151d1b4ca5ab3b2e0a4e98cb54" is_pre_election: true
I20260809 19:12:25.730031 29917 raft_consensus.cc:2454] T 95716ab4e92c4538b3a66a80da53c507 P 265511151d1b4ca5ab3b2e0a4e98cb54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9bb8e9c0824cc8937a25de0118a76c in term 0.
I20260809 19:12:25.730050 29583 leader_election.cc:302] T 95716ab4e92c4538b3a66a80da53c507 P ee9bb8e9c0824cc8937a25de0118a76c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bcd9fcfcf5394392bd535606d932097b, ee9bb8e9c0824cc8937a25de0118a76c; no voters:
I20260809 19:12:25.730399 30264 raft_consensus.cc:2781] T 95716ab4e92c4538b3a66a80da53c507 P ee9bb8e9c0824cc8937a25de0118a76c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:12:25.730526 30264 raft_consensus.cc:482] T 95716ab4e92c4538b3a66a80da53c507 P ee9bb8e9c0824cc8937a25de0118a76c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:12:25.730629 30264 raft_consensus.cc:3037] T 95716ab4e92c4538b3a66a80da53c507 P ee9bb8e9c0824cc8937a25de0118a76c [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:12:25.732836 30264 raft_consensus.cc:504] T 95716ab4e92c4538b3a66a80da53c507 P ee9bb8e9c0824cc8937a25de0118a76c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "265511151d1b4ca5ab3b2e0a4e98cb54" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 41131 } } peers { permanent_uuid: "bcd9fcfcf5394392bd535606d932097b" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 39983 } } peers { permanent_uuid: "ee9bb8e9c0824cc8937a25de0118a76c" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 40013 } }
I20260809 19:12:25.733367 30264 leader_election.cc:288] T 95716ab4e92c4538b3a66a80da53c507 P ee9bb8e9c0824cc8937a25de0118a76c [CANDIDATE]: Term 1 election: Requested vote from peers 265511151d1b4ca5ab3b2e0a4e98cb54 (127.7.39.2:41131), bcd9fcfcf5394392bd535606d932097b (127.7.39.3:39983)
I20260809 19:12:25.733723 29917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95716ab4e92c4538b3a66a80da53c507" candidate_uuid: "ee9bb8e9c0824cc8937a25de0118a76c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "265511151d1b4ca5ab3b2e0a4e98cb54"
I20260809 19:12:25.733803 30145 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95716ab4e92c4538b3a66a80da53c507" candidate_uuid: "ee9bb8e9c0824cc8937a25de0118a76c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcd9fcfcf5394392bd535606d932097b"
I20260809 19:12:25.733887 29917 raft_consensus.cc:3037] T 95716ab4e92c4538b3a66a80da53c507 P 265511151d1b4ca5ab3b2e0a4e98cb54 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:12:25.733978 30145 raft_consensus.cc:3037] T 95716ab4e92c4538b3a66a80da53c507 P bcd9fcfcf5394392bd535606d932097b [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:12:25.736050 29917 raft_consensus.cc:2454] T 95716ab4e92c4538b3a66a80da53c507 P 265511151d1b4ca5ab3b2e0a4e98cb54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9bb8e9c0824cc8937a25de0118a76c in term 1.
I20260809 19:12:25.736097 30145 raft_consensus.cc:2454] T 95716ab4e92c4538b3a66a80da53c507 P bcd9fcfcf5394392bd535606d932097b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9bb8e9c0824cc8937a25de0118a76c in term 1.
I20260809 19:12:25.736411 29585 leader_election.cc:302] T 95716ab4e92c4538b3a66a80da53c507 P ee9bb8e9c0824cc8937a25de0118a76c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 265511151d1b4ca5ab3b2e0a4e98cb54, ee9bb8e9c0824cc8937a25de0118a76c; no voters:
I20260809 19:12:25.736707 30264 raft_consensus.cc:2781] T 95716ab4e92c4538b3a66a80da53c507 P ee9bb8e9c0824cc8937a25de0118a76c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:12:25.737128 30264 raft_consensus.cc:686] T 95716ab4e92c4538b3a66a80da53c507 P ee9bb8e9c0824cc8937a25de0118a76c [term 1 LEADER]: Becoming Leader. State: Replica: ee9bb8e9c0824cc8937a25de0118a76c, State: Running, Role: LEADER
I20260809 19:12:25.737555 30264 consensus_queue.cc:237] T 95716ab4e92c4538b3a66a80da53c507 P ee9bb8e9c0824cc8937a25de0118a76c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "265511151d1b4ca5ab3b2e0a4e98cb54" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 41131 } } peers { permanent_uuid: "bcd9fcfcf5394392bd535606d932097b" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 39983 } } peers { permanent_uuid: "ee9bb8e9c0824cc8937a25de0118a76c" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 40013 } }
I20260809 19:12:25.742081 29452 catalog_manager.cc:5495] T 95716ab4e92c4538b3a66a80da53c507 P ee9bb8e9c0824cc8937a25de0118a76c reported cstate change: term changed from 0 to 1, leader changed from <none> to ee9bb8e9c0824cc8937a25de0118a76c (127.7.39.1). New cstate: current_term: 1 leader_uuid: "ee9bb8e9c0824cc8937a25de0118a76c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "265511151d1b4ca5ab3b2e0a4e98cb54" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 41131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcd9fcfcf5394392bd535606d932097b" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 39983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9bb8e9c0824cc8937a25de0118a76c" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 40013 } health_report { overall_health: HEALTHY } } }
I20260809 19:12:25.776672 30250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:25.771966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38990 (local address 127.7.39.1:40013)
0809 19:12:25.772178 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:25.772184 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:25.772203 (+ 19us) server_negotiation.cc:407] Connection header received
0809 19:12:25.772397 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:25.772401 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:25.772478 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:25.772595 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:12:25.772888 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.773561 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.774878 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.775277 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.775366 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:25.775776 (+ 410us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:12:25.776227 (+ 451us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:12:25.776330 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:25.776369 (+ 39us) server_negotiation.cc:299] Negotiation successful
0809 19:12:25.776429 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 19:12:25.784116 30145 raft_consensus.cc:1261] T 95716ab4e92c4538b3a66a80da53c507 P bcd9fcfcf5394392bd535606d932097b [term 1 FOLLOWER]: Refusing update from remote peer ee9bb8e9c0824cc8937a25de0118a76c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:12:25.784125 29917 raft_consensus.cc:1261] T 95716ab4e92c4538b3a66a80da53c507 P 265511151d1b4ca5ab3b2e0a4e98cb54 [term 1 FOLLOWER]: Refusing update from remote peer ee9bb8e9c0824cc8937a25de0118a76c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:12:25.784996 30264 consensus_queue.cc:1035] T 95716ab4e92c4538b3a66a80da53c507 P ee9bb8e9c0824cc8937a25de0118a76c [LEADER]: Connected to new peer: Peer: permanent_uuid: "265511151d1b4ca5ab3b2e0a4e98cb54" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 41131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:12:25.785283 30269 consensus_queue.cc:1035] T 95716ab4e92c4538b3a66a80da53c507 P ee9bb8e9c0824cc8937a25de0118a76c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcd9fcfcf5394392bd535606d932097b" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 39983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:12:25.795282 30272 mvcc.cc:205] Tried to move back new op lower bound from 7316696046723031040 to 7316696046544703488. Current Snapshot: MvccSnapshot[applied={T|T < 7316696046723031040}]
I20260809 19:12:25.815440 29454 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43496:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:12:25.815745 29454 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43496:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:12:25.819384 29454 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f: Sending DeleteTablet for 3 replicas of tablet 95716ab4e92c4538b3a66a80da53c507
I20260809 19:12:25.820379 30110 tablet_service.cc:1514] Processing DeleteTablet for tablet 95716ab4e92c4538b3a66a80da53c507 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:12:25 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:55740
I20260809 19:12:25.820852 29885 tablet_service.cc:1514] Processing DeleteTablet for tablet 95716ab4e92c4538b3a66a80da53c507 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:12:25 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:33160
I20260809 19:12:25.821184 29659 tablet_service.cc:1514] Processing DeleteTablet for tablet 95716ab4e92c4538b3a66a80da53c507 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:12:25 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:38978
I20260809 19:12:25.822012 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 29552
I20260809 19:12:25.831710 30296 tablet_replica.cc:330] T 95716ab4e92c4538b3a66a80da53c507 P 265511151d1b4ca5ab3b2e0a4e98cb54: stopping tablet replica
I20260809 19:12:25.832250 30297 tablet_replica.cc:330] T 95716ab4e92c4538b3a66a80da53c507 P ee9bb8e9c0824cc8937a25de0118a76c: stopping tablet replica
I20260809 19:12:25.832818 30297 raft_consensus.cc:2229] T 95716ab4e92c4538b3a66a80da53c507 P ee9bb8e9c0824cc8937a25de0118a76c [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:12:25.833328 30296 raft_consensus.cc:2229] T 95716ab4e92c4538b3a66a80da53c507 P 265511151d1b4ca5ab3b2e0a4e98cb54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:12:25.834120 30297 raft_consensus.cc:2258] T 95716ab4e92c4538b3a66a80da53c507 P ee9bb8e9c0824cc8937a25de0118a76c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:12:25.834683 30296 raft_consensus.cc:2258] T 95716ab4e92c4538b3a66a80da53c507 P 265511151d1b4ca5ab3b2e0a4e98cb54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:12:25.835638 30295 tablet_replica.cc:330] T 95716ab4e92c4538b3a66a80da53c507 P bcd9fcfcf5394392bd535606d932097b: stopping tablet replica
I20260809 19:12:25.835989 30295 raft_consensus.cc:2229] T 95716ab4e92c4538b3a66a80da53c507 P bcd9fcfcf5394392bd535606d932097b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:12:25.836875 30295 raft_consensus.cc:2258] T 95716ab4e92c4538b3a66a80da53c507 P bcd9fcfcf5394392bd535606d932097b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:12:25.838212 30297 ts_tablet_manager.cc:1905] T 95716ab4e92c4538b3a66a80da53c507 P ee9bb8e9c0824cc8937a25de0118a76c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:12:25.838546 30296 ts_tablet_manager.cc:1905] T 95716ab4e92c4538b3a66a80da53c507 P 265511151d1b4ca5ab3b2e0a4e98cb54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:12:25.838697 30295 ts_tablet_manager.cc:1905] T 95716ab4e92c4538b3a66a80da53c507 P bcd9fcfcf5394392bd535606d932097b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:12:25.845395 30295 ts_tablet_manager.cc:1918] T 95716ab4e92c4538b3a66a80da53c507 P bcd9fcfcf5394392bd535606d932097b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:12:25.845562 30295 log.cc:1196] T 95716ab4e92c4538b3a66a80da53c507 P bcd9fcfcf5394392bd535606d932097b: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/wal/wals/95716ab4e92c4538b3a66a80da53c507
I20260809 19:12:25.846052 30295 ts_tablet_manager.cc:1939] T 95716ab4e92c4538b3a66a80da53c507 P bcd9fcfcf5394392bd535606d932097b: Deleting consensus metadata
I20260809 19:12:25.847791 29425 catalog_manager.cc:4841] TS bcd9fcfcf5394392bd535606d932097b (127.7.39.3:39983): tablet 95716ab4e92c4538b3a66a80da53c507 (table test-table [id=83ddf52f604b43afa20930e617e66eb8]) successfully deleted
I20260809 19:12:25.849936 30297 ts_tablet_manager.cc:1918] T 95716ab4e92c4538b3a66a80da53c507 P ee9bb8e9c0824cc8937a25de0118a76c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:12:25.850090 30297 log.cc:1196] T 95716ab4e92c4538b3a66a80da53c507 P ee9bb8e9c0824cc8937a25de0118a76c: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/wal/wals/95716ab4e92c4538b3a66a80da53c507
I20260809 19:12:25.850567 30297 ts_tablet_manager.cc:1939] T 95716ab4e92c4538b3a66a80da53c507 P ee9bb8e9c0824cc8937a25de0118a76c: Deleting consensus metadata
Aug 09 19:12:25 dist-test-slave-4tdj krb5kdc[29381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302743, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.1@KRBTEST.COM
I20260809 19:12:25.852100 29425 catalog_manager.cc:4841] TS ee9bb8e9c0824cc8937a25de0118a76c (127.7.39.1:40013): tablet 95716ab4e92c4538b3a66a80da53c507 (table test-table [id=83ddf52f604b43afa20930e617e66eb8]) successfully deleted
I20260809 19:12:25.853581 30296 ts_tablet_manager.cc:1918] T 95716ab4e92c4538b3a66a80da53c507 P 265511151d1b4ca5ab3b2e0a4e98cb54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:12:25.853720 30296 log.cc:1196] T 95716ab4e92c4538b3a66a80da53c507 P 265511151d1b4ca5ab3b2e0a4e98cb54: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/wal/wals/95716ab4e92c4538b3a66a80da53c507
I20260809 19:12:25.854198 30296 ts_tablet_manager.cc:1939] T 95716ab4e92c4538b3a66a80da53c507 P 265511151d1b4ca5ab3b2e0a4e98cb54: Deleting consensus metadata
I20260809 19:12:25.855747 29431 catalog_manager.cc:4841] TS 265511151d1b4ca5ab3b2e0a4e98cb54 (127.7.39.2:41131): tablet 95716ab4e92c4538b3a66a80da53c507 (table test-table [id=83ddf52f604b43afa20930e617e66eb8]) successfully deleted
I20260809 19:12:25.859901 30250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:25.824118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39002 (local address 127.7.39.1:40013)
0809 19:12:25.824298 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:25.824304 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:25.840895 (+ 16591us) server_negotiation.cc:407] Connection header received
0809 19:12:25.841315 (+ 420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:25.841321 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:25.841399 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:25.841475 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:25.843419 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.844636 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.846620 (+ 1984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.847356 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.847459 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:25.852933 (+ 5474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:25.852947 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:25.852965 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:25.853015 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:25.857099 (+ 4084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:25.857753 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:25.857762 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:25.857766 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:25.857935 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:25.858276 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:25.858281 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:25.858285 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:25.858783 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:25.859065 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:25.859294 (+ 229us) server_negotiation.cc:299] Negotiation successful
0809 19:12:25.859519 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 19:12:25.860598 29760 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:12:25.956426 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 29552
I20260809 19:12:25.979691 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 29779
Aug 09 19:12:25 dist-test-slave-4tdj krb5kdc[29381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302743, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.2@KRBTEST.COM
I20260809 19:12:25.994627 30241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:25.980605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33172 (local address 127.7.39.2:41131)
0809 19:12:25.980820 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:25.980827 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:25.980847 (+ 20us) server_negotiation.cc:407] Connection header received
0809 19:12:25.980910 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:25.980914 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:25.980977 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:25.981063 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:25.982388 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.983127 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.984384 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:25.984781 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:25.984893 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:25.989143 (+ 4250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:25.989157 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:25.989172 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:25.989209 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:25.991961 (+ 2752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:25.992603 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:25.992611 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:25.992613 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:25.992741 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:25.993117 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:25.993121 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:25.993123 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:25.993490 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:25.993775 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:25.994085 (+ 310us) server_negotiation.cc:299] Negotiation successful
0809 19:12:25.994288 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 19:12:25.995321 29981 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:12:26.080770 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 29779
I20260809 19:12:26.103123 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 29999
Aug 09 19:12:26 dist-test-slave-4tdj krb5kdc[29381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302743, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.3@KRBTEST.COM
I20260809 19:12:26.120380 30247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:26.103850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55744 (local address 127.7.39.3:39983)
0809 19:12:26.104032 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:26.104038 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:26.104142 (+ 104us) server_negotiation.cc:407] Connection header received
0809 19:12:26.104327 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:26.104332 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:26.104427 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:26.104522 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:26.105803 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:26.106604 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:26.107871 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:26.108261 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:26.108371 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:26.113191 (+ 4820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:26.113210 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:26.113233 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:26.113273 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:26.116724 (+ 3451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:26.117545 (+ 821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:26.117555 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:26.117559 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:26.117711 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:26.118135 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:26.118140 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:26.118143 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:26.118716 (+ 573us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:26.118979 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:26.119798 (+ 819us) server_negotiation.cc:299] Negotiation successful
0809 19:12:26.120035 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 19:12:26.121094 30206 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:12:26.214811 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 29999
I20260809 19:12:26.236871 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 29401
I20260809 19:12:26.238015 29499 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:12:26.346212 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 29401
I20260809 19:12:26.375319 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:42585
--webserver_interface=127.7.39.62
--webserver_port=39657
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:32953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:42585
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:12:26.691447 30307 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:12:26.691728 30307 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:12:26.691859 30307 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:12:26.698941 30307 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:12:26.699045 30307 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:12:26.699119 30307 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:12:26.699193 30307 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:12:26.699249 30307 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:12:26.708555 30307 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:32953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:42585
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:42585
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=39657
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:12:26.709710 30307 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:12:26.711087 30307 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:12:26.735599 30322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:26.735565 30319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:26.735565 30317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:12:26.736378 30307 server_base.cc:1034] running on GCE node
I20260809 19:12:26.737248 30307 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:12:26.738837 30307 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:12:26.740031 30307 hybrid_clock.cc:648] HybridClock initialized: now 1786302746739977 us; error 45 us; skew 500 ppm
I20260809 19:12:26.740408 30307 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:12:26 dist-test-slave-4tdj krb5kdc[29381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302746, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:12:26.743850 30307 init.cc:377] Logged in from keytab as kudu/127.7.39.62@KRBTEST.COM (short username kudu)
I20260809 19:12:26.745445 30307 webserver.cc:460] Webserver started at http://127.7.39.62:39657/ using document root <none> and password file <none>
I20260809 19:12:26.746169 30307 fs_manager.cc:359] Metadata directory not provided
I20260809 19:12:26.746317 30307 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:12:26.751935 30307 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260809 19:12:26.754709 30334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:26.755997 30307 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 19:12:26.756162 30307 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "4cafbefbc00f4a9db26e582141e6d80f"
format_stamp: "Formatted at 2026-08-09 19:12:23 on dist-test-slave-4tdj"
server_key: "4c5a5b5ad5a63fce8ff69382efd2b93c"
server_key_iv: "bc3d3c3af70f879eab5fd2f429eae3c7"
server_key_version: "encryptionkey@0"
I20260809 19:12:26.757230 30307 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:12:26.788379 30307 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:12:26.792546 30307 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:12:26.792807 30307 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:12:26.810976 30307 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:42585
I20260809 19:12:26.811000 30423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:42585 every 8 connection(s)
I20260809 19:12:26.812454 30307 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:12:26.816916 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 30307
I20260809 19:12:26.817924 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.1:40013
--local_ip_for_outbound_sockets=127.7.39.1
--tserver_master_addrs=127.7.39.62:42585
--webserver_port=33677
--webserver_interface=127.7.39.1
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:32953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 19:12:26.820439 30424 sys_catalog.cc:263] Verifying existing consensus state
I20260809 19:12:26.824844 30424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f: Bootstrap starting.
I20260809 19:12:26.844841 30424 log.cc:824] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f: Log is configured to *not* fsync() on all Append() calls
I20260809 19:12:26.856827 30424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 19:12:26.857338 30424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f: Bootstrap complete.
I20260809 19:12:26.866534 30424 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cafbefbc00f4a9db26e582141e6d80f" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 42585 } }
I20260809 19:12:26.867316 30424 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cafbefbc00f4a9db26e582141e6d80f, State: Initialized, Role: FOLLOWER
I20260809 19:12:26.867916 30424 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cafbefbc00f4a9db26e582141e6d80f" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 42585 } }
I20260809 19:12:26.868135 30424 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:12:26.868250 30424 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:12:26.868407 30424 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [term 1 FOLLOWER]: Advancing to term 2
I20260809 19:12:26.872092 30424 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cafbefbc00f4a9db26e582141e6d80f" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 42585 } }
I20260809 19:12:26.872632 30424 leader_election.cc:302] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4cafbefbc00f4a9db26e582141e6d80f; no voters:
I20260809 19:12:26.873332 30424 leader_election.cc:288] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 19:12:26.873464 30429 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [term 2 FOLLOWER]: Leader election won for term 2
I20260809 19:12:26.874625 30429 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [term 2 LEADER]: Becoming Leader. State: Replica: 4cafbefbc00f4a9db26e582141e6d80f, State: Running, Role: LEADER
I20260809 19:12:26.875182 30429 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cafbefbc00f4a9db26e582141e6d80f" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 42585 } }
I20260809 19:12:26.875633 30424 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:12:26.877785 30430 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "4cafbefbc00f4a9db26e582141e6d80f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cafbefbc00f4a9db26e582141e6d80f" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 42585 } } }
I20260809 19:12:26.878530 30430 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [sys.catalog]: This master's current role is: LEADER
I20260809 19:12:26.878046 30431 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4cafbefbc00f4a9db26e582141e6d80f. Latest consensus state: current_term: 2 leader_uuid: "4cafbefbc00f4a9db26e582141e6d80f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cafbefbc00f4a9db26e582141e6d80f" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 42585 } } }
I20260809 19:12:26.880955 30431 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [sys.catalog]: This master's current role is: LEADER
I20260809 19:12:26.882306 30436 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:12:26.892056 30436 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:12:26.893657 30436 catalog_manager.cc:1259] Loaded cluster ID: 59b58d30c69b4209abb7d48fc6e3e821
I20260809 19:12:26.893761 30436 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:12:26.897143 30436 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260809 19:12:26.916911 30436 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260809 19:12:26.926554 30436 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:12:26.928306 30436 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f: Loaded TSK: 0
I20260809 19:12:26.929961 30436 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 19:12:27.187356 30426 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:12:27.187652 30426 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:12:27.187794 30426 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:12:27.194947 30426 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:12:27.195068 30426 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:12:27.195221 30426 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.1
I20260809 19:12:27.205318 30426 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:32953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.1:40013
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.39.1
--webserver_port=33677
--tserver_master_addrs=127.7.39.62:42585
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.1
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:12:27.206681 30426 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:12:27.208058 30426 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:12:27.222662 30472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:27.223181 30474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:27.223660 30477 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:12:27.223999 30426 server_base.cc:1034] running on GCE node
I20260809 19:12:27.224629 30426 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:12:27.225590 30426 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:12:27.226802 30426 hybrid_clock.cc:648] HybridClock initialized: now 1786302747226744 us; error 48 us; skew 500 ppm
I20260809 19:12:27.227123 30426 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:12:27 dist-test-slave-4tdj krb5kdc[29381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302747, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:12:27.230432 30426 init.cc:377] Logged in from keytab as kudu/127.7.39.1@KRBTEST.COM (short username kudu)
I20260809 19:12:27.231933 30426 webserver.cc:460] Webserver started at http://127.7.39.1:33677/ using document root <none> and password file <none>
I20260809 19:12:27.232620 30426 fs_manager.cc:359] Metadata directory not provided
I20260809 19:12:27.232754 30426 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:12:27.238358 30426 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 19:12:27.241160 30492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:27.242653 30426 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:12:27.242821 30426 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/wal
uuid: "ee9bb8e9c0824cc8937a25de0118a76c"
format_stamp: "Formatted at 2026-08-09 19:12:24 on dist-test-slave-4tdj"
server_key: "da540ae42911d9201eed7c254aeb5131"
server_key_iv: "c0f24b16e95e6baa27ca015284886dd6"
server_key_version: "encryptionkey@0"
I20260809 19:12:27.243794 30426 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:12:27.260944 30426 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:12:27.264909 30426 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:12:27.265183 30426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:12:27.266134 30426 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:12:27.267477 30426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:12:27.267596 30426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:27.267716 30426 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:12:27.267794 30426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:27.299352 30426 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.1:40013
I20260809 19:12:27.299407 30678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.1:40013 every 8 connection(s)
I20260809 19:12:27.300773 30426 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
I20260809 19:12:27.304675 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 30426
I20260809 19:12:27.305403 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.2:41131
--local_ip_for_outbound_sockets=127.7.39.2
--tserver_master_addrs=127.7.39.62:42585
--webserver_port=38387
--webserver_interface=127.7.39.2
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:32953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 19:12:27 dist-test-slave-4tdj krb5kdc[29381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302747, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:12:27.324806 30689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:27.303658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.1:37625)
0809 19:12:27.304484 (+ 826us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:27.304532 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:27.306239 (+ 1707us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:27.307562 (+ 1323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:27.307571 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:27.308172 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:12:27.308678 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:27.308696 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:27.310537 (+ 1841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:27.310542 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:27.312113 (+ 1571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:27.312127 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:27.313511 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:27.313517 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:27.313760 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:27.314441 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:12:27.314471 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:12:27.316991 (+ 2520us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:12:27.320958 (+ 3967us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:27.320967 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:27.320977 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:27.321391 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:27.321848 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:27.321851 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:27.321853 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:27.322038 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:27.322921 (+ 883us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:12:27.322927 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:12:27.323231 (+ 304us) client_negotiation.cc:769] Sending connection context
0809 19:12:27.323476 (+ 245us) client_negotiation.cc:240] Negotiation successful
0809 19:12:27.323836 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":591,"thread_start_us":391,"threads_started":1}
I20260809 19:12:27.325258 30686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:27.303485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:37625 (local address 127.7.39.62:42585)
0809 19:12:27.304096 (+ 611us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:27.304114 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:27.304653 (+ 539us) server_negotiation.cc:407] Connection header received
0809 19:12:27.306772 (+ 2119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:27.306785 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:27.307081 (+ 296us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:27.307381 (+ 300us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:27.308892 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:27.310353 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:27.312262 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:27.313077 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:27.313214 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:27.317269 (+ 4055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:27.317278 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:27.317295 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:27.317337 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:27.320813 (+ 3476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:27.321542 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:27.321550 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:27.321558 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:27.321751 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:27.322156 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:27.322160 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:27.322163 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:27.322784 (+ 621us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:27.322960 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:27.323700 (+ 740us) server_negotiation.cc:299] Negotiation successful
0809 19:12:27.324091 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":241,"threads_started":1}
I20260809 19:12:27.327941 30680 heartbeater.cc:347] Connected to a master server at 127.7.39.62:42585
I20260809 19:12:27.328269 30680 heartbeater.cc:464] Registering TS with master...
I20260809 19:12:27.329160 30680 heartbeater.cc:511] Master 127.7.39.62:42585 requested a full tablet report, sending...
I20260809 19:12:27.331550 30366 ts_manager.cc:194] Registered new tserver with Master: ee9bb8e9c0824cc8937a25de0118a76c (127.7.39.1:40013)
I20260809 19:12:27.333022 30366 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.1@KRBTEST.COM'} at 127.7.39.1:37625
W20260809 19:12:27.628660 30691 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:12:27.628894 30691 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:12:27.629019 30691 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:12:27.635865 30691 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:12:27.635958 30691 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:12:27.636106 30691 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.2
I20260809 19:12:27.645036 30691 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:32953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.2:41131
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.39.2
--webserver_port=38387
--tserver_master_addrs=127.7.39.62:42585
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.2
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:12:27.646128 30691 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:12:27.647392 30691 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:12:27.659590 30701 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:27.659544 30709 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:27.659515 30704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:12:27.660404 30691 server_base.cc:1034] running on GCE node
I20260809 19:12:27.660933 30691 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:12:27.661808 30691 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:12:27.663018 30691 hybrid_clock.cc:648] HybridClock initialized: now 1786302747662958 us; error 45 us; skew 500 ppm
I20260809 19:12:27.663301 30691 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:12:27 dist-test-slave-4tdj krb5kdc[29381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302747, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:12:27.666220 30691 init.cc:377] Logged in from keytab as kudu/127.7.39.2@KRBTEST.COM (short username kudu)
I20260809 19:12:27.667603 30691 webserver.cc:460] Webserver started at http://127.7.39.2:38387/ using document root <none> and password file <none>
I20260809 19:12:27.668231 30691 fs_manager.cc:359] Metadata directory not provided
I20260809 19:12:27.668354 30691 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:12:27.673281 30691 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260809 19:12:27.675889 30723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:27.677168 30691 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 19:12:27.677309 30691 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/wal
uuid: "265511151d1b4ca5ab3b2e0a4e98cb54"
format_stamp: "Formatted at 2026-08-09 19:12:25 on dist-test-slave-4tdj"
server_key: "3b914c4b81671233a71c81f9b7fce572"
server_key_iv: "8fcfc7ba9d0c2eb6a37429178d89017b"
server_key_version: "encryptionkey@0"
I20260809 19:12:27.678200 30691 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:12:27.703761 30691 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:12:27.707319 30691 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:12:27.707608 30691 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:12:27.708506 30691 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:12:27.709730 30691 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:12:27.709822 30691 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:27.709924 30691 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:12:27.709996 30691 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:27.738982 30691 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.2:41131
I20260809 19:12:27.739056 30933 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.2:41131 every 8 connection(s)
I20260809 19:12:27.740310 30691 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
I20260809 19:12:27.742777 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 30691
I20260809 19:12:27.743355 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.3:39983
--local_ip_for_outbound_sockets=127.7.39.3
--tserver_master_addrs=127.7.39.62:42585
--webserver_port=40621
--webserver_interface=127.7.39.3
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:32953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 19:12:27 dist-test-slave-4tdj krb5kdc[29381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302747, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:12:27.759147 30686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:27.742732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:48049 (local address 127.7.39.62:42585)
0809 19:12:27.742951 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:27.742958 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:27.744095 (+ 1137us) server_negotiation.cc:407] Connection header received
0809 19:12:27.745903 (+ 1808us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:27.745909 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:27.745993 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:27.746103 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:27.747528 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:27.748578 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:27.750036 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:27.750601 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:27.750722 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:27.753898 (+ 3176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:27.753903 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:27.753906 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:27.753941 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:27.756321 (+ 2380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:27.756973 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:27.756979 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:27.756981 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:27.757121 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:27.757506 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:27.757510 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:27.757512 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:27.757775 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:27.757909 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:27.758575 (+ 666us) server_negotiation.cc:299] Negotiation successful
0809 19:12:27.758801 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 19:12:27.759967 30937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:27.743157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.2:48049)
0809 19:12:27.743934 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:27.743977 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:27.745643 (+ 1666us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:27.746272 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:27.746280 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:27.746805 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:12:27.747367 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:27.747384 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:27.748717 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:27.748720 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:27.749895 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:27.749906 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:27.750790 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:27.750795 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:27.750976 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:27.751562 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:12:27.751582 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:12:27.753701 (+ 2119us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:12:27.756451 (+ 2750us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:27.756459 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:27.756473 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:27.756861 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:27.757224 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:27.757229 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:27.757233 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:27.757400 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:27.757908 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:12:27.757916 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:12:27.758194 (+ 278us) client_negotiation.cc:769] Sending connection context
0809 19:12:27.758446 (+ 252us) client_negotiation.cc:240] Negotiation successful
0809 19:12:27.758905 (+ 459us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":324,"threads_started":1}
I20260809 19:12:27.761376 30934 heartbeater.cc:347] Connected to a master server at 127.7.39.62:42585
I20260809 19:12:27.761648 30934 heartbeater.cc:464] Registering TS with master...
I20260809 19:12:27.762355 30934 heartbeater.cc:511] Master 127.7.39.62:42585 requested a full tablet report, sending...
I20260809 19:12:27.763861 30366 ts_manager.cc:194] Registered new tserver with Master: 265511151d1b4ca5ab3b2e0a4e98cb54 (127.7.39.2:41131)
I20260809 19:12:27.764955 30366 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.2@KRBTEST.COM'} at 127.7.39.2:48049
W20260809 19:12:28.065708 30939 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:12:28.065973 30939 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:12:28.066071 30939 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:12:28.073197 30939 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:12:28.073303 30939 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:12:28.073429 30939 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.3
I20260809 19:12:28.082975 30939 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:32953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.3:39983
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.39.3
--webserver_port=40621
--tserver_master_addrs=127.7.39.62:42585
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.3
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:12:28.084175 30939 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:12:28.085515 30939 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:12:28.098641 30952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:28.098673 30953 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:28.098794 30955 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:12:28.099280 30939 server_base.cc:1034] running on GCE node
I20260809 19:12:28.099840 30939 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:12:28.100682 30939 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:12:28.101887 30939 hybrid_clock.cc:648] HybridClock initialized: now 1786302748101838 us; error 45 us; skew 500 ppm
I20260809 19:12:28.102170 30939 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:12:28 dist-test-slave-4tdj krb5kdc[29381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302748, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:12:28.105116 30939 init.cc:377] Logged in from keytab as kudu/127.7.39.3@KRBTEST.COM (short username kudu)
I20260809 19:12:28.106484 30939 webserver.cc:460] Webserver started at http://127.7.39.3:40621/ using document root <none> and password file <none>
I20260809 19:12:28.107137 30939 fs_manager.cc:359] Metadata directory not provided
I20260809 19:12:28.107263 30939 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:12:28.112411 30939 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.002s
I20260809 19:12:28.115057 30973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:28.116284 30939 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:12:28.116430 30939 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/wal
uuid: "bcd9fcfcf5394392bd535606d932097b"
format_stamp: "Formatted at 2026-08-09 19:12:25 on dist-test-slave-4tdj"
server_key: "8641fd7861526374beb816fb90b1a8f3"
server_key_iv: "180ec943c6af84abafee0121d86e136c"
server_key_version: "encryptionkey@0"
I20260809 19:12:28.117400 30939 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:12:28.131035 30939 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:12:28.134457 30939 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:12:28.134691 30939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:12:28.135541 30939 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:12:28.136739 30939 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:12:28.136839 30939 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:28.136940 30939 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:12:28.137008 30939 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:28.166210 30939 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.3:39983
I20260809 19:12:28.166270 31166 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.3:39983 every 8 connection(s)
I20260809 19:12:28.167654 30939 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
I20260809 19:12:28.177909 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 30939
Aug 09 19:12:28 dist-test-slave-4tdj krb5kdc[29381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302748, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:12:28.186188 30686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:28.169931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:39889 (local address 127.7.39.62:42585)
0809 19:12:28.170157 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:28.170163 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:28.171260 (+ 1097us) server_negotiation.cc:407] Connection header received
0809 19:12:28.172926 (+ 1666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:28.172930 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:28.172996 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:28.173086 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:28.174432 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.175136 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.176633 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.177120 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.177225 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:28.180617 (+ 3392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:28.180621 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:28.180624 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:28.180655 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:28.183437 (+ 2782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:28.184079 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:28.184085 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:28.184089 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:28.184244 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:28.184648 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:28.184652 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:28.184654 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:28.184911 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:28.185038 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:28.185680 (+ 642us) server_negotiation.cc:299] Negotiation successful
0809 19:12:28.185886 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 19:12:28.187016 31169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:28.170424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.3:39889)
0809 19:12:28.171104 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:28.171147 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:28.172700 (+ 1553us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:28.173259 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:28.173266 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:28.173759 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:12:28.174278 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:28.174315 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.175289 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.175294 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:28.176521 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:28.176533 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.177295 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.177300 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:28.177476 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:28.178098 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:12:28.178120 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:12:28.180418 (+ 2298us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:12:28.183564 (+ 3146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:28.183573 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:28.183586 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:28.183969 (+ 383us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:28.184347 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:28.184352 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:28.184356 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:28.184528 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:28.185036 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:12:28.185044 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:12:28.185333 (+ 289us) client_negotiation.cc:769] Sending connection context
0809 19:12:28.185545 (+ 212us) client_negotiation.cc:240] Negotiation successful
0809 19:12:28.185987 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":259,"threads_started":1}
I20260809 19:12:28.188400 31167 heartbeater.cc:347] Connected to a master server at 127.7.39.62:42585
I20260809 19:12:28.188699 31167 heartbeater.cc:464] Registering TS with master...
I20260809 19:12:28.189371 31167 heartbeater.cc:511] Master 127.7.39.62:42585 requested a full tablet report, sending...
I20260809 19:12:28.190766 30366 ts_manager.cc:194] Registered new tserver with Master: bcd9fcfcf5394392bd535606d932097b (127.7.39.3:39983)
I20260809 19:12:28.191879 30366 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.3@KRBTEST.COM'} at 127.7.39.3:39889
I20260809 19:12:28.192247 31171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:28.178778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41968 (local address 127.7.39.62:42585)
0809 19:12:28.179275 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:28.179281 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:28.179677 (+ 396us) server_negotiation.cc:407] Connection header received
0809 19:12:28.179825 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:28.179830 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:28.179897 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:28.179983 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:28.181520 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.182528 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.183953 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.184369 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.184474 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:28.187105 (+ 2631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:28.187112 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:28.187117 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:28.187155 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:28.189695 (+ 2540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:28.190361 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:28.190366 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:28.190369 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:28.190508 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:28.190853 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:28.190857 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:28.190860 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:28.191212 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:28.191470 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:28.191672 (+ 202us) server_negotiation.cc:299] Negotiation successful
0809 19:12:28.191876 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":382,"thread_start_us":249,"threads_started":1}
I20260809 19:12:28.194707 7324 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 19:12:28.200436 31171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:28.195477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41984 (local address 127.7.39.62:42585)
0809 19:12:28.195645 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:28.195648 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:28.196039 (+ 391us) server_negotiation.cc:407] Connection header received
0809 19:12:28.196200 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:28.196203 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:28.196320 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:28.196417 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:12:28.196769 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.197400 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.198744 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.199134 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.199222 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:28.199609 (+ 387us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:12:28.200040 (+ 431us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:12:28.200138 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:28.200208 (+ 70us) server_negotiation.cc:299] Negotiation successful
0809 19:12:28.200263 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 19:12:28.201223 30366 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:41984:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:12:28.208380 30366 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:12:28.236542 31189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:28.219364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:39983 (local address 127.0.0.1:39900)
0809 19:12:28.224421 (+ 5057us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:28.224477 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:28.224652 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:28.227597 (+ 2945us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:28.227603 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:28.227630 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:12:28.227991 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:28.228002 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.230221 (+ 2219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.230227 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:28.233447 (+ 3220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:28.233462 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.235706 (+ 2244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.235712 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:28.235898 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:28.235932 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 19:12:28.236017 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 19:12:28.236143 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4800,"mutex_wait_us":25,"thread_start_us":4640,"threads_started":1}
I20260809 19:12:28.236796 31190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:28.219551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39900 (local address 127.7.39.3:39983)
0809 19:12:28.225886 (+ 6335us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:28.225894 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:28.225924 (+ 30us) server_negotiation.cc:407] Connection header received
0809 19:12:28.226017 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:28.226025 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:28.227352 (+ 1327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:28.228179 (+ 827us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:12:28.228436 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.230050 (+ 1614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.233660 (+ 3610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.235058 (+ 1398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.235191 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:28.235413 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:28.236301 (+ 888us) server_negotiation.cc:299] Negotiation successful
0809 19:12:28.236446 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6193,"thread_start_us":6051,"threads_started":1}
I20260809 19:12:28.237033 31192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:28.219915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49908 (local address 127.7.39.2:41131)
0809 19:12:28.223815 (+ 3900us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:28.223824 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:28.225352 (+ 1528us) server_negotiation.cc:407] Connection header received
0809 19:12:28.225515 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:28.225524 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:28.225783 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:28.225984 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:12:28.227122 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.228795 (+ 1673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.233735 (+ 4940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.235100 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.235200 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:28.235416 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:28.236555 (+ 1139us) server_negotiation.cc:299] Negotiation successful
0809 19:12:28.236720 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2673,"thread_start_us":2548,"threads_started":1}
I20260809 19:12:28.237304 31191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:28.219708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:41131 (local address 127.0.0.1:49908)
0809 19:12:28.225232 (+ 5524us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:28.225249 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:28.225365 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:28.226329 (+ 964us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:28.226338 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:28.226381 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:12:28.226887 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:28.226900 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.228975 (+ 2075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.228981 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:28.233574 (+ 4593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:28.233586 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.235565 (+ 1979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.235571 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:28.235756 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:28.235807 (+ 51us) client_negotiation.cc:769] Sending connection context
0809 19:12:28.235926 (+ 119us) client_negotiation.cc:240] Negotiation successful
0809 19:12:28.236120 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5381,"mutex_wait_us":1,"thread_start_us":5235,"threads_started":1}
I20260809 19:12:28.240413 31194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:28.225899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:40013 (local address 127.0.0.1:43212)
0809 19:12:28.233911 (+ 8012us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:28.233925 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:28.234030 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:28.234510 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:28.234514 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:28.234546 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:12:28.234857 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:28.234865 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.236612 (+ 1747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.236617 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:28.238480 (+ 1863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:28.238492 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.239738 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.239744 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:28.239894 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:28.239917 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 19:12:28.239996 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 19:12:28.240110 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7920,"thread_start_us":7806,"threads_started":1}
I20260809 19:12:28.240526 31193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:28.225164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43212 (local address 127.7.39.1:40013)
0809 19:12:28.233517 (+ 8353us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:28.233527 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:28.234014 (+ 487us) server_negotiation.cc:407] Connection header received
0809 19:12:28.234163 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:28.234169 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:28.234349 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:28.234513 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:12:28.235010 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.236450 (+ 1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.238626 (+ 2176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.239539 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.239653 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:28.239835 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:28.240067 (+ 232us) server_negotiation.cc:299] Negotiation successful
0809 19:12:28.240229 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8183,"thread_start_us":8044,"threads_started":1}
I20260809 19:12:28.241148 31057 tablet_service.cc:1467] Processing CreateTablet for tablet 59cb4f802cd04e32a4a2332700c92030 (DEFAULT_TABLE table=test-table [id=f450dac28e3f4aa6b2d574cf2c5ddd96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:12:28.241148 30810 tablet_service.cc:1467] Processing CreateTablet for tablet 59cb4f802cd04e32a4a2332700c92030 (DEFAULT_TABLE table=test-table [id=f450dac28e3f4aa6b2d574cf2c5ddd96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:12:28.242650 31057 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59cb4f802cd04e32a4a2332700c92030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:12:28.242739 30810 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59cb4f802cd04e32a4a2332700c92030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:12:28.243647 30585 tablet_service.cc:1467] Processing CreateTablet for tablet 59cb4f802cd04e32a4a2332700c92030 (DEFAULT_TABLE table=test-table [id=f450dac28e3f4aa6b2d574cf2c5ddd96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:12:28.244664 30585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59cb4f802cd04e32a4a2332700c92030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:12:28.255852 31196 tablet_bootstrap.cc:492] T 59cb4f802cd04e32a4a2332700c92030 P ee9bb8e9c0824cc8937a25de0118a76c: Bootstrap starting.
I20260809 19:12:28.260103 31196 tablet_bootstrap.cc:654] T 59cb4f802cd04e32a4a2332700c92030 P ee9bb8e9c0824cc8937a25de0118a76c: Neither blocks nor log segments found. Creating new log.
I20260809 19:12:28.261284 31196 log.cc:824] T 59cb4f802cd04e32a4a2332700c92030 P ee9bb8e9c0824cc8937a25de0118a76c: Log is configured to *not* fsync() on all Append() calls
I20260809 19:12:28.263561 31199 tablet_bootstrap.cc:492] T 59cb4f802cd04e32a4a2332700c92030 P 265511151d1b4ca5ab3b2e0a4e98cb54: Bootstrap starting.
I20260809 19:12:28.263552 31198 tablet_bootstrap.cc:492] T 59cb4f802cd04e32a4a2332700c92030 P bcd9fcfcf5394392bd535606d932097b: Bootstrap starting.
I20260809 19:12:28.266754 31199 tablet_bootstrap.cc:654] T 59cb4f802cd04e32a4a2332700c92030 P 265511151d1b4ca5ab3b2e0a4e98cb54: Neither blocks nor log segments found. Creating new log.
I20260809 19:12:28.267788 31198 tablet_bootstrap.cc:654] T 59cb4f802cd04e32a4a2332700c92030 P bcd9fcfcf5394392bd535606d932097b: Neither blocks nor log segments found. Creating new log.
I20260809 19:12:28.268375 31199 log.cc:824] T 59cb4f802cd04e32a4a2332700c92030 P 265511151d1b4ca5ab3b2e0a4e98cb54: Log is configured to *not* fsync() on all Append() calls
I20260809 19:12:28.268908 31198 log.cc:824] T 59cb4f802cd04e32a4a2332700c92030 P bcd9fcfcf5394392bd535606d932097b: Log is configured to *not* fsync() on all Append() calls
I20260809 19:12:28.270079 31196 tablet_bootstrap.cc:492] T 59cb4f802cd04e32a4a2332700c92030 P ee9bb8e9c0824cc8937a25de0118a76c: No bootstrap required, opened a new log
I20260809 19:12:28.270372 31196 ts_tablet_manager.cc:1397] T 59cb4f802cd04e32a4a2332700c92030 P ee9bb8e9c0824cc8937a25de0118a76c: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.006s
I20260809 19:12:28.270967 31199 tablet_bootstrap.cc:492] T 59cb4f802cd04e32a4a2332700c92030 P 265511151d1b4ca5ab3b2e0a4e98cb54: No bootstrap required, opened a new log
I20260809 19:12:28.271195 31199 ts_tablet_manager.cc:1397] T 59cb4f802cd04e32a4a2332700c92030 P 265511151d1b4ca5ab3b2e0a4e98cb54: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.001s
I20260809 19:12:28.271862 31198 tablet_bootstrap.cc:492] T 59cb4f802cd04e32a4a2332700c92030 P bcd9fcfcf5394392bd535606d932097b: No bootstrap required, opened a new log
I20260809 19:12:28.272112 31198 ts_tablet_manager.cc:1397] T 59cb4f802cd04e32a4a2332700c92030 P bcd9fcfcf5394392bd535606d932097b: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260809 19:12:28.277786 31199 raft_consensus.cc:348] T 59cb4f802cd04e32a4a2332700c92030 P 265511151d1b4ca5ab3b2e0a4e98cb54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcd9fcfcf5394392bd535606d932097b" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 39983 } } peers { permanent_uuid: "265511151d1b4ca5ab3b2e0a4e98cb54" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 41131 } } peers { permanent_uuid: "ee9bb8e9c0824cc8937a25de0118a76c" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 40013 } }
I20260809 19:12:28.278102 31199 raft_consensus.cc:374] T 59cb4f802cd04e32a4a2332700c92030 P 265511151d1b4ca5ab3b2e0a4e98cb54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:12:28.278198 31199 raft_consensus.cc:729] T 59cb4f802cd04e32a4a2332700c92030 P 265511151d1b4ca5ab3b2e0a4e98cb54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 265511151d1b4ca5ab3b2e0a4e98cb54, State: Initialized, Role: FOLLOWER
I20260809 19:12:28.278765 31199 consensus_queue.cc:260] T 59cb4f802cd04e32a4a2332700c92030 P 265511151d1b4ca5ab3b2e0a4e98cb54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcd9fcfcf5394392bd535606d932097b" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 39983 } } peers { permanent_uuid: "265511151d1b4ca5ab3b2e0a4e98cb54" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 41131 } } peers { permanent_uuid: "ee9bb8e9c0824cc8937a25de0118a76c" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 40013 } }
I20260809 19:12:28.279726 30934 heartbeater.cc:503] Master 127.7.39.62:42585 was elected leader, sending a full tablet report...
I20260809 19:12:28.280371 31199 ts_tablet_manager.cc:1428] T 59cb4f802cd04e32a4a2332700c92030 P 265511151d1b4ca5ab3b2e0a4e98cb54: Time spent starting tablet: real 0.009s user 0.006s sys 0.003s
I20260809 19:12:28.281375 31196 raft_consensus.cc:348] T 59cb4f802cd04e32a4a2332700c92030 P ee9bb8e9c0824cc8937a25de0118a76c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcd9fcfcf5394392bd535606d932097b" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 39983 } } peers { permanent_uuid: "265511151d1b4ca5ab3b2e0a4e98cb54" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 41131 } } peers { permanent_uuid: "ee9bb8e9c0824cc8937a25de0118a76c" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 40013 } }
I20260809 19:12:28.281787 31196 raft_consensus.cc:374] T 59cb4f802cd04e32a4a2332700c92030 P ee9bb8e9c0824cc8937a25de0118a76c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:12:28.281896 31196 raft_consensus.cc:729] T 59cb4f802cd04e32a4a2332700c92030 P ee9bb8e9c0824cc8937a25de0118a76c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9bb8e9c0824cc8937a25de0118a76c, State: Initialized, Role: FOLLOWER
I20260809 19:12:28.281930 31198 raft_consensus.cc:348] T 59cb4f802cd04e32a4a2332700c92030 P bcd9fcfcf5394392bd535606d932097b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcd9fcfcf5394392bd535606d932097b" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 39983 } } peers { permanent_uuid: "265511151d1b4ca5ab3b2e0a4e98cb54" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 41131 } } peers { permanent_uuid: "ee9bb8e9c0824cc8937a25de0118a76c" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 40013 } }
I20260809 19:12:28.282480 31198 raft_consensus.cc:374] T 59cb4f802cd04e32a4a2332700c92030 P bcd9fcfcf5394392bd535606d932097b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:12:28.282588 31198 raft_consensus.cc:729] T 59cb4f802cd04e32a4a2332700c92030 P bcd9fcfcf5394392bd535606d932097b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcd9fcfcf5394392bd535606d932097b, State: Initialized, Role: FOLLOWER
I20260809 19:12:28.282594 31196 consensus_queue.cc:260] T 59cb4f802cd04e32a4a2332700c92030 P ee9bb8e9c0824cc8937a25de0118a76c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcd9fcfcf5394392bd535606d932097b" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 39983 } } peers { permanent_uuid: "265511151d1b4ca5ab3b2e0a4e98cb54" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 41131 } } peers { permanent_uuid: "ee9bb8e9c0824cc8937a25de0118a76c" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 40013 } }
I20260809 19:12:28.283171 31198 consensus_queue.cc:260] T 59cb4f802cd04e32a4a2332700c92030 P bcd9fcfcf5394392bd535606d932097b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcd9fcfcf5394392bd535606d932097b" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 39983 } } peers { permanent_uuid: "265511151d1b4ca5ab3b2e0a4e98cb54" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 41131 } } peers { permanent_uuid: "ee9bb8e9c0824cc8937a25de0118a76c" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 40013 } }
I20260809 19:12:28.284425 31167 heartbeater.cc:503] Master 127.7.39.62:42585 was elected leader, sending a full tablet report...
I20260809 19:12:28.284978 31198 ts_tablet_manager.cc:1428] T 59cb4f802cd04e32a4a2332700c92030 P bcd9fcfcf5394392bd535606d932097b: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
I20260809 19:12:28.285887 30680 heartbeater.cc:503] Master 127.7.39.62:42585 was elected leader, sending a full tablet report...
I20260809 19:12:28.287201 31196 ts_tablet_manager.cc:1428] T 59cb4f802cd04e32a4a2332700c92030 P ee9bb8e9c0824cc8937a25de0118a76c: Time spent starting tablet: real 0.017s user 0.013s sys 0.001s
W20260809 19:12:28.302809 30682 tablet.cc:2369] T 59cb4f802cd04e32a4a2332700c92030 P ee9bb8e9c0824cc8937a25de0118a76c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 19:12:28.419209 31168 tablet.cc:2369] T 59cb4f802cd04e32a4a2332700c92030 P bcd9fcfcf5394392bd535606d932097b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:12:28.467618 31205 raft_consensus.cc:482] T 59cb4f802cd04e32a4a2332700c92030 P 265511151d1b4ca5ab3b2e0a4e98cb54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:12:28.467941 31205 raft_consensus.cc:504] T 59cb4f802cd04e32a4a2332700c92030 P 265511151d1b4ca5ab3b2e0a4e98cb54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcd9fcfcf5394392bd535606d932097b" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 39983 } } peers { permanent_uuid: "265511151d1b4ca5ab3b2e0a4e98cb54" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 41131 } } peers { permanent_uuid: "ee9bb8e9c0824cc8937a25de0118a76c" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 40013 } }
I20260809 19:12:28.469700 31205 leader_election.cc:288] T 59cb4f802cd04e32a4a2332700c92030 P 265511151d1b4ca5ab3b2e0a4e98cb54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bcd9fcfcf5394392bd535606d932097b (127.7.39.3:39983), ee9bb8e9c0824cc8937a25de0118a76c (127.7.39.1:40013)
I20260809 19:12:28.476554 31190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:28.470138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:40987 (local address 127.7.39.3:39983)
0809 19:12:28.470399 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:28.470406 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:28.470821 (+ 415us) server_negotiation.cc:407] Connection header received
0809 19:12:28.471042 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:28.471048 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:28.471131 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:28.471221 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:12:28.471878 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.472807 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.474746 (+ 1939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.475623 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.475735 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:28.475810 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:28.476185 (+ 375us) server_negotiation.cc:299] Negotiation successful
0809 19:12:28.476308 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 19:12:28.476719 31208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:28.470019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:39983 (local address 127.7.39.2:40987)
0809 19:12:28.470695 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:28.470712 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:28.470875 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:28.471308 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:28.471314 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:28.471346 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:12:28.471712 (+ 366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:28.471726 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.472932 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.472937 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:28.474604 (+ 1667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:28.474616 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.475834 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.475841 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:28.476004 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:28.476054 (+ 50us) client_negotiation.cc:769] Sending connection context
0809 19:12:28.476145 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 19:12:28.476260 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":567,"mutex_wait_us":37,"thread_start_us":376,"threads_started":1}
I20260809 19:12:28.476871 31193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:28.471114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:50891 (local address 127.7.39.1:40013)
0809 19:12:28.471302 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:28.471308 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:28.471529 (+ 221us) server_negotiation.cc:407] Connection header received
0809 19:12:28.471688 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:28.471693 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:28.471767 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:28.471851 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:12:28.472397 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.473181 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.475018 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.475881 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.476006 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:28.476090 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:28.476496 (+ 406us) server_negotiation.cc:299] Negotiation successful
0809 19:12:28.476628 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 19:12:28.477017 31211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:28.470790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:40013 (local address 127.7.39.2:50891)
0809 19:12:28.471434 (+ 644us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:28.471451 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:28.471564 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:28.471879 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:28.471883 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:28.471906 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:12:28.472261 (+ 355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:28.472273 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.473319 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.473322 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:28.474862 (+ 1540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:28.474876 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.476083 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.476087 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:28.476275 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:28.476307 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 19:12:28.476448 (+ 141us) client_negotiation.cc:240] Negotiation successful
0809 19:12:28.476578 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"mutex_wait_us":1,"thread_start_us":313,"threads_started":1}
I20260809 19:12:28.477860 31091 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59cb4f802cd04e32a4a2332700c92030" candidate_uuid: "265511151d1b4ca5ab3b2e0a4e98cb54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcd9fcfcf5394392bd535606d932097b" is_pre_election: true
I20260809 19:12:28.477896 30614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59cb4f802cd04e32a4a2332700c92030" candidate_uuid: "265511151d1b4ca5ab3b2e0a4e98cb54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9bb8e9c0824cc8937a25de0118a76c" is_pre_election: true
I20260809 19:12:28.478488 31091 raft_consensus.cc:2454] T 59cb4f802cd04e32a4a2332700c92030 P bcd9fcfcf5394392bd535606d932097b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 265511151d1b4ca5ab3b2e0a4e98cb54 in term 0.
I20260809 19:12:28.478488 30614 raft_consensus.cc:2454] T 59cb4f802cd04e32a4a2332700c92030 P ee9bb8e9c0824cc8937a25de0118a76c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 265511151d1b4ca5ab3b2e0a4e98cb54 in term 0.
I20260809 19:12:28.479161 30725 leader_election.cc:302] T 59cb4f802cd04e32a4a2332700c92030 P 265511151d1b4ca5ab3b2e0a4e98cb54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 265511151d1b4ca5ab3b2e0a4e98cb54, ee9bb8e9c0824cc8937a25de0118a76c; no voters:
I20260809 19:12:28.479509 31205 raft_consensus.cc:2781] T 59cb4f802cd04e32a4a2332700c92030 P 265511151d1b4ca5ab3b2e0a4e98cb54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:12:28.479646 31205 raft_consensus.cc:482] T 59cb4f802cd04e32a4a2332700c92030 P 265511151d1b4ca5ab3b2e0a4e98cb54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:12:28.479748 31205 raft_consensus.cc:3037] T 59cb4f802cd04e32a4a2332700c92030 P 265511151d1b4ca5ab3b2e0a4e98cb54 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:12:28.482074 31205 raft_consensus.cc:504] T 59cb4f802cd04e32a4a2332700c92030 P 265511151d1b4ca5ab3b2e0a4e98cb54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcd9fcfcf5394392bd535606d932097b" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 39983 } } peers { permanent_uuid: "265511151d1b4ca5ab3b2e0a4e98cb54" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 41131 } } peers { permanent_uuid: "ee9bb8e9c0824cc8937a25de0118a76c" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 40013 } }
I20260809 19:12:28.482659 31205 leader_election.cc:288] T 59cb4f802cd04e32a4a2332700c92030 P 265511151d1b4ca5ab3b2e0a4e98cb54 [CANDIDATE]: Term 1 election: Requested vote from peers bcd9fcfcf5394392bd535606d932097b (127.7.39.3:39983), ee9bb8e9c0824cc8937a25de0118a76c (127.7.39.1:40013)
I20260809 19:12:28.483060 31091 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59cb4f802cd04e32a4a2332700c92030" candidate_uuid: "265511151d1b4ca5ab3b2e0a4e98cb54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcd9fcfcf5394392bd535606d932097b"
I20260809 19:12:28.483134 30614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59cb4f802cd04e32a4a2332700c92030" candidate_uuid: "265511151d1b4ca5ab3b2e0a4e98cb54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9bb8e9c0824cc8937a25de0118a76c"
I20260809 19:12:28.483233 31091 raft_consensus.cc:3037] T 59cb4f802cd04e32a4a2332700c92030 P bcd9fcfcf5394392bd535606d932097b [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:12:28.483325 30614 raft_consensus.cc:3037] T 59cb4f802cd04e32a4a2332700c92030 P ee9bb8e9c0824cc8937a25de0118a76c [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:12:28.485386 31091 raft_consensus.cc:2454] T 59cb4f802cd04e32a4a2332700c92030 P bcd9fcfcf5394392bd535606d932097b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 265511151d1b4ca5ab3b2e0a4e98cb54 in term 1.
I20260809 19:12:28.485556 30614 raft_consensus.cc:2454] T 59cb4f802cd04e32a4a2332700c92030 P ee9bb8e9c0824cc8937a25de0118a76c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 265511151d1b4ca5ab3b2e0a4e98cb54 in term 1.
I20260809 19:12:28.485749 30725 leader_election.cc:302] T 59cb4f802cd04e32a4a2332700c92030 P 265511151d1b4ca5ab3b2e0a4e98cb54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 265511151d1b4ca5ab3b2e0a4e98cb54, bcd9fcfcf5394392bd535606d932097b; no voters:
I20260809 19:12:28.486019 31205 raft_consensus.cc:2781] T 59cb4f802cd04e32a4a2332700c92030 P 265511151d1b4ca5ab3b2e0a4e98cb54 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:12:28.486446 31205 raft_consensus.cc:686] T 59cb4f802cd04e32a4a2332700c92030 P 265511151d1b4ca5ab3b2e0a4e98cb54 [term 1 LEADER]: Becoming Leader. State: Replica: 265511151d1b4ca5ab3b2e0a4e98cb54, State: Running, Role: LEADER
I20260809 19:12:28.486907 31205 consensus_queue.cc:237] T 59cb4f802cd04e32a4a2332700c92030 P 265511151d1b4ca5ab3b2e0a4e98cb54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcd9fcfcf5394392bd535606d932097b" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 39983 } } peers { permanent_uuid: "265511151d1b4ca5ab3b2e0a4e98cb54" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 41131 } } peers { permanent_uuid: "ee9bb8e9c0824cc8937a25de0118a76c" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 40013 } }
I20260809 19:12:28.491400 30366 catalog_manager.cc:5495] T 59cb4f802cd04e32a4a2332700c92030 P 265511151d1b4ca5ab3b2e0a4e98cb54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 265511151d1b4ca5ab3b2e0a4e98cb54 (127.7.39.2). New cstate: current_term: 1 leader_uuid: "265511151d1b4ca5ab3b2e0a4e98cb54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcd9fcfcf5394392bd535606d932097b" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 39983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "265511151d1b4ca5ab3b2e0a4e98cb54" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 41131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9bb8e9c0824cc8937a25de0118a76c" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 40013 } health_report { overall_health: UNKNOWN } } }
W20260809 19:12:28.492085 30935 tablet.cc:2369] T 59cb4f802cd04e32a4a2332700c92030 P 265511151d1b4ca5ab3b2e0a4e98cb54: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:12:28.519649 31192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:28.515109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49922 (local address 127.7.39.2:41131)
0809 19:12:28.515287 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:28.515291 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:28.515308 (+ 17us) server_negotiation.cc:407] Connection header received
0809 19:12:28.515380 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:28.515383 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:28.515458 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:28.515578 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:12:28.515875 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.516561 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.517803 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.518211 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.518325 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:28.518747 (+ 422us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:12:28.519210 (+ 463us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:12:28.519314 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:28.519353 (+ 39us) server_negotiation.cc:299] Negotiation successful
0809 19:12:28.519410 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 19:12:28.527057 30614 raft_consensus.cc:1261] T 59cb4f802cd04e32a4a2332700c92030 P ee9bb8e9c0824cc8937a25de0118a76c [term 1 FOLLOWER]: Refusing update from remote peer 265511151d1b4ca5ab3b2e0a4e98cb54: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:12:28.527077 31091 raft_consensus.cc:1261] T 59cb4f802cd04e32a4a2332700c92030 P bcd9fcfcf5394392bd535606d932097b [term 1 FOLLOWER]: Refusing update from remote peer 265511151d1b4ca5ab3b2e0a4e98cb54: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:12:28.527876 31212 consensus_queue.cc:1035] T 59cb4f802cd04e32a4a2332700c92030 P 265511151d1b4ca5ab3b2e0a4e98cb54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcd9fcfcf5394392bd535606d932097b" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 39983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:12:28.528172 31205 consensus_queue.cc:1035] T 59cb4f802cd04e32a4a2332700c92030 P 265511151d1b4ca5ab3b2e0a4e98cb54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9bb8e9c0824cc8937a25de0118a76c" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 40013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:12:28.538179 31216 mvcc.cc:205] Tried to move back new op lower bound from 7316696057958125568 to 7316696057805938688. Current Snapshot: MvccSnapshot[applied={T|T < 7316696057958125568}]
I20260809 19:12:28.551620 30366 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:41984:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:12:28.551838 30366 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:41984:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:12:28.555110 30366 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f: Sending DeleteTablet for 3 replicas of tablet 59cb4f802cd04e32a4a2332700c92030
I20260809 19:12:28.556135 31057 tablet_service.cc:1514] Processing DeleteTablet for tablet 59cb4f802cd04e32a4a2332700c92030 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:12:28 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:39900
I20260809 19:12:28.556174 30810 tablet_service.cc:1514] Processing DeleteTablet for tablet 59cb4f802cd04e32a4a2332700c92030 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:12:28 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:49908
I20260809 19:12:28.556224 30585 tablet_service.cc:1514] Processing DeleteTablet for tablet 59cb4f802cd04e32a4a2332700c92030 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:12:28 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:43212
I20260809 19:12:28.558058 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 30426
I20260809 19:12:28.562736 31238 tablet_replica.cc:330] T 59cb4f802cd04e32a4a2332700c92030 P ee9bb8e9c0824cc8937a25de0118a76c: stopping tablet replica
I20260809 19:12:28.562950 31235 tablet_replica.cc:330] T 59cb4f802cd04e32a4a2332700c92030 P bcd9fcfcf5394392bd535606d932097b: stopping tablet replica
I20260809 19:12:28.563141 31238 raft_consensus.cc:2229] T 59cb4f802cd04e32a4a2332700c92030 P ee9bb8e9c0824cc8937a25de0118a76c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:12:28.563285 31235 raft_consensus.cc:2229] T 59cb4f802cd04e32a4a2332700c92030 P bcd9fcfcf5394392bd535606d932097b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:12:28.563627 31238 raft_consensus.cc:2258] T 59cb4f802cd04e32a4a2332700c92030 P ee9bb8e9c0824cc8937a25de0118a76c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:12:28.563678 31235 raft_consensus.cc:2258] T 59cb4f802cd04e32a4a2332700c92030 P bcd9fcfcf5394392bd535606d932097b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:12:28.564281 31239 tablet_replica.cc:330] T 59cb4f802cd04e32a4a2332700c92030 P 265511151d1b4ca5ab3b2e0a4e98cb54: stopping tablet replica
I20260809 19:12:28.564640 31239 raft_consensus.cc:2229] T 59cb4f802cd04e32a4a2332700c92030 P 265511151d1b4ca5ab3b2e0a4e98cb54 [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:12:28.565277 31239 raft_consensus.cc:2258] T 59cb4f802cd04e32a4a2332700c92030 P 265511151d1b4ca5ab3b2e0a4e98cb54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:12:28.567518 31238 ts_tablet_manager.cc:1905] T 59cb4f802cd04e32a4a2332700c92030 P ee9bb8e9c0824cc8937a25de0118a76c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:12:28.567713 31239 ts_tablet_manager.cc:1905] T 59cb4f802cd04e32a4a2332700c92030 P 265511151d1b4ca5ab3b2e0a4e98cb54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:12:28.574455 31239 ts_tablet_manager.cc:1918] T 59cb4f802cd04e32a4a2332700c92030 P 265511151d1b4ca5ab3b2e0a4e98cb54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:12:28.574450 31238 ts_tablet_manager.cc:1918] T 59cb4f802cd04e32a4a2332700c92030 P ee9bb8e9c0824cc8937a25de0118a76c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:12:28.574601 31238 log.cc:1196] T 59cb4f802cd04e32a4a2332700c92030 P ee9bb8e9c0824cc8937a25de0118a76c: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/wal/wals/59cb4f802cd04e32a4a2332700c92030
I20260809 19:12:28.574621 31239 log.cc:1196] T 59cb4f802cd04e32a4a2332700c92030 P 265511151d1b4ca5ab3b2e0a4e98cb54: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/wal/wals/59cb4f802cd04e32a4a2332700c92030
I20260809 19:12:28.575150 31239 ts_tablet_manager.cc:1939] T 59cb4f802cd04e32a4a2332700c92030 P 265511151d1b4ca5ab3b2e0a4e98cb54: Deleting consensus metadata
I20260809 19:12:28.575150 31238 ts_tablet_manager.cc:1939] T 59cb4f802cd04e32a4a2332700c92030 P ee9bb8e9c0824cc8937a25de0118a76c: Deleting consensus metadata
I20260809 19:12:28.576756 31235 ts_tablet_manager.cc:1905] T 59cb4f802cd04e32a4a2332700c92030 P bcd9fcfcf5394392bd535606d932097b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:12:28.577070 30338 catalog_manager.cc:4841] TS ee9bb8e9c0824cc8937a25de0118a76c (127.7.39.1:40013): tablet 59cb4f802cd04e32a4a2332700c92030 (table test-table [id=f450dac28e3f4aa6b2d574cf2c5ddd96]) successfully deleted
I20260809 19:12:28.577772 31193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:28.559085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43216 (local address 127.7.39.1:40013)
0809 19:12:28.559262 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:28.559268 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:28.559289 (+ 21us) server_negotiation.cc:407] Connection header received
0809 19:12:28.559430 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:28.559436 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:28.559540 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:28.559631 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:28.561666 (+ 2035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.562801 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.564870 (+ 2069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.565451 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.565578 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:28.569085 (+ 3507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:28.569100 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:28.569120 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:28.569164 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:28.573211 (+ 4047us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:28.574113 (+ 902us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:28.574122 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:28.574125 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:28.574277 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:28.574963 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:28.574968 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:28.574971 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:28.575591 (+ 620us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:28.575873 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:28.577138 (+ 1265us) server_negotiation.cc:299] Negotiation successful
0809 19:12:28.577427 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 19:12:28.578691 30674 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:12:28.578836 30340 catalog_manager.cc:4841] TS 265511151d1b4ca5ab3b2e0a4e98cb54 (127.7.39.2:41131): tablet 59cb4f802cd04e32a4a2332700c92030 (table test-table [id=f450dac28e3f4aa6b2d574cf2c5ddd96]) successfully deleted
I20260809 19:12:28.583520 31235 ts_tablet_manager.cc:1918] T 59cb4f802cd04e32a4a2332700c92030 P bcd9fcfcf5394392bd535606d932097b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:12:28.583660 31235 log.cc:1196] T 59cb4f802cd04e32a4a2332700c92030 P bcd9fcfcf5394392bd535606d932097b: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/wal/wals/59cb4f802cd04e32a4a2332700c92030
I20260809 19:12:28.584122 31235 ts_tablet_manager.cc:1939] T 59cb4f802cd04e32a4a2332700c92030 P bcd9fcfcf5394392bd535606d932097b: Deleting consensus metadata
I20260809 19:12:28.585337 30338 catalog_manager.cc:4841] TS bcd9fcfcf5394392bd535606d932097b (127.7.39.3:39983): tablet 59cb4f802cd04e32a4a2332700c92030 (table test-table [id=f450dac28e3f4aa6b2d574cf2c5ddd96]) successfully deleted
I20260809 19:12:28.697537 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 30426
I20260809 19:12:28.724576 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 30691
I20260809 19:12:28.738365 31192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:28.725317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49926 (local address 127.7.39.2:41131)
0809 19:12:28.725494 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:28.725500 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:28.725604 (+ 104us) server_negotiation.cc:407] Connection header received
0809 19:12:28.725792 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:28.725796 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:28.725865 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:28.725958 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:28.727339 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.728145 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.729374 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.729824 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.729935 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:28.732478 (+ 2543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:28.732497 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:28.732513 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:28.732558 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:28.735578 (+ 3020us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:28.736247 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:28.736254 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:28.736256 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:28.736399 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:28.736754 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:28.736758 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:28.736760 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:28.737172 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:28.737443 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:28.737825 (+ 382us) server_negotiation.cc:299] Negotiation successful
0809 19:12:28.738002 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 19:12:28.739050 30923 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:12:28.849843 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 30691
I20260809 19:12:28.874312 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 30939
I20260809 19:12:28.886826 31190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:28.875034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39902 (local address 127.7.39.3:39983)
0809 19:12:28.875197 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:28.875201 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:28.875280 (+ 79us) server_negotiation.cc:407] Connection header received
0809 19:12:28.875424 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:28.875429 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:28.875502 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:28.875589 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:28.876872 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.877616 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.879014 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:28.879382 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:28.879473 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:28.881944 (+ 2471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:28.881955 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:28.881971 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:28.882003 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:28.884481 (+ 2478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:28.885080 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:28.885087 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:28.885090 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:28.885231 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:28.885494 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:28.885497 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:28.885499 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:28.885823 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:28.886025 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:28.886245 (+ 220us) server_negotiation.cc:299] Negotiation successful
0809 19:12:28.886579 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 19:12:28.887418 31161 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:12:28.973160 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 30939
I20260809 19:12:29.000111 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 30307
I20260809 19:12:29.001267 30417 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:12:29.113888 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 30307
I20260809 19:12:29.138854 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:42585
--webserver_interface=127.7.39.62
--webserver_port=39657
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:32953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:42585
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:12:29.459611 31244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:12:29.459863 31244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:12:29.459990 31244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:12:29.466868 31244 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:12:29.466958 31244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:12:29.467036 31244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:12:29.467113 31244 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:12:29.467170 31244 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:12:29.476320 31244 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:32953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:42585
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:42585
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=39657
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:12:29.477515 31244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:12:29.478829 31244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:12:29.489822 31254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:29.489898 31259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:29.489859 31261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:12:29.491004 31244 server_base.cc:1034] running on GCE node
I20260809 19:12:29.491755 31244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:12:29.493068 31244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:12:29.494273 31244 hybrid_clock.cc:648] HybridClock initialized: now 1786302749494219 us; error 33 us; skew 500 ppm
I20260809 19:12:29.494630 31244 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:12:29 dist-test-slave-4tdj krb5kdc[29381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302749, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:12:29.500701 31244 init.cc:377] Logged in from keytab as kudu/127.7.39.62@KRBTEST.COM (short username kudu)
I20260809 19:12:29.502051 31244 webserver.cc:460] Webserver started at http://127.7.39.62:39657/ using document root <none> and password file <none>
I20260809 19:12:29.502738 31244 fs_manager.cc:359] Metadata directory not provided
I20260809 19:12:29.502851 31244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:12:29.508021 31244 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260809 19:12:29.510668 31272 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:29.511940 31244 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 19:12:29.512089 31244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "4cafbefbc00f4a9db26e582141e6d80f"
format_stamp: "Formatted at 2026-08-09 19:12:23 on dist-test-slave-4tdj"
server_key: "4c5a5b5ad5a63fce8ff69382efd2b93c"
server_key_iv: "bc3d3c3af70f879eab5fd2f429eae3c7"
server_key_version: "encryptionkey@0"
I20260809 19:12:29.513022 31244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:12:29.530407 31244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:12:29.533880 31244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:12:29.534116 31244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:12:29.551244 31244 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:42585
I20260809 19:12:29.551275 31366 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:42585 every 8 connection(s)
I20260809 19:12:29.552657 31244 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:12:29.559297 31370 sys_catalog.cc:263] Verifying existing consensus state
I20260809 19:12:29.560618 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 31244
I20260809 19:12:29.561623 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.1:40013
--local_ip_for_outbound_sockets=127.7.39.1
--tserver_master_addrs=127.7.39.62:42585
--webserver_port=33677
--webserver_interface=127.7.39.1
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:32953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 19:12:29.563540 31370 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f: Bootstrap starting.
I20260809 19:12:29.585546 31370 log.cc:824] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f: Log is configured to *not* fsync() on all Append() calls
I20260809 19:12:29.601651 31370 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 19:12:29.602133 31370 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f: Bootstrap complete.
I20260809 19:12:29.610968 31370 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cafbefbc00f4a9db26e582141e6d80f" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 42585 } }
I20260809 19:12:29.611871 31370 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cafbefbc00f4a9db26e582141e6d80f, State: Initialized, Role: FOLLOWER
I20260809 19:12:29.612435 31370 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cafbefbc00f4a9db26e582141e6d80f" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 42585 } }
I20260809 19:12:29.612636 31370 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:12:29.612746 31370 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:12:29.612902 31370 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [term 2 FOLLOWER]: Advancing to term 3
I20260809 19:12:29.616734 31370 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cafbefbc00f4a9db26e582141e6d80f" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 42585 } }
I20260809 19:12:29.617200 31370 leader_election.cc:302] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4cafbefbc00f4a9db26e582141e6d80f; no voters:
I20260809 19:12:29.617839 31370 leader_election.cc:288] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 19:12:29.617957 31375 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [term 3 FOLLOWER]: Leader election won for term 3
I20260809 19:12:29.619993 31370 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:12:29.622597 31375 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [term 3 LEADER]: Becoming Leader. State: Replica: 4cafbefbc00f4a9db26e582141e6d80f, State: Running, Role: LEADER
I20260809 19:12:29.623178 31375 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cafbefbc00f4a9db26e582141e6d80f" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 42585 } }
I20260809 19:12:29.625747 31378 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "4cafbefbc00f4a9db26e582141e6d80f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cafbefbc00f4a9db26e582141e6d80f" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 42585 } } }
I20260809 19:12:29.625941 31380 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4cafbefbc00f4a9db26e582141e6d80f. Latest consensus state: current_term: 3 leader_uuid: "4cafbefbc00f4a9db26e582141e6d80f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cafbefbc00f4a9db26e582141e6d80f" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 42585 } } }
I20260809 19:12:29.626142 31378 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [sys.catalog]: This master's current role is: LEADER
I20260809 19:12:29.626230 31380 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cafbefbc00f4a9db26e582141e6d80f [sys.catalog]: This master's current role is: LEADER
I20260809 19:12:29.639165 31388 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:12:29.647540 31388 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:12:29.649081 31388 catalog_manager.cc:1259] Loaded cluster ID: 59b58d30c69b4209abb7d48fc6e3e821
I20260809 19:12:29.649238 31388 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260809 19:12:29.651315 31388 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f52fc5719ad google::LogMessage::Fail() at ??:0
@ 0x7f52fc57488a google::LogMessage::SendToLog() at ??:0
@ 0x7f52fc5714de google::LogMessage::Flush() at ??:0
@ 0x7f52fc572a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f5311fa4512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f5311fa1976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f5312029610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f5312029439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f52ff1bd345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f52ff1c091c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f52ff1c0799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f52ff19beaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f53024756db start_thread at ??:0
@ 0x7f52fb40b61f clone at ??:0
W20260809 19:12:29.942310 31373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:12:29.942566 31373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:12:29.942687 31373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:12:29.949699 31373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:12:29.949792 31373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:12:29.949935 31373 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.1
I20260809 19:12:29.959257 31373 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:32953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.1:40013
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.39.1
--webserver_port=33677
--tserver_master_addrs=127.7.39.62:42585
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.1
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:12:29.960415 31373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:12:29.961660 31373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:12:29.973829 31434 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:29.973896 31437 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:29.973873 31435 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:12:29.974927 31373 server_base.cc:1034] running on GCE node
I20260809 19:12:29.975481 31373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:12:29.976342 31373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:12:29.977555 31373 hybrid_clock.cc:648] HybridClock initialized: now 1786302749977506 us; error 50 us; skew 500 ppm
I20260809 19:12:29.977869 31373 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:12:29 dist-test-slave-4tdj krb5kdc[29381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302749, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:12:29.980773 31373 init.cc:377] Logged in from keytab as kudu/127.7.39.1@KRBTEST.COM (short username kudu)
I20260809 19:12:29.982072 31373 webserver.cc:460] Webserver started at http://127.7.39.1:33677/ using document root <none> and password file <none>
I20260809 19:12:29.982721 31373 fs_manager.cc:359] Metadata directory not provided
I20260809 19:12:29.982822 31373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:12:29.987767 31373 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260809 19:12:29.990365 31444 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:29.991601 31373 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 19:12:29.991737 31373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/wal
uuid: "ee9bb8e9c0824cc8937a25de0118a76c"
format_stamp: "Formatted at 2026-08-09 19:12:24 on dist-test-slave-4tdj"
server_key: "da540ae42911d9201eed7c254aeb5131"
server_key_iv: "c0f24b16e95e6baa27ca015284886dd6"
server_key_version: "encryptionkey@0"
I20260809 19:12:29.992640 31373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:12:30.006960 31373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:12:30.011113 31373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:12:30.011384 31373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:12:30.012355 31373 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:12:30.013625 31373 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:12:30.013721 31373 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:30.013825 31373 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:12:30.013902 31373 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:30.044744 31373 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.1:40013
I20260809 19:12:30.044819 31652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.1:40013 every 8 connection(s)
I20260809 19:12:30.046175 31373 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
I20260809 19:12:30.049240 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 31373
I20260809 19:12:30.049858 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.2:41131
--local_ip_for_outbound_sockets=127.7.39.2
--tserver_master_addrs=127.7.39.62:42585
--webserver_port=38387
--webserver_interface=127.7.39.2
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:32953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 19:12:30.051126 31659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:30.049066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.1:37889)
0809 19:12:30.049908 (+ 842us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:30.050158 (+ 250us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":341,"threads_started":1}
W20260809 19:12:30.051797 31653 heartbeater.cc:644] Failed to heartbeat to 127.7.39.62:42585 (0 consecutive failures): Network error: Failed to ping master at 127.7.39.62:42585: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
I20260809 19:12:30.052597 31659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:30.052288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.1:51391)
0809 19:12:30.052417 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:30.052481 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260809 19:12:30.053366 31659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:30.053062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.1:47941)
0809 19:12:30.053192 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:30.053262 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 19:12:30.053584 31653 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 19:12:30.372028 31664 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:12:30.372290 31664 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:12:30.372421 31664 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:12:30.379369 31664 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:12:30.379473 31664 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:12:30.379626 31664 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.2
I20260809 19:12:30.388728 31664 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:32953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.2:41131
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.39.2
--webserver_port=38387
--tserver_master_addrs=127.7.39.62:42585
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.2
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:12:30.389889 31664 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:12:30.391168 31664 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:12:30.403460 31680 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:30.403493 31676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:30.403388 31678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:12:30.404292 31664 server_base.cc:1034] running on GCE node
I20260809 19:12:30.404884 31664 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:12:30.405767 31664 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:12:30.406955 31664 hybrid_clock.cc:648] HybridClock initialized: now 1786302750406899 us; error 49 us; skew 500 ppm
I20260809 19:12:30.407245 31664 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:12:30 dist-test-slave-4tdj krb5kdc[29381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302750, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:12:30.410138 31664 init.cc:377] Logged in from keytab as kudu/127.7.39.2@KRBTEST.COM (short username kudu)
I20260809 19:12:30.411569 31664 webserver.cc:460] Webserver started at http://127.7.39.2:38387/ using document root <none> and password file <none>
I20260809 19:12:30.412199 31664 fs_manager.cc:359] Metadata directory not provided
I20260809 19:12:30.412312 31664 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:12:30.417443 31664 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.002s
I20260809 19:12:30.420099 31694 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:30.421387 31664 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 19:12:30.421558 31664 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/wal
uuid: "265511151d1b4ca5ab3b2e0a4e98cb54"
format_stamp: "Formatted at 2026-08-09 19:12:25 on dist-test-slave-4tdj"
server_key: "3b914c4b81671233a71c81f9b7fce572"
server_key_iv: "8fcfc7ba9d0c2eb6a37429178d89017b"
server_key_version: "encryptionkey@0"
I20260809 19:12:30.422544 31664 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:12:30.438836 31664 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:12:30.442459 31664 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:12:30.442708 31664 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:12:30.443630 31664 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:12:30.444890 31664 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:12:30.444986 31664 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:30.445086 31664 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:12:30.445160 31664 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:30.474905 31664 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.2:41131
I20260809 19:12:30.474957 31890 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.2:41131 every 8 connection(s)
I20260809 19:12:30.476276 31664 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
I20260809 19:12:30.480886 31893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:30.479142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.2:46391)
0809 19:12:30.479861 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:30.480046 (+ 185us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":272,"threads_started":1}
W20260809 19:12:30.481570 31891 heartbeater.cc:644] Failed to heartbeat to 127.7.39.62:42585 (0 consecutive failures): Network error: Failed to ping master at 127.7.39.62:42585: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
I20260809 19:12:30.482384 31893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:30.482017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.2:38877)
0809 19:12:30.482173 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:30.482241 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260809 19:12:30.482923 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 31664
I20260809 19:12:30.483258 31893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:30.482894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.2:46089)
0809 19:12:30.483040 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:30.483129 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 19:12:30.483482 31891 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 19:12:30.483686 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.3:39983
--local_ip_for_outbound_sockets=127.7.39.3
--tserver_master_addrs=127.7.39.62:42585
--webserver_port=40621
--webserver_interface=127.7.39.3
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:32953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:12:30.801311 31895 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:12:30.801592 31895 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:12:30.801756 31895 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:12:30.808908 31895 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:12:30.809000 31895 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:12:30.809141 31895 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.3
I20260809 19:12:30.818495 31895 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:32953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.3:39983
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.39.3
--webserver_port=40621
--tserver_master_addrs=127.7.39.62:42585
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.3
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:12:30.819628 31895 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:12:30.820861 31895 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:12:30.832970 31905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:30.833041 31903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:30.833065 31902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:12:30.833968 31895 server_base.cc:1034] running on GCE node
I20260809 19:12:30.834542 31895 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:12:30.835376 31895 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:12:30.836575 31895 hybrid_clock.cc:648] HybridClock initialized: now 1786302750836524 us; error 63 us; skew 500 ppm
I20260809 19:12:30.836850 31895 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:12:30 dist-test-slave-4tdj krb5kdc[29381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302750, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:12:30.839737 31895 init.cc:377] Logged in from keytab as kudu/127.7.39.3@KRBTEST.COM (short username kudu)
I20260809 19:12:30.841023 31895 webserver.cc:460] Webserver started at http://127.7.39.3:40621/ using document root <none> and password file <none>
I20260809 19:12:30.841640 31895 fs_manager.cc:359] Metadata directory not provided
I20260809 19:12:30.841753 31895 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:12:30.846732 31895 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 19:12:30.849201 31916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:30.850442 31895 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:12:30.850581 31895 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/wal
uuid: "bcd9fcfcf5394392bd535606d932097b"
format_stamp: "Formatted at 2026-08-09 19:12:25 on dist-test-slave-4tdj"
server_key: "8641fd7861526374beb816fb90b1a8f3"
server_key_iv: "180ec943c6af84abafee0121d86e136c"
server_key_version: "encryptionkey@0"
I20260809 19:12:30.851472 31895 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:12:30.876988 31895 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:12:30.880466 31895 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:12:30.880709 31895 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:12:30.881621 31895 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:12:30.882863 31895 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:12:30.882956 31895 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:30.883064 31895 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:12:30.883139 31895 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:30.913084 31895 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.3:39983
I20260809 19:12:30.913149 32106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.3:39983 every 8 connection(s)
I20260809 19:12:30.914494 31895 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
I20260809 19:12:30.916963 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 31895
I20260809 19:12:30.919456 32110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:30.917296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.3:45295)
0809 19:12:30.918111 (+ 815us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:30.918415 (+ 304us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":288,"threads_started":1}
W20260809 19:12:30.920025 32107 heartbeater.cc:644] Failed to heartbeat to 127.7.39.62:42585 (0 consecutive failures): Network error: Failed to ping master at 127.7.39.62:42585: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
I20260809 19:12:30.920738 32110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:30.920451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.3:56887)
0809 19:12:30.920579 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:30.920641 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 19:12:30.921444 32110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:30.921186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.3:52053)
0809 19:12:30.921284 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:30.921350 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260809 19:12:30.921666 32107 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 19:12:31.054906 32112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:31.054084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.1:34217)
0809 19:12:31.054597 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:31.054685 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":266,"threads_started":1}
I20260809 19:12:31.484771 32115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:31.483962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.2:34695)
0809 19:12:31.484414 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:31.484529 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":216,"threads_started":1}
I20260809 19:12:31.922865 32116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:31.922106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.3:34923)
0809 19:12:31.922560 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:31.922642 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":228,"threads_started":1}
I20260809 19:12:32.056393 32118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:32.055717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.1:43355)
0809 19:12:32.056153 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:32.056236 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":221,"threads_started":1}
I20260809 19:12:32.486395 32119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:32.485602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.2:51177)
0809 19:12:32.486088 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:32.486176 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":239,"threads_started":1}
I20260809 19:12:32.924316 32120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:32.923631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.3:54547)
0809 19:12:32.924079 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:32.924156 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":216,"threads_started":1}
I20260809 19:12:33.057828 32121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:33.057155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.1:44059)
0809 19:12:33.057585 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:33.057662 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":215,"threads_started":1}
I20260809 19:12:33.487923 32123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:33.487247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.2:39181)
0809 19:12:33.487684 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:33.487758 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":227,"threads_started":1}
I20260809 19:12:33.925773 32124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:33.925064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.3:42167)
0809 19:12:33.925512 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:33.925606 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":250,"threads_started":1}
I20260809 19:12:34.059302 32125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:34.058621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.1:43257)
0809 19:12:34.059044 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:34.059119 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":209,"threads_started":1}
I20260809 19:12:34.489548 32126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:34.488807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.2:53445)
0809 19:12:34.489279 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:34.489358 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":237,"threads_started":1}
I20260809 19:12:34.927263 32128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:34.926521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.3:51365)
0809 19:12:34.926982 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:34.927071 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":212,"threads_started":1}
I20260809 19:12:35.060781 32129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:35.060097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.1:48073)
0809 19:12:35.060540 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:35.060617 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":226,"threads_started":1}
I20260809 19:12:35.491179 32130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:35.490375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.2:37677)
0809 19:12:35.490904 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:35.490998 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":288,"threads_started":1}
I20260809 19:12:35.928761 32132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:35.928051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.3:41593)
0809 19:12:35.928517 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:35.928597 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":252,"threads_started":1}
I20260809 19:12:36.062244 32133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:36.061567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.1:46937)
0809 19:12:36.062009 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:36.062092 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":243,"threads_started":1}
I20260809 19:12:36.492652 32134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:36.491929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.2:38753)
0809 19:12:36.492381 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:36.492489 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":241,"threads_started":1}
I20260809 19:12:36.930214 32135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:36.929494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.3:48865)
0809 19:12:36.929954 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:36.930064 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":226,"threads_started":1}
I20260809 19:12:37.063840 32136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:37.063037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.1:55681)
0809 19:12:37.063549 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:37.063627 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":250,"threads_started":1}
I20260809 19:12:37.494169 32138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:37.493415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.2:46931)
0809 19:12:37.493885 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:37.493959 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":210,"threads_started":1}
I20260809 19:12:37.931747 32140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:37.930986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.3:35371)
0809 19:12:37.931462 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:37.931540 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":210,"threads_started":1}
I20260809 19:12:38.065399 32141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:38.064697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.1:57519)
0809 19:12:38.065146 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:38.065239 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":233,"threads_started":1}
I20260809 19:12:38.495776 32144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:38.495027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.2:59649)
0809 19:12:38.495495 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:38.495615 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":225,"threads_started":1}
I20260809 19:12:38.933219 32146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:38.932503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.3:43635)
0809 19:12:38.932963 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:38.933054 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":245,"threads_started":1}
I20260809 19:12:39.067137 32147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:39.066198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.1:37451)
0809 19:12:39.066803 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:39.066911 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":308,"threads_started":1}
I20260809 19:12:39.497270 32149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:39.496562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.2:33283)
0809 19:12:39.497022 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:39.497103 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":212,"threads_started":1}
I20260809 19:12:39.934705 32150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:39.933972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.3:53601)
0809 19:12:39.934453 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:39.934537 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":211,"threads_started":1}
I20260809 19:12:40.068635 32151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:40.067987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.1:60767)
0809 19:12:40.068398 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:40.068474 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":229,"threads_started":1}
I20260809 19:12:40.498843 32153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:40.498132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.2:36351)
0809 19:12:40.498606 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:40.498685 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":260,"threads_started":1}
I20260809 19:12:40.936213 32154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:40.935557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.3:52247)
0809 19:12:40.935976 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:40.936055 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":226,"threads_started":1}
I20260809 19:12:41.070119 32155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:41.069449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.1:37805)
0809 19:12:41.069851 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:41.069942 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":198,"threads_started":1}
I20260809 19:12:41.500265 32156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:41.499612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.2:41767)
0809 19:12:41.500008 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:41.500092 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":206,"threads_started":1}
I20260809 19:12:41.937683 32157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:41.937013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.3:57247)
0809 19:12:41.937428 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:41.937514 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":201,"threads_started":1}
I20260809 19:12:42.071661 32161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:42.070956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.1:39567)
0809 19:12:42.071414 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:42.071499 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":231,"threads_started":1}
I20260809 19:12:42.501713 32165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:42.501063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.2:38717)
0809 19:12:42.501476 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:42.501560 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":213,"threads_started":1}
I20260809 19:12:42.939186 32166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:42.938498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.3:51977)
0809 19:12:42.938917 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:42.939031 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":214,"threads_started":1}
I20260809 19:12:43.073158 32167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:43.072442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.1:50933)
0809 19:12:43.072890 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:43.072971 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":224,"threads_started":1}
I20260809 19:12:43.503254 32168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:43.502521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.2:40353)
0809 19:12:43.502983 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:43.503073 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":219,"threads_started":1}
I20260809 19:12:43.940812 32169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:43.940041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.3:56511)
0809 19:12:43.940520 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:43.940621 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":224,"threads_started":1}
I20260809 19:12:44.074697 32171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:44.073965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.1:44247)
0809 19:12:44.074430 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:44.074515 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":233,"threads_started":1}
I20260809 19:12:44.504642 32172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:44.503991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.2:56513)
0809 19:12:44.504400 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:44.504476 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":198,"threads_started":1}
I20260809 19:12:44.942363 32173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:44.941628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.3:46687)
0809 19:12:44.942068 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:44.942150 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":204,"threads_started":1}
I20260809 19:12:45.076426 32175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:45.075717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.1:41849)
0809 19:12:45.076161 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:45.076241 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":220,"threads_started":1}
I20260809 19:12:45.506326 32178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:45.505600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.2:57475)
0809 19:12:45.506041 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:45.506119 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":218,"threads_started":1}
I20260809 19:12:45.922606 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 31373
I20260809 19:12:45.939895 32179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:45.923693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56628 (local address 127.7.39.1:40013)
0809 19:12:45.924272 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:45.924289 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:45.924332 (+ 43us) server_negotiation.cc:407] Connection header received
0809 19:12:45.926062 (+ 1730us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:45.926072 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:45.926544 (+ 472us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:45.926897 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:45.928338 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:45.929577 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:45.930878 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:45.931528 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:45.931697 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:45.934206 (+ 2509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:45.934214 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:45.934228 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:45.934268 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:45.936838 (+ 2570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:45.937459 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:45.937466 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:45.937472 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:45.937634 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:45.937984 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:45.937987 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:45.937989 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:45.938528 (+ 539us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:45.938821 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:45.939239 (+ 418us) server_negotiation.cc:299] Negotiation successful
0809 19:12:45.939618 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":214,"threads_started":1}
I20260809 19:12:45.941186 31646 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:12:45.945932 32183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:45.943630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42585 (local address 127.7.39.3:35187)
0809 19:12:45.945693 (+ 2063us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:45.945767 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:42585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1957,"thread_start_us":1851,"threads_started":1}
I20260809 19:12:46.023867 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 31373
I20260809 19:12:46.051412 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 31664
I20260809 19:12:46.068378 32185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:46.052344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58632 (local address 127.7.39.2:41131)
0809 19:12:46.052880 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:46.052894 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:46.052932 (+ 38us) server_negotiation.cc:407] Connection header received
0809 19:12:46.054609 (+ 1677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:46.054619 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:46.055081 (+ 462us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:46.055496 (+ 415us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:46.056716 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:46.057940 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:46.059521 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:46.060167 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:46.060291 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:46.062748 (+ 2457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:46.062755 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:46.062774 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:46.062812 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:46.065548 (+ 2736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:46.066094 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:46.066100 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:46.066105 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:46.066260 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:46.066739 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:46.066742 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:46.066744 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:46.067216 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:46.067446 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:46.067719 (+ 273us) server_negotiation.cc:299] Negotiation successful
0809 19:12:46.068095 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":256,"threads_started":1}
I20260809 19:12:46.069696 31885 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:12:46.151546 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 31664
I20260809 19:12:46.175905 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 31895
I20260809 19:12:46.192281 32191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:46.176887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54314 (local address 127.7.39.3:39983)
0809 19:12:46.177450 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:46.177463 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:46.177506 (+ 43us) server_negotiation.cc:407] Connection header received
0809 19:12:46.179229 (+ 1723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:46.179240 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:46.179686 (+ 446us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:46.179975 (+ 289us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:46.181211 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:46.182461 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:46.183650 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:46.184273 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:46.184406 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:46.186804 (+ 2398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:46.186811 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:46.186825 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:46.186865 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:46.189608 (+ 2743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:46.190166 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:46.190173 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:46.190179 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:46.190370 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:46.190658 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:46.190661 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:46.190663 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:46.191136 (+ 473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:46.191358 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:46.191628 (+ 270us) server_negotiation.cc:299] Negotiation successful
0809 19:12:46.191985 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":257,"threads_started":1}
I20260809 19:12:46.193538 32099 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:12:46.274506 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 31895
2026-08-09T19:12:46Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (24161 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:12:46 dist-test-slave-4tdj krb5kdc[32200](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:12:46 dist-test-slave-4tdj krb5kdc[32200](info): set up 2 sockets
Aug 09 19:12:46 dist-test-slave-4tdj krb5kdc[32200](info): commencing operation
krb5kdc: starting...
W20260809 19:12:47.488986 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.170s user 0.002s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:12:47 dist-test-slave-4tdj krb5kdc[32200](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302767, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:12:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:12:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.39.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
I20260809 19:12:47.707499 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:39609
--webserver_interface=127.7.39.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:42951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:39609
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:12:48.025769 32221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:12:48.026048 32221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:12:48.026181 32221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:12:48.033227 32221 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 19:12:48.033318 32221 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 19:12:48.033360 32221 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 19:12:48.033432 32221 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:12:48.033501 32221 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:12:48.033608 32221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:12:48.033667 32221 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:12:48.033743 32221 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:12:48.043476 32221 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:42951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:39609
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:39609
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:12:48.044691 32221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:12:48.046027 32221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:12:48.057340 32230 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:48.057428 32232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:48.057399 32235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:12:48.058352 32221 server_base.cc:1034] running on GCE node
I20260809 19:12:48.059070 32221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:12:48.060321 32221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:12:48.061533 32221 hybrid_clock.cc:648] HybridClock initialized: now 1786302768061465 us; error 39 us; skew 500 ppm
I20260809 19:12:48.061827 32221 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:12:48 dist-test-slave-4tdj krb5kdc[32200](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302768, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:12:48.068621 32221 init.cc:377] Logged in from keytab as kudu/127.7.39.62@KRBTEST.COM (short username kudu)
I20260809 19:12:48.070050 32221 webserver.cc:460] Webserver started at http://127.7.39.62:42409/ using document root <none> and password file <none>
I20260809 19:12:48.070741 32221 fs_manager.cc:359] Metadata directory not provided
I20260809 19:12:48.070828 32221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:12:48.071086 32221 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:12:48.073889 32221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "1b0b7554a35d45659eca0632e44e6fd7"
format_stamp: "Formatted at 2026-08-09 19:12:48 on dist-test-slave-4tdj"
server_key: "2995d2ffd76738940c389ff15fd012e0"
server_key_iv: "1e9d2ad618bf5674a2b80fd5d1cf57bb"
server_key_version: "encryptionkey@0"
I20260809 19:12:48.074640 32221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "1b0b7554a35d45659eca0632e44e6fd7"
format_stamp: "Formatted at 2026-08-09 19:12:48 on dist-test-slave-4tdj"
server_key: "2995d2ffd76738940c389ff15fd012e0"
server_key_iv: "1e9d2ad618bf5674a2b80fd5d1cf57bb"
server_key_version: "encryptionkey@0"
I20260809 19:12:48.079475 32221 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260809 19:12:48.082677 32250 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:48.083896 32221 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:12:48.084025 32221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "1b0b7554a35d45659eca0632e44e6fd7"
format_stamp: "Formatted at 2026-08-09 19:12:48 on dist-test-slave-4tdj"
server_key: "2995d2ffd76738940c389ff15fd012e0"
server_key_iv: "1e9d2ad618bf5674a2b80fd5d1cf57bb"
server_key_version: "encryptionkey@0"
I20260809 19:12:48.084192 32221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:12:48.096228 32221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:12:48.100160 32221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:12:48.100363 32221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:12:48.117628 32221 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:39609
I20260809 19:12:48.117647 32329 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:39609 every 8 connection(s)
I20260809 19:12:48.118947 32221 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:12:48.122633 32330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:12:48.127313 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 32221
I20260809 19:12:48.127506 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:12:48.128170 7324 external_mini_cluster.cc:1428] Setting key 03bff8d5fd4d12be2612b5db75fa38ca
I20260809 19:12:48.134330 32330 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7: Bootstrap starting.
I20260809 19:12:48.137909 32330 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7: Neither blocks nor log segments found. Creating new log.
I20260809 19:12:48.138914 32330 log.cc:824] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7: Log is configured to *not* fsync() on all Append() calls
I20260809 19:12:48.141604 32330 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7: No bootstrap required, opened a new log
Aug 09 19:12:48 dist-test-slave-4tdj krb5kdc[32200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302767, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:12:48.151381 32330 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b0b7554a35d45659eca0632e44e6fd7" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39609 } }
I20260809 19:12:48.151872 32330 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:12:48.151986 32330 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b0b7554a35d45659eca0632e44e6fd7, State: Initialized, Role: FOLLOWER
I20260809 19:12:48.152325 32337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:48.130018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42310 (local address 127.7.39.62:39609)
0809 19:12:48.130879 (+ 861us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:48.130899 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:48.130950 (+ 51us) server_negotiation.cc:407] Connection header received
0809 19:12:48.133262 (+ 2312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:48.133289 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:48.133766 (+ 477us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:48.134171 (+ 405us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:48.135591 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:48.137582 (+ 1991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:48.138976 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:48.139886 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:48.140021 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:48.143797 (+ 3776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:48.143807 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:48.143824 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:48.143871 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:48.147809 (+ 3938us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:48.148499 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:48.148507 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:48.148515 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:48.148735 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:48.149068 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:48.149073 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:48.149076 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:48.149820 (+ 744us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:48.150127 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:48.150478 (+ 351us) server_negotiation.cc:299] Negotiation successful
0809 19:12:48.150907 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":579,"thread_start_us":331,"threads_started":1}
I20260809 19:12:48.152678 32330 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b0b7554a35d45659eca0632e44e6fd7" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39609 } }
I20260809 19:12:48.152923 32330 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:12:48.153071 32330 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:12:48.153232 32330 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:12:48.155573 32330 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b0b7554a35d45659eca0632e44e6fd7" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39609 } }
I20260809 19:12:48.156042 32330 leader_election.cc:302] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1b0b7554a35d45659eca0632e44e6fd7; no voters:
I20260809 19:12:48.156590 32330 leader_election.cc:288] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:12:48.156730 32339 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:12:48.157341 32339 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [term 1 LEADER]: Becoming Leader. State: Replica: 1b0b7554a35d45659eca0632e44e6fd7, State: Running, Role: LEADER
I20260809 19:12:48.157868 32339 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b0b7554a35d45659eca0632e44e6fd7" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39609 } }
I20260809 19:12:48.158746 32330 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:12:48.160986 32342 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1b0b7554a35d45659eca0632e44e6fd7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b0b7554a35d45659eca0632e44e6fd7" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39609 } } }
I20260809 19:12:48.161373 32342 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [sys.catalog]: This master's current role is: LEADER
I20260809 19:12:48.162622 32345 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b0b7554a35d45659eca0632e44e6fd7. Latest consensus state: current_term: 1 leader_uuid: "1b0b7554a35d45659eca0632e44e6fd7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b0b7554a35d45659eca0632e44e6fd7" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39609 } } }
I20260809 19:12:48.163072 32345 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [sys.catalog]: This master's current role is: LEADER
I20260809 19:12:48.164597 32354 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:12:48.169872 32354 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:12:48.178195 32354 catalog_manager.cc:1347] Generated new cluster ID: f2c79448e8cb4ff58c4eea441eac657a
I20260809 19:12:48.178335 32354 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:12:48.207988 32354 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:12:48.209415 32354 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:12:48.217900 32354 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7: Generated new TSK 0
I20260809 19:12:48.218755 32354 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.39.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
I20260809 19:12:48.283524 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.1:0
--local_ip_for_outbound_sockets=127.7.39.1
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:39609
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:42951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:12:48.611116 32380 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:12:48.611392 32380 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:12:48.611532 32380 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:12:48.618551 32380 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:12:48.618672 32380 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:12:48.618830 32380 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.1
I20260809 19:12:48.628300 32380 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:42951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:39609
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.1
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:12:48.629527 32380 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:12:48.630867 32380 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:12:48.643152 32390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:48.643110 32392 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:48.643184 32389 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:12:48.643894 32380 server_base.cc:1034] running on GCE node
I20260809 19:12:48.644464 32380 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:12:48.645358 32380 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:12:48.646551 32380 hybrid_clock.cc:648] HybridClock initialized: now 1786302768646514 us; error 33 us; skew 500 ppm
I20260809 19:12:48.646850 32380 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:12:48 dist-test-slave-4tdj krb5kdc[32200](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302768, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:12:48.649760 32380 init.cc:377] Logged in from keytab as kudu/127.7.39.1@KRBTEST.COM (short username kudu)
I20260809 19:12:48.651185 32380 webserver.cc:460] Webserver started at http://127.7.39.1:36709/ using document root <none> and password file <none>
I20260809 19:12:48.651803 32380 fs_manager.cc:359] Metadata directory not provided
I20260809 19:12:48.651916 32380 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:12:48.652213 32380 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:12:48.655164 32380 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/data/instance:
uuid: "296846bc52c94340a527f868acf50cb9"
format_stamp: "Formatted at 2026-08-09 19:12:48 on dist-test-slave-4tdj"
server_key: "e0fa0d940baa8c4ee4e536437d49af57"
server_key_iv: "d643db34e6c3c679d6f612fa4e4dbb71"
server_key_version: "encryptionkey@0"
I20260809 19:12:48.655884 32380 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance:
uuid: "296846bc52c94340a527f868acf50cb9"
format_stamp: "Formatted at 2026-08-09 19:12:48 on dist-test-slave-4tdj"
server_key: "e0fa0d940baa8c4ee4e536437d49af57"
server_key_iv: "d643db34e6c3c679d6f612fa4e4dbb71"
server_key_version: "encryptionkey@0"
I20260809 19:12:48.660806 32380 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 19:12:48.664142 32407 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:48.665392 32380 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 19:12:48.665515 32380 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/wal
uuid: "296846bc52c94340a527f868acf50cb9"
format_stamp: "Formatted at 2026-08-09 19:12:48 on dist-test-slave-4tdj"
server_key: "e0fa0d940baa8c4ee4e536437d49af57"
server_key_iv: "d643db34e6c3c679d6f612fa4e4dbb71"
server_key_version: "encryptionkey@0"
I20260809 19:12:48.665678 32380 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:12:48.683207 32380 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:12:48.686746 32380 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:12:48.686981 32380 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:12:48.687850 32380 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:12:48.689152 32380 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:12:48.689225 32380 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:48.689309 32380 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:12:48.689353 32380 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:48.719317 32380 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.1:38539
I20260809 19:12:48.719395 32619 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.1:38539 every 8 connection(s)
I20260809 19:12:48.720587 32380 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
I20260809 19:12:48.728055 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 32380
I20260809 19:12:48.728261 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance
I20260809 19:12:48.728907 7324 external_mini_cluster.cc:1428] Setting key cad027be2180a664cecf1c695763857d
Aug 09 19:12:48 dist-test-slave-4tdj krb5kdc[32200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302768, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:12:48.740288 32627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:48.722926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:56177 (local address 127.7.39.62:39609)
0809 19:12:48.723354 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:48.723358 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:48.724230 (+ 872us) server_negotiation.cc:407] Connection header received
0809 19:12:48.725993 (+ 1763us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:48.725999 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:48.726083 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:48.726174 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:48.728008 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:48.728799 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:48.730686 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:48.731128 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:48.731230 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:48.735032 (+ 3802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:48.735036 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:48.735039 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:48.735071 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:48.737437 (+ 2366us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:48.738096 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:48.738100 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:48.738102 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:48.738217 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:48.738648 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:48.738651 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:48.738654 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:48.738902 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:48.739056 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:48.739706 (+ 650us) server_negotiation.cc:299] Negotiation successful
0809 19:12:48.739931 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":227,"threads_started":1}
I20260809 19:12:48.741271 32628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:48.723381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.1:56177)
0809 19:12:48.724082 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:48.724126 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:48.725739 (+ 1613us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:48.726451 (+ 712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:48.726461 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:48.727210 (+ 749us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:12:48.727836 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:48.727853 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:48.728955 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:48.728959 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:48.730393 (+ 1434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:48.730407 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:48.731357 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:48.731365 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:48.731640 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:48.732279 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:12:48.732312 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:12:48.734815 (+ 2503us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:12:48.737567 (+ 2752us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:48.737575 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:48.737590 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:48.737975 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:48.738337 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:48.738342 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:48.738346 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:48.738534 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:48.739028 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:12:48.739035 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:12:48.739332 (+ 297us) client_negotiation.cc:769] Sending connection context
0809 19:12:48.739563 (+ 231us) client_negotiation.cc:240] Negotiation successful
0809 19:12:48.740038 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":286,"threads_started":1}
I20260809 19:12:48.742760 32622 heartbeater.cc:347] Connected to a master server at 127.7.39.62:39609
I20260809 19:12:48.743042 32622 heartbeater.cc:464] Registering TS with master...
I20260809 19:12:48.743714 32622 heartbeater.cc:511] Master 127.7.39.62:39609 requested a full tablet report, sending...
I20260809 19:12:48.745774 32273 ts_manager.cc:194] Registered new tserver with Master: 296846bc52c94340a527f868acf50cb9 (127.7.39.1:38539)
I20260809 19:12:48.747239 32273 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.1@KRBTEST.COM'} at 127.7.39.1:56177
WARNING: no policy specified for kudu/127.7.39.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
I20260809 19:12:48.783634 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.2:0
--local_ip_for_outbound_sockets=127.7.39.2
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:39609
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:42951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:12:49.109046 32632 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:12:49.109334 32632 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:12:49.109504 32632 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:12:49.117009 32632 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:12:49.117130 32632 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:12:49.117328 32632 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.2
I20260809 19:12:49.127164 32632 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:42951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:39609
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.2
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:12:49.128319 32632 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:12:49.129695 32632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:12:49.142387 32644 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:49.142433 32645 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:49.142460 32649 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:12:49.143975 32632 server_base.cc:1034] running on GCE node
I20260809 19:12:49.144682 32632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:12:49.145648 32632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:12:49.146840 32632 hybrid_clock.cc:648] HybridClock initialized: now 1786302769146799 us; error 33 us; skew 500 ppm
I20260809 19:12:49.147145 32632 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:12:49 dist-test-slave-4tdj krb5kdc[32200](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302769, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:12:49.150103 32632 init.cc:377] Logged in from keytab as kudu/127.7.39.2@KRBTEST.COM (short username kudu)
I20260809 19:12:49.151530 32632 webserver.cc:460] Webserver started at http://127.7.39.2:39429/ using document root <none> and password file <none>
I20260809 19:12:49.152172 32632 fs_manager.cc:359] Metadata directory not provided
I20260809 19:12:49.152283 32632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:12:49.152570 32632 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:12:49.155365 32632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/data/instance:
uuid: "a85a90adc4ba4b51a8c0fc0e4110b5dd"
format_stamp: "Formatted at 2026-08-09 19:12:49 on dist-test-slave-4tdj"
server_key: "d5ee79502b62d457784eaa04aa71214a"
server_key_iv: "d5dceb6b4877b352a2921207f9243f24"
server_key_version: "encryptionkey@0"
I20260809 19:12:49.156075 32632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance:
uuid: "a85a90adc4ba4b51a8c0fc0e4110b5dd"
format_stamp: "Formatted at 2026-08-09 19:12:49 on dist-test-slave-4tdj"
server_key: "d5ee79502b62d457784eaa04aa71214a"
server_key_iv: "d5dceb6b4877b352a2921207f9243f24"
server_key_version: "encryptionkey@0"
I20260809 19:12:49.161065 32632 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 19:12:49.164374 32660 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:49.165647 32632 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 19:12:49.165776 32632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/wal
uuid: "a85a90adc4ba4b51a8c0fc0e4110b5dd"
format_stamp: "Formatted at 2026-08-09 19:12:49 on dist-test-slave-4tdj"
server_key: "d5ee79502b62d457784eaa04aa71214a"
server_key_iv: "d5dceb6b4877b352a2921207f9243f24"
server_key_version: "encryptionkey@0"
I20260809 19:12:49.165940 32632 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:12:49.183599 32632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:12:49.187083 32632 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:12:49.187301 32632 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:12:49.188158 32632 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:12:49.189404 32632 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:12:49.189473 32632 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:49.189558 32632 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:12:49.189599 32632 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:49.219551 32632 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.2:35517
I20260809 19:12:49.219619 392 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.2:35517 every 8 connection(s)
I20260809 19:12:49.220701 32632 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
I20260809 19:12:49.226989 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 32632
I20260809 19:12:49.227195 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance
I20260809 19:12:49.227772 7324 external_mini_cluster.cc:1428] Setting key ffc4537a0148fe7d5264802e805b0b60
Aug 09 19:12:49 dist-test-slave-4tdj krb5kdc[32200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302769, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:12:49.240474 32627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:49.223080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:47895 (local address 127.7.39.62:39609)
0809 19:12:49.223288 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:49.223294 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:49.224436 (+ 1142us) server_negotiation.cc:407] Connection header received
0809 19:12:49.226156 (+ 1720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:49.226160 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:49.226228 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:49.226341 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:49.228209 (+ 1868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:49.229023 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:49.230807 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:49.231407 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:49.231534 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:49.234671 (+ 3137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:49.234677 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:49.234681 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:49.234717 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:49.237615 (+ 2898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:49.238275 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:49.238279 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:49.238282 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:49.238461 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:49.238870 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:49.238874 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:49.238876 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:49.239133 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:49.239279 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:49.239921 (+ 642us) server_negotiation.cc:299] Negotiation successful
0809 19:12:49.240157 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 19:12:49.241333 399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:49.223581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.2:47895)
0809 19:12:49.224282 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:49.224324 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:49.225917 (+ 1593us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:49.226520 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:49.226528 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:49.227271 (+ 743us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:12:49.228040 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:49.228067 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:49.229176 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:49.229181 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:49.230666 (+ 1485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:49.230678 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:49.231595 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:49.231601 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:49.231782 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:49.232377 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:12:49.232398 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:12:49.234457 (+ 2059us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:12:49.237738 (+ 3281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:49.237744 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:49.237755 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:49.238155 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:49.238554 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:49.238557 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:49.238559 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:49.238746 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:49.239270 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:12:49.239278 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:12:49.239566 (+ 288us) client_negotiation.cc:769] Sending connection context
0809 19:12:49.239786 (+ 220us) client_negotiation.cc:240] Negotiation successful
0809 19:12:49.240268 (+ 482us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":270,"threads_started":1}
I20260809 19:12:49.242712 394 heartbeater.cc:347] Connected to a master server at 127.7.39.62:39609
I20260809 19:12:49.242983 394 heartbeater.cc:464] Registering TS with master...
I20260809 19:12:49.243644 394 heartbeater.cc:511] Master 127.7.39.62:39609 requested a full tablet report, sending...
I20260809 19:12:49.245100 32273 ts_manager.cc:194] Registered new tserver with Master: a85a90adc4ba4b51a8c0fc0e4110b5dd (127.7.39.2:35517)
I20260809 19:12:49.246131 32273 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.2@KRBTEST.COM'} at 127.7.39.2:47895
WARNING: no policy specified for kudu/127.7.39.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
I20260809 19:12:49.283417 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.3:0
--local_ip_for_outbound_sockets=127.7.39.3
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:39609
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:42951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:12:49.601351 403 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:12:49.601619 403 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:12:49.601753 403 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:12:49.608844 403 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:12:49.608952 403 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:12:49.609098 403 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.3
I20260809 19:12:49.618336 403 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:42951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:39609
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.3
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:12:49.619488 403 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:12:49.620728 403 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:12:49.632879 413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:49.632939 414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:12:49.632905 418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:12:49.633869 403 server_base.cc:1034] running on GCE node
I20260809 19:12:49.634449 403 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:12:49.635298 403 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:12:49.636492 403 hybrid_clock.cc:648] HybridClock initialized: now 1786302769636445 us; error 39 us; skew 500 ppm
I20260809 19:12:49.636767 403 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:12:49 dist-test-slave-4tdj krb5kdc[32200](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302769, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:12:49.639690 403 init.cc:377] Logged in from keytab as kudu/127.7.39.3@KRBTEST.COM (short username kudu)
I20260809 19:12:49.641093 403 webserver.cc:460] Webserver started at http://127.7.39.3:43793/ using document root <none> and password file <none>
I20260809 19:12:49.641780 403 fs_manager.cc:359] Metadata directory not provided
I20260809 19:12:49.641891 403 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:12:49.642198 403 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:12:49.644928 403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/data/instance:
uuid: "1b9580420508435a861cee7610aeb01f"
format_stamp: "Formatted at 2026-08-09 19:12:49 on dist-test-slave-4tdj"
server_key: "8ad041f0f1ea27118ea10b1019dd9ced"
server_key_iv: "f9000d12aec8874c98e7c84f99747c69"
server_key_version: "encryptionkey@0"
I20260809 19:12:49.645660 403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance:
uuid: "1b9580420508435a861cee7610aeb01f"
format_stamp: "Formatted at 2026-08-09 19:12:49 on dist-test-slave-4tdj"
server_key: "8ad041f0f1ea27118ea10b1019dd9ced"
server_key_iv: "f9000d12aec8874c98e7c84f99747c69"
server_key_version: "encryptionkey@0"
I20260809 19:12:49.650481 403 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 19:12:49.653679 432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:49.654874 403 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 19:12:49.655016 403 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/wal
uuid: "1b9580420508435a861cee7610aeb01f"
format_stamp: "Formatted at 2026-08-09 19:12:49 on dist-test-slave-4tdj"
server_key: "8ad041f0f1ea27118ea10b1019dd9ced"
server_key_iv: "f9000d12aec8874c98e7c84f99747c69"
server_key_version: "encryptionkey@0"
I20260809 19:12:49.655192 403 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:12:49.670187 403 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:12:49.673727 403 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:12:49.673982 403 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:12:49.674866 403 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:12:49.676074 403 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:12:49.676151 403 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:49.676262 403 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:12:49.676318 403 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:12:49.705514 403 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.3:35861
I20260809 19:12:49.705550 611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.3:35861 every 8 connection(s)
I20260809 19:12:49.706692 403 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
I20260809 19:12:49.713598 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 403
I20260809 19:12:49.713768 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance
I20260809 19:12:49.714172 7324 external_mini_cluster.cc:1428] Setting key a0fa6bdadbc00d3ba48b213a33f7b6c7
Aug 09 19:12:49 dist-test-slave-4tdj krb5kdc[32200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302769, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:12:49.725222 32627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:49.708954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:42605 (local address 127.7.39.62:39609)
0809 19:12:49.709174 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:49.709180 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:49.710220 (+ 1040us) server_negotiation.cc:407] Connection header received
0809 19:12:49.711919 (+ 1699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:49.711924 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:49.711993 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:49.712079 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:49.713422 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:49.714247 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:49.716190 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:49.716612 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:49.716732 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:49.719967 (+ 3235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:49.719972 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:49.719975 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:49.720007 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:49.722490 (+ 2483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:49.723125 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:49.723129 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:49.723132 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:49.723254 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:49.723638 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:49.723643 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:49.723646 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:49.723906 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:49.724034 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:49.724667 (+ 633us) server_negotiation.cc:299] Negotiation successful
0809 19:12:49.724886 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 19:12:49.725978 614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:49.709391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.3:42605)
0809 19:12:49.710071 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:49.710106 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:49.711695 (+ 1589us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:49.712247 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:49.712254 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:49.712744 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:12:49.713263 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:49.713284 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:49.714415 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:49.714421 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:49.716048 (+ 1627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:49.716062 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:49.716841 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:49.716848 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:49.717078 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:49.717617 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:12:49.717638 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:12:49.719773 (+ 2135us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:12:49.722614 (+ 2841us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:49.722622 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:49.722636 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:49.723010 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:49.723354 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:12:49.723359 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:12:49.723363 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:12:49.723534 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:12:49.724024 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:12:49.724031 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:12:49.724312 (+ 281us) client_negotiation.cc:769] Sending connection context
0809 19:12:49.724528 (+ 216us) client_negotiation.cc:240] Negotiation successful
0809 19:12:49.724966 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":277,"threads_started":1}
I20260809 19:12:49.727166 612 heartbeater.cc:347] Connected to a master server at 127.7.39.62:39609
I20260809 19:12:49.727460 612 heartbeater.cc:464] Registering TS with master...
I20260809 19:12:49.728273 612 heartbeater.cc:511] Master 127.7.39.62:39609 requested a full tablet report, sending...
I20260809 19:12:49.729671 32273 ts_manager.cc:194] Registered new tserver with Master: 1b9580420508435a861cee7610aeb01f (127.7.39.3:35861)
I20260809 19:12:49.730471 32273 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.3@KRBTEST.COM'} at 127.7.39.3:42605
I20260809 19:12:49.740908 7324 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 19:12:49.749892 32622 heartbeater.cc:503] Master 127.7.39.62:39609 was elected leader, sending a full tablet report...
I20260809 19:12:49.757004 32627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:49.745203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42320 (local address 127.7.39.62:39609)
0809 19:12:49.745361 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:49.745366 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:49.745786 (+ 420us) server_negotiation.cc:407] Connection header received
0809 19:12:49.745955 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:49.745958 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:49.746012 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:49.746091 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:49.747557 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:49.748224 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:49.749540 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:49.750070 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:49.750196 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:49.752685 (+ 2489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:49.752689 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:49.752692 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:49.752721 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:49.754933 (+ 2212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:49.755541 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:49.755544 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:49.755546 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:49.755645 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:49.755899 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:49.755901 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:49.755903 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:49.756180 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:49.756361 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:49.756581 (+ 220us) server_negotiation.cc:299] Negotiation successful
0809 19:12:49.756741 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 19:12:49.760592 32273 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42320:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:12:49.767320 32273 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:12:49.807464 632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:49.778360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:35861 (local address 127.0.0.1:34528)
0809 19:12:49.793398 (+ 15038us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:49.793451 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:49.793636 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:49.801164 (+ 7528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:49.801168 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:49.801193 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:12:49.801580 (+ 387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:49.801593 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:49.803388 (+ 1795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:49.803394 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:49.805054 (+ 1660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:49.805069 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:49.806641 (+ 1572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:49.806649 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:49.806806 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:49.806840 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 19:12:49.806922 (+ 82us) client_negotiation.cc:240] Negotiation successful
0809 19:12:49.807054 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14777,"mutex_wait_us":71,"thread_start_us":15448,"threads_started":1}
I20260809 19:12:49.808096 639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:49.778512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:35517 (local address 127.0.0.1:60162)
0809 19:12:49.799198 (+ 20686us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:49.799217 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:49.799340 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:49.800268 (+ 928us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:49.800276 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:49.800303 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:12:49.800735 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:49.800750 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:49.802523 (+ 1773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:49.802529 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:49.804877 (+ 2348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:49.804891 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:49.806324 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:49.806332 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:49.806508 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:49.806580 (+ 72us) client_negotiation.cc:769] Sending connection context
0809 19:12:49.806707 (+ 127us) client_negotiation.cc:240] Negotiation successful
0809 19:12:49.806878 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20553,"mutex_wait_us":25,"thread_start_us":22482,"threads_started":1}
I20260809 19:12:49.808279 633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:49.778490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34528 (local address 127.7.39.3:35861)
0809 19:12:49.800321 (+ 21831us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:49.800331 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:49.800364 (+ 33us) server_negotiation.cc:407] Connection header received
0809 19:12:49.800460 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:49.800468 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:49.800693 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:49.800883 (+ 190us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:12:49.801774 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:49.803250 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:49.805219 (+ 1969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:49.806431 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:49.806545 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:49.807756 (+ 1211us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:49.807824 (+ 68us) server_negotiation.cc:299] Negotiation successful
0809 19:12:49.807979 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21589,"thread_start_us":22171,"threads_started":1}
I20260809 19:12:49.808429 641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:49.779063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60162 (local address 127.7.39.2:35517)
0809 19:12:49.798778 (+ 19715us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:49.798788 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:49.799458 (+ 670us) server_negotiation.cc:407] Connection header received
0809 19:12:49.799581 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:49.799590 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:49.799839 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:49.800013 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:12:49.800910 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:49.802373 (+ 1463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:49.805041 (+ 2668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:49.806115 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:49.806242 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:49.806465 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:49.807170 (+ 705us) server_negotiation.cc:299] Negotiation successful
0809 19:12:49.807342 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19539,"thread_start_us":19410,"threads_started":1}
I20260809 19:12:49.808550 637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:49.778990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:38539 (local address 127.0.0.1:47230)
0809 19:12:49.801275 (+ 22285us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:49.801295 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:49.801419 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:49.801947 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:49.801951 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:49.801974 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:12:49.802355 (+ 381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:49.802368 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:49.803693 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:49.803699 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:49.805750 (+ 2051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:49.805764 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:49.807783 (+ 2019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:49.807789 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:49.807947 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:49.807982 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 19:12:49.808073 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 19:12:49.808192 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22146,"mutex_wait_us":20,"thread_start_us":19929,"threads_started":1}
I20260809 19:12:49.809154 642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:49.779607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47230 (local address 127.7.39.1:38539)
0809 19:12:49.799619 (+ 20012us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:49.799628 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:49.801405 (+ 1777us) server_negotiation.cc:407] Connection header received
0809 19:12:49.801577 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:49.801583 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:49.801790 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:49.801944 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:12:49.802493 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:49.803548 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:49.805911 (+ 2363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:49.807371 (+ 1460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:49.807490 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:49.808074 (+ 584us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:49.808140 (+ 66us) server_negotiation.cc:299] Negotiation successful
0809 19:12:49.808921 (+ 781us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19832,"thread_start_us":20020,"threads_started":1}
I20260809 19:12:49.811741 512 tablet_service.cc:1467] Processing CreateTablet for tablet 8f02c94bc9b24d1c821dbdedbef8642e (DEFAULT_TABLE table=test-table [id=8e2233746ef943239ab6b57fe86ec802]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:12:49.812894 512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f02c94bc9b24d1c821dbdedbef8642e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:12:49.812604 32504 tablet_service.cc:1467] Processing CreateTablet for tablet 8f02c94bc9b24d1c821dbdedbef8642e (DEFAULT_TABLE table=test-table [id=8e2233746ef943239ab6b57fe86ec802]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:12:49.812604 32751 tablet_service.cc:1467] Processing CreateTablet for tablet 8f02c94bc9b24d1c821dbdedbef8642e (DEFAULT_TABLE table=test-table [id=8e2233746ef943239ab6b57fe86ec802]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:12:49.813930 32504 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f02c94bc9b24d1c821dbdedbef8642e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:12:49.813930 32751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f02c94bc9b24d1c821dbdedbef8642e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:12:49.823491 644 tablet_bootstrap.cc:492] T 8f02c94bc9b24d1c821dbdedbef8642e P 1b9580420508435a861cee7610aeb01f: Bootstrap starting.
I20260809 19:12:49.827203 644 tablet_bootstrap.cc:654] T 8f02c94bc9b24d1c821dbdedbef8642e P 1b9580420508435a861cee7610aeb01f: Neither blocks nor log segments found. Creating new log.
I20260809 19:12:49.827634 648 tablet_bootstrap.cc:492] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9: Bootstrap starting.
I20260809 19:12:49.828449 650 tablet_bootstrap.cc:492] T 8f02c94bc9b24d1c821dbdedbef8642e P a85a90adc4ba4b51a8c0fc0e4110b5dd: Bootstrap starting.
I20260809 19:12:49.829273 644 log.cc:824] T 8f02c94bc9b24d1c821dbdedbef8642e P 1b9580420508435a861cee7610aeb01f: Log is configured to *not* fsync() on all Append() calls
I20260809 19:12:49.830848 648 tablet_bootstrap.cc:654] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9: Neither blocks nor log segments found. Creating new log.
I20260809 19:12:49.831353 650 tablet_bootstrap.cc:654] T 8f02c94bc9b24d1c821dbdedbef8642e P a85a90adc4ba4b51a8c0fc0e4110b5dd: Neither blocks nor log segments found. Creating new log.
I20260809 19:12:49.832044 648 log.cc:824] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9: Log is configured to *not* fsync() on all Append() calls
I20260809 19:12:49.832259 650 log.cc:824] T 8f02c94bc9b24d1c821dbdedbef8642e P a85a90adc4ba4b51a8c0fc0e4110b5dd: Log is configured to *not* fsync() on all Append() calls
I20260809 19:12:49.832346 644 tablet_bootstrap.cc:492] T 8f02c94bc9b24d1c821dbdedbef8642e P 1b9580420508435a861cee7610aeb01f: No bootstrap required, opened a new log
I20260809 19:12:49.832623 644 ts_tablet_manager.cc:1397] T 8f02c94bc9b24d1c821dbdedbef8642e P 1b9580420508435a861cee7610aeb01f: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260809 19:12:49.834844 648 tablet_bootstrap.cc:492] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9: No bootstrap required, opened a new log
I20260809 19:12:49.835108 648 ts_tablet_manager.cc:1397] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260809 19:12:49.835165 650 tablet_bootstrap.cc:492] T 8f02c94bc9b24d1c821dbdedbef8642e P a85a90adc4ba4b51a8c0fc0e4110b5dd: No bootstrap required, opened a new log
I20260809 19:12:49.835391 650 ts_tablet_manager.cc:1397] T 8f02c94bc9b24d1c821dbdedbef8642e P a85a90adc4ba4b51a8c0fc0e4110b5dd: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260809 19:12:49.840200 644 raft_consensus.cc:348] T 8f02c94bc9b24d1c821dbdedbef8642e P 1b9580420508435a861cee7610aeb01f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b9580420508435a861cee7610aeb01f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 35861 } } peers { permanent_uuid: "a85a90adc4ba4b51a8c0fc0e4110b5dd" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35517 } } peers { permanent_uuid: "296846bc52c94340a527f868acf50cb9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38539 } }
I20260809 19:12:49.840535 644 raft_consensus.cc:374] T 8f02c94bc9b24d1c821dbdedbef8642e P 1b9580420508435a861cee7610aeb01f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:12:49.840631 644 raft_consensus.cc:729] T 8f02c94bc9b24d1c821dbdedbef8642e P 1b9580420508435a861cee7610aeb01f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b9580420508435a861cee7610aeb01f, State: Initialized, Role: FOLLOWER
I20260809 19:12:49.841179 644 consensus_queue.cc:260] T 8f02c94bc9b24d1c821dbdedbef8642e P 1b9580420508435a861cee7610aeb01f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b9580420508435a861cee7610aeb01f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 35861 } } peers { permanent_uuid: "a85a90adc4ba4b51a8c0fc0e4110b5dd" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35517 } } peers { permanent_uuid: "296846bc52c94340a527f868acf50cb9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38539 } }
I20260809 19:12:49.842149 612 heartbeater.cc:503] Master 127.7.39.62:39609 was elected leader, sending a full tablet report...
I20260809 19:12:49.845201 648 raft_consensus.cc:348] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b9580420508435a861cee7610aeb01f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 35861 } } peers { permanent_uuid: "a85a90adc4ba4b51a8c0fc0e4110b5dd" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35517 } } peers { permanent_uuid: "296846bc52c94340a527f868acf50cb9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38539 } }
I20260809 19:12:49.845201 650 raft_consensus.cc:348] T 8f02c94bc9b24d1c821dbdedbef8642e P a85a90adc4ba4b51a8c0fc0e4110b5dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b9580420508435a861cee7610aeb01f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 35861 } } peers { permanent_uuid: "a85a90adc4ba4b51a8c0fc0e4110b5dd" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35517 } } peers { permanent_uuid: "296846bc52c94340a527f868acf50cb9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38539 } }
I20260809 19:12:49.845628 648 raft_consensus.cc:374] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:12:49.845628 650 raft_consensus.cc:374] T 8f02c94bc9b24d1c821dbdedbef8642e P a85a90adc4ba4b51a8c0fc0e4110b5dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:12:49.845726 650 raft_consensus.cc:729] T 8f02c94bc9b24d1c821dbdedbef8642e P a85a90adc4ba4b51a8c0fc0e4110b5dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a85a90adc4ba4b51a8c0fc0e4110b5dd, State: Initialized, Role: FOLLOWER
I20260809 19:12:49.845726 648 raft_consensus.cc:729] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 296846bc52c94340a527f868acf50cb9, State: Initialized, Role: FOLLOWER
I20260809 19:12:49.846004 644 ts_tablet_manager.cc:1428] T 8f02c94bc9b24d1c821dbdedbef8642e P 1b9580420508435a861cee7610aeb01f: Time spent starting tablet: real 0.013s user 0.000s sys 0.012s
I20260809 19:12:49.846308 648 consensus_queue.cc:260] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b9580420508435a861cee7610aeb01f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 35861 } } peers { permanent_uuid: "a85a90adc4ba4b51a8c0fc0e4110b5dd" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35517 } } peers { permanent_uuid: "296846bc52c94340a527f868acf50cb9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38539 } }
I20260809 19:12:49.846329 650 consensus_queue.cc:260] T 8f02c94bc9b24d1c821dbdedbef8642e P a85a90adc4ba4b51a8c0fc0e4110b5dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b9580420508435a861cee7610aeb01f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 35861 } } peers { permanent_uuid: "a85a90adc4ba4b51a8c0fc0e4110b5dd" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35517 } } peers { permanent_uuid: "296846bc52c94340a527f868acf50cb9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38539 } }
I20260809 19:12:49.848453 394 heartbeater.cc:503] Master 127.7.39.62:39609 was elected leader, sending a full tablet report...
I20260809 19:12:49.848759 648 ts_tablet_manager.cc:1428] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9: Time spent starting tablet: real 0.014s user 0.009s sys 0.004s
I20260809 19:12:49.849010 650 ts_tablet_manager.cc:1428] T 8f02c94bc9b24d1c821dbdedbef8642e P a85a90adc4ba4b51a8c0fc0e4110b5dd: Time spent starting tablet: real 0.014s user 0.010s sys 0.004s
I20260809 19:12:49.886826 656 raft_consensus.cc:482] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:12:49.887091 656 raft_consensus.cc:504] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b9580420508435a861cee7610aeb01f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 35861 } } peers { permanent_uuid: "a85a90adc4ba4b51a8c0fc0e4110b5dd" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35517 } } peers { permanent_uuid: "296846bc52c94340a527f868acf50cb9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38539 } }
I20260809 19:12:49.888878 656 leader_election.cc:288] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b9580420508435a861cee7610aeb01f (127.7.39.3:35861), a85a90adc4ba4b51a8c0fc0e4110b5dd (127.7.39.2:35517)
I20260809 19:12:49.895197 633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:49.889236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:54503 (local address 127.7.39.3:35861)
0809 19:12:49.889437 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:49.889443 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:49.890247 (+ 804us) server_negotiation.cc:407] Connection header received
0809 19:12:49.890425 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:49.890429 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:49.890487 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:49.890558 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:12:49.891153 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:49.891841 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:49.893553 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:49.894312 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:49.894429 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:49.894531 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:49.894839 (+ 308us) server_negotiation.cc:299] Negotiation successful
0809 19:12:49.894955 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 19:12:49.895226 641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:49.889461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:32933 (local address 127.7.39.2:35517)
0809 19:12:49.889673 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:49.889679 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:49.890068 (+ 389us) server_negotiation.cc:407] Connection header received
0809 19:12:49.890257 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:49.890261 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:49.890351 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:49.890423 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:12:49.891072 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:49.891787 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:49.893555 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:49.894315 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:49.894440 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:49.894541 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:49.894867 (+ 326us) server_negotiation.cc:299] Negotiation successful
0809 19:12:49.894990 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 19:12:49.895442 661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:49.889207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:35517 (local address 127.7.39.1:32933)
0809 19:12:49.889945 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:49.889966 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:49.890118 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:49.890464 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:49.890469 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:49.890494 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:12:49.890924 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:49.890935 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:49.891906 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:49.891911 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:49.893395 (+ 1484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:49.893407 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:49.894582 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:49.894589 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:49.894722 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:49.894745 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 19:12:49.894822 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 19:12:49.894942 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"mutex_wait_us":5,"spinlock_wait_cycles":19328,"thread_start_us":647,"threads_started":1}
I20260809 19:12:49.895591 660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:49.889215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:35861 (local address 127.7.39.1:54503)
0809 19:12:49.890146 (+ 931us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:49.890160 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 19:12:49.890278 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:12:49.890610 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:12:49.890615 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:12:49.890653 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:12:49.890992 (+ 339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:49.891001 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:49.891974 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:49.891979 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:49.893402 (+ 1423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:12:49.893414 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:12:49.894530 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:12:49.894547 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:12:49.894672 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:49.894722 (+ 50us) client_negotiation.cc:769] Sending connection context
0809 19:12:49.894802 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 19:12:49.894926 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":835,"mutex_wait_us":57,"thread_start_us":356,"threads_started":1}
I20260809 19:12:49.896461 550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f02c94bc9b24d1c821dbdedbef8642e" candidate_uuid: "296846bc52c94340a527f868acf50cb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b9580420508435a861cee7610aeb01f" is_pre_election: true
I20260809 19:12:49.896459 312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f02c94bc9b24d1c821dbdedbef8642e" candidate_uuid: "296846bc52c94340a527f868acf50cb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85a90adc4ba4b51a8c0fc0e4110b5dd" is_pre_election: true
I20260809 19:12:49.897033 550 raft_consensus.cc:2454] T 8f02c94bc9b24d1c821dbdedbef8642e P 1b9580420508435a861cee7610aeb01f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 296846bc52c94340a527f868acf50cb9 in term 0.
I20260809 19:12:49.897022 312 raft_consensus.cc:2454] T 8f02c94bc9b24d1c821dbdedbef8642e P a85a90adc4ba4b51a8c0fc0e4110b5dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 296846bc52c94340a527f868acf50cb9 in term 0.
I20260809 19:12:49.897750 32409 leader_election.cc:302] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b9580420508435a861cee7610aeb01f, 296846bc52c94340a527f868acf50cb9; no voters:
I20260809 19:12:49.898370 656 raft_consensus.cc:2781] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:12:49.898494 656 raft_consensus.cc:482] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:12:49.898613 656 raft_consensus.cc:3037] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:12:49.900741 656 raft_consensus.cc:504] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b9580420508435a861cee7610aeb01f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 35861 } } peers { permanent_uuid: "a85a90adc4ba4b51a8c0fc0e4110b5dd" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35517 } } peers { permanent_uuid: "296846bc52c94340a527f868acf50cb9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38539 } }
I20260809 19:12:49.901286 656 leader_election.cc:288] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9 [CANDIDATE]: Term 1 election: Requested vote from peers 1b9580420508435a861cee7610aeb01f (127.7.39.3:35861), a85a90adc4ba4b51a8c0fc0e4110b5dd (127.7.39.2:35517)
I20260809 19:12:49.901674 550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f02c94bc9b24d1c821dbdedbef8642e" candidate_uuid: "296846bc52c94340a527f868acf50cb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b9580420508435a861cee7610aeb01f"
I20260809 19:12:49.901715 312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f02c94bc9b24d1c821dbdedbef8642e" candidate_uuid: "296846bc52c94340a527f868acf50cb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85a90adc4ba4b51a8c0fc0e4110b5dd"
I20260809 19:12:49.901839 550 raft_consensus.cc:3037] T 8f02c94bc9b24d1c821dbdedbef8642e P 1b9580420508435a861cee7610aeb01f [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:12:49.901880 312 raft_consensus.cc:3037] T 8f02c94bc9b24d1c821dbdedbef8642e P a85a90adc4ba4b51a8c0fc0e4110b5dd [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:12:49.903962 550 raft_consensus.cc:2454] T 8f02c94bc9b24d1c821dbdedbef8642e P 1b9580420508435a861cee7610aeb01f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 296846bc52c94340a527f868acf50cb9 in term 1.
I20260809 19:12:49.904023 312 raft_consensus.cc:2454] T 8f02c94bc9b24d1c821dbdedbef8642e P a85a90adc4ba4b51a8c0fc0e4110b5dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 296846bc52c94340a527f868acf50cb9 in term 1.
I20260809 19:12:49.904315 32409 leader_election.cc:302] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b9580420508435a861cee7610aeb01f, 296846bc52c94340a527f868acf50cb9; no voters:
I20260809 19:12:49.904650 656 raft_consensus.cc:2781] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:12:49.905021 656 raft_consensus.cc:686] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9 [term 1 LEADER]: Becoming Leader. State: Replica: 296846bc52c94340a527f868acf50cb9, State: Running, Role: LEADER
I20260809 19:12:49.905488 656 consensus_queue.cc:237] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b9580420508435a861cee7610aeb01f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 35861 } } peers { permanent_uuid: "a85a90adc4ba4b51a8c0fc0e4110b5dd" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35517 } } peers { permanent_uuid: "296846bc52c94340a527f868acf50cb9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38539 } }
I20260809 19:12:49.909480 32273 catalog_manager.cc:5495] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 296846bc52c94340a527f868acf50cb9 (127.7.39.1). New cstate: current_term: 1 leader_uuid: "296846bc52c94340a527f868acf50cb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b9580420508435a861cee7610aeb01f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 35861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a85a90adc4ba4b51a8c0fc0e4110b5dd" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "296846bc52c94340a527f868acf50cb9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38539 } health_report { overall_health: HEALTHY } } }
I20260809 19:12:49.938695 642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:49.933467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47234 (local address 127.7.39.1:38539)
0809 19:12:49.933656 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:49.933662 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:49.933679 (+ 17us) server_negotiation.cc:407] Connection header received
0809 19:12:49.933864 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:49.933868 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:49.933941 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:49.934069 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:12:49.934487 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:49.935184 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:49.936663 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:49.937061 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:49.937168 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:49.937630 (+ 462us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:12:49.938107 (+ 477us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:12:49.938258 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:49.938373 (+ 115us) server_negotiation.cc:299] Negotiation successful
0809 19:12:49.938452 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 19:12:49.946230 312 raft_consensus.cc:1261] T 8f02c94bc9b24d1c821dbdedbef8642e P a85a90adc4ba4b51a8c0fc0e4110b5dd [term 1 FOLLOWER]: Refusing update from remote peer 296846bc52c94340a527f868acf50cb9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:12:49.946337 550 raft_consensus.cc:1261] T 8f02c94bc9b24d1c821dbdedbef8642e P 1b9580420508435a861cee7610aeb01f [term 1 FOLLOWER]: Refusing update from remote peer 296846bc52c94340a527f868acf50cb9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:12:49.947180 662 consensus_queue.cc:1035] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b9580420508435a861cee7610aeb01f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 35861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:12:49.947508 656 consensus_queue.cc:1035] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a85a90adc4ba4b51a8c0fc0e4110b5dd" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:12:49.957814 669 mvcc.cc:205] Tried to move back new op lower bound from 7316696145690148864 to 7316696145536438272. Current Snapshot: MvccSnapshot[applied={T|T < 7316696145690148864}]
I20260809 19:12:49.968724 32273 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42320:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:12:49.968955 32273 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42320:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:12:49.972323 32273 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7: Sending DeleteTablet for 3 replicas of tablet 8f02c94bc9b24d1c821dbdedbef8642e
W20260809 19:12:49.972452 395 tablet.cc:2369] T 8f02c94bc9b24d1c821dbdedbef8642e P a85a90adc4ba4b51a8c0fc0e4110b5dd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:12:49.973903 512 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f02c94bc9b24d1c821dbdedbef8642e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:12:49 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:34528
I20260809 19:12:49.974617 32751 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f02c94bc9b24d1c821dbdedbef8642e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:12:49 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:60162
I20260809 19:12:49.974802 682 tablet_replica.cc:330] T 8f02c94bc9b24d1c821dbdedbef8642e P 1b9580420508435a861cee7610aeb01f: stopping tablet replica
I20260809 19:12:49.974915 32504 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f02c94bc9b24d1c821dbdedbef8642e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:12:49 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:47230
I20260809 19:12:49.975244 682 raft_consensus.cc:2229] T 8f02c94bc9b24d1c821dbdedbef8642e P 1b9580420508435a861cee7610aeb01f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:12:49.975539 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 32380
I20260809 19:12:49.975813 682 raft_consensus.cc:2258] T 8f02c94bc9b24d1c821dbdedbef8642e P 1b9580420508435a861cee7610aeb01f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:12:49.979475 671 mvcc.cc:205] Tried to move back new op lower bound from 7316696145690148864 to 7316696145536438272. Current Snapshot: MvccSnapshot[applied={T|T < 7316696145690148864}]
I20260809 19:12:49.983350 683 tablet_replica.cc:330] T 8f02c94bc9b24d1c821dbdedbef8642e P a85a90adc4ba4b51a8c0fc0e4110b5dd: stopping tablet replica
I20260809 19:12:49.983734 683 raft_consensus.cc:2229] T 8f02c94bc9b24d1c821dbdedbef8642e P a85a90adc4ba4b51a8c0fc0e4110b5dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:12:49.984175 683 raft_consensus.cc:2258] T 8f02c94bc9b24d1c821dbdedbef8642e P a85a90adc4ba4b51a8c0fc0e4110b5dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:12:49.985421 688 tablet_replica.cc:330] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9: stopping tablet replica
I20260809 19:12:49.985813 688 raft_consensus.cc:2229] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9 [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:12:49.986390 682 ts_tablet_manager.cc:1905] T 8f02c94bc9b24d1c821dbdedbef8642e P 1b9580420508435a861cee7610aeb01f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:12:49.986438 688 raft_consensus.cc:2258] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:12:49.988415 683 ts_tablet_manager.cc:1905] T 8f02c94bc9b24d1c821dbdedbef8642e P a85a90adc4ba4b51a8c0fc0e4110b5dd: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 09 19:12:49 dist-test-slave-4tdj krb5kdc[32200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302767, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.1@KRBTEST.COM
I20260809 19:12:49.993806 682 ts_tablet_manager.cc:1918] T 8f02c94bc9b24d1c821dbdedbef8642e P 1b9580420508435a861cee7610aeb01f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:12:49.994035 682 log.cc:1196] T 8f02c94bc9b24d1c821dbdedbef8642e P 1b9580420508435a861cee7610aeb01f: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/wal/wals/8f02c94bc9b24d1c821dbdedbef8642e
I20260809 19:12:49.994644 682 ts_tablet_manager.cc:1939] T 8f02c94bc9b24d1c821dbdedbef8642e P 1b9580420508435a861cee7610aeb01f: Deleting consensus metadata
I20260809 19:12:49.995013 683 ts_tablet_manager.cc:1918] T 8f02c94bc9b24d1c821dbdedbef8642e P a85a90adc4ba4b51a8c0fc0e4110b5dd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:12:49.995172 683 log.cc:1196] T 8f02c94bc9b24d1c821dbdedbef8642e P a85a90adc4ba4b51a8c0fc0e4110b5dd: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/wal/wals/8f02c94bc9b24d1c821dbdedbef8642e
I20260809 19:12:49.995669 683 ts_tablet_manager.cc:1939] T 8f02c94bc9b24d1c821dbdedbef8642e P a85a90adc4ba4b51a8c0fc0e4110b5dd: Deleting consensus metadata
I20260809 19:12:49.996688 32251 catalog_manager.cc:4841] TS 1b9580420508435a861cee7610aeb01f (127.7.39.3:35861): tablet 8f02c94bc9b24d1c821dbdedbef8642e (table test-table [id=8e2233746ef943239ab6b57fe86ec802]) successfully deleted
I20260809 19:12:49.998164 688 ts_tablet_manager.cc:1905] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:12:50.002444 642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:49.976576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47236 (local address 127.7.39.1:38539)
0809 19:12:49.976729 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:49.976737 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:49.982791 (+ 6054us) server_negotiation.cc:407] Connection header received
0809 19:12:49.982969 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:49.982975 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:49.983067 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:49.983162 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:49.985326 (+ 2164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:49.986492 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:49.988442 (+ 1950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:49.989061 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:49.989158 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:49.994877 (+ 5719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:49.994892 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:49.994908 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:49.994945 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:49.999030 (+ 4085us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:49.999869 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:49.999878 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:49.999882 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:50.000081 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:50.000527 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:50.000532 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:50.000536 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:50.000950 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:50.001236 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:50.001586 (+ 350us) server_negotiation.cc:299] Negotiation successful
0809 19:12:50.001828 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 19:12:50.003268 32612 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:12:50.005888 32254 catalog_manager.cc:4841] TS a85a90adc4ba4b51a8c0fc0e4110b5dd (127.7.39.2:35517): tablet 8f02c94bc9b24d1c821dbdedbef8642e (table test-table [id=8e2233746ef943239ab6b57fe86ec802]) successfully deleted
I20260809 19:12:50.097077 688 ts_tablet_manager.cc:1918] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:12:50.097373 688 log.cc:1196] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/wal/wals/8f02c94bc9b24d1c821dbdedbef8642e
I20260809 19:12:50.097781 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 32380
W20260809 19:12:50.121727 32253 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.39.1:38539 (error 108)
I20260809 19:12:50.122066 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 32632
I20260809 19:12:50.123829 637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:50.123459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:38539 (local address 127.0.0.1:47246)
0809 19:12:50.123590 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:50.123682 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:38539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260809 19:12:50.124094 32253 catalog_manager.cc:4584] TS 296846bc52c94340a527f868acf50cb9 (127.7.39.1:38539): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8f02c94bc9b24d1c821dbdedbef8642e: Network error: Client connection negotiation failed: client connection to 127.7.39.1:38539: connect: Connection refused (error 111)
Aug 09 19:12:50 dist-test-slave-4tdj krb5kdc[32200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302767, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.2@KRBTEST.COM
I20260809 19:12:50.137534 641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:50.123110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60168 (local address 127.7.39.2:35517)
0809 19:12:50.123297 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:50.123303 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:50.123325 (+ 22us) server_negotiation.cc:407] Connection header received
0809 19:12:50.123862 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:50.123869 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:50.123969 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:50.124078 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:50.125586 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:50.126409 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:50.127685 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:50.128074 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:50.128186 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:50.132488 (+ 4302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:50.132501 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:50.132516 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:50.132547 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:50.135312 (+ 2765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:50.135914 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:50.135920 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:50.135922 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:50.136052 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:50.136327 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:50.136330 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:50.136332 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:50.136687 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:50.136894 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:50.137097 (+ 203us) server_negotiation.cc:299] Negotiation successful
0809 19:12:50.137249 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 19:12:50.138168 386 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:12:50.177708 637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:50.177232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:38539 (local address 127.0.0.1:47254)
0809 19:12:50.177442 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:50.177549 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:38539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260809 19:12:50.178759 637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:50.178438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:38539 (local address 127.0.0.1:47270)
0809 19:12:50.178563 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:50.178649 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:38539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 19:12:50.224726 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 32632
I20260809 19:12:50.239352 637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:50.238782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:38539 (local address 127.0.0.1:47286)
0809 19:12:50.239031 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:50.239146 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:38539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260809 19:12:50.240373 637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:50.240000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:38539 (local address 127.0.0.1:47292)
0809 19:12:50.240155 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:50.240237 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:38539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260809 19:12:50.249094 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 403
Aug 09 19:12:50 dist-test-slave-4tdj krb5kdc[32200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302767, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.3@KRBTEST.COM
I20260809 19:12:50.263515 633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:50.249819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34538 (local address 127.7.39.3:35861)
0809 19:12:50.249996 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 19:12:50.250000 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:12:50.250019 (+ 19us) server_negotiation.cc:407] Connection header received
0809 19:12:50.250131 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:12:50.250135 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:12:50.250209 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:12:50.250332 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:12:50.251679 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:50.252391 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:50.253653 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:12:50.254044 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:12:50.254136 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:12:50.258392 (+ 4256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:12:50.258408 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:12:50.258425 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:12:50.258458 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:12:50.261151 (+ 2693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:50.261767 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:50.261773 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:50.261775 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:50.261901 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:12:50.262185 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:12:50.262188 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:12:50.262190 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:12:50.262661 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:12:50.262877 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0809 19:12:50.263088 (+ 211us) server_negotiation.cc:299] Negotiation successful
0809 19:12:50.263244 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 19:12:50.264111 604 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:12:50.320979 637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:50.320421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:38539 (local address 127.0.0.1:47300)
0809 19:12:50.320669 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:50.320785 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:38539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260809 19:12:50.322105 637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:12:50.321645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:38539 (local address 127.0.0.1:47306)
0809 19:12:50.321884 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0809 19:12:50.321972 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:38539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
I20260809 19:12:50.349503 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 403
I20260809 19:12:50.369130 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 32221
I20260809 19:12:50.370224 32325 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:12:50.477324 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 32221
I20260809 19:13:10.505923 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:39609
--webserver_interface=127.7.39.62
--webserver_port=42409
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:42951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:39609
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:13:10.825299 701 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:13:10.825551 701 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:13:10.825678 701 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:13:10.832521 701 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 19:13:10.832603 701 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 19:13:10.832664 701 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 19:13:10.832732 701 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:13:10.832806 701 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:13:10.832897 701 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:13:10.832949 701 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:13:10.833024 701 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:13:10.842274 701 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:42951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:39609
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:39609
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=42409
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:13:10.843446 701 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:13:10.844659 701 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:13:10.866788 708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:10.866827 709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:10.866779 712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:13:10.867581 701 server_base.cc:1034] running on GCE node
I20260809 19:13:10.868360 701 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:13:10.869791 701 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:13:10.871001 701 hybrid_clock.cc:648] HybridClock initialized: now 1786302790870933 us; error 45 us; skew 500 ppm
I20260809 19:13:10.871354 701 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:13:10 dist-test-slave-4tdj krb5kdc[32200](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302790, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:13:10.878742 701 init.cc:377] Logged in from keytab as kudu/127.7.39.62@KRBTEST.COM (short username kudu)
I20260809 19:13:10.880271 701 webserver.cc:460] Webserver started at http://127.7.39.62:42409/ using document root <none> and password file <none>
I20260809 19:13:10.881142 701 fs_manager.cc:359] Metadata directory not provided
I20260809 19:13:10.881280 701 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:13:10.887118 701 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 19:13:10.890054 721 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:10.891351 701 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 19:13:10.891515 701 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "1b0b7554a35d45659eca0632e44e6fd7"
format_stamp: "Formatted at 2026-08-09 19:12:48 on dist-test-slave-4tdj"
server_key: "2995d2ffd76738940c389ff15fd012e0"
server_key_iv: "1e9d2ad618bf5674a2b80fd5d1cf57bb"
server_key_version: "encryptionkey@0"
I20260809 19:13:10.892517 701 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:13:10.903637 701 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:13:10.907426 701 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:13:10.907691 701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:13:10.924986 701 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:39609
I20260809 19:13:10.925026 805 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:39609 every 8 connection(s)
I20260809 19:13:10.926460 701 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:13:10.929525 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 701
I20260809 19:13:10.930537 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.1:38539
--local_ip_for_outbound_sockets=127.7.39.1
--tserver_master_addrs=127.7.39.62:39609
--webserver_port=36709
--webserver_interface=127.7.39.1
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:42951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 19:13:10.934716 806 sys_catalog.cc:263] Verifying existing consensus state
I20260809 19:13:10.939158 806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7: Bootstrap starting.
I20260809 19:13:10.959049 806 log.cc:824] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7: Log is configured to *not* fsync() on all Append() calls
I20260809 19:13:10.971005 806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 19:13:10.971537 806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7: Bootstrap complete.
I20260809 19:13:10.980439 806 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b0b7554a35d45659eca0632e44e6fd7" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39609 } }
I20260809 19:13:10.981249 806 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b0b7554a35d45659eca0632e44e6fd7, State: Initialized, Role: FOLLOWER
I20260809 19:13:10.981855 806 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b0b7554a35d45659eca0632e44e6fd7" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39609 } }
I20260809 19:13:10.982085 806 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:13:10.982201 806 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:13:10.982394 806 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [term 1 FOLLOWER]: Advancing to term 2
I20260809 19:13:10.986107 806 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b0b7554a35d45659eca0632e44e6fd7" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39609 } }
I20260809 19:13:10.986613 806 leader_election.cc:302] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1b0b7554a35d45659eca0632e44e6fd7; no voters:
I20260809 19:13:10.987202 806 leader_election.cc:288] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 19:13:10.987336 811 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 19:13:10.988519 811 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [term 2 LEADER]: Becoming Leader. State: Replica: 1b0b7554a35d45659eca0632e44e6fd7, State: Running, Role: LEADER
I20260809 19:13:10.989034 811 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b0b7554a35d45659eca0632e44e6fd7" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39609 } }
I20260809 19:13:10.989511 806 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:13:10.991513 814 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b0b7554a35d45659eca0632e44e6fd7. Latest consensus state: current_term: 2 leader_uuid: "1b0b7554a35d45659eca0632e44e6fd7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b0b7554a35d45659eca0632e44e6fd7" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39609 } } }
I20260809 19:13:10.992012 814 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [sys.catalog]: This master's current role is: LEADER
I20260809 19:13:10.991554 812 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "1b0b7554a35d45659eca0632e44e6fd7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b0b7554a35d45659eca0632e44e6fd7" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39609 } } }
I20260809 19:13:10.992496 812 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [sys.catalog]: This master's current role is: LEADER
I20260809 19:13:10.997073 819 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:13:11.006103 819 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:13:11.007560 819 catalog_manager.cc:1259] Loaded cluster ID: f2c79448e8cb4ff58c4eea441eac657a
I20260809 19:13:11.007727 819 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:13:11.011628 819 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:13:11.013620 819 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7: Loaded TSK: 0
I20260809 19:13:11.050487 819 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7: Generated new TSK 1
I20260809 19:13:11.050900 819 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 19:13:11.277385 808 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:13:11.277652 808 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:13:11.277782 808 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:13:11.284757 808 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:13:11.284868 808 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:13:11.285013 808 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.1
I20260809 19:13:11.294536 808 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:42951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.1:38539
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.39.1
--webserver_port=36709
--tserver_master_addrs=127.7.39.62:39609
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.1
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:13:11.295765 808 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:13:11.297093 808 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:13:11.310906 844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:11.310967 845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:11.311574 847 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:13:11.311973 808 server_base.cc:1034] running on GCE node
I20260809 19:13:11.312528 808 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:13:11.313429 808 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:13:11.314634 808 hybrid_clock.cc:648] HybridClock initialized: now 1786302791314580 us; error 48 us; skew 500 ppm
I20260809 19:13:11.314917 808 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:13:11 dist-test-slave-4tdj krb5kdc[32200](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302791, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:13:11.318023 808 init.cc:377] Logged in from keytab as kudu/127.7.39.1@KRBTEST.COM (short username kudu)
I20260809 19:13:11.319523 808 webserver.cc:460] Webserver started at http://127.7.39.1:36709/ using document root <none> and password file <none>
I20260809 19:13:11.320161 808 fs_manager.cc:359] Metadata directory not provided
I20260809 19:13:11.320291 808 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:13:11.325412 808 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.002s
I20260809 19:13:11.328078 856 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:11.329329 808 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 19:13:11.329476 808 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/wal
uuid: "296846bc52c94340a527f868acf50cb9"
format_stamp: "Formatted at 2026-08-09 19:12:48 on dist-test-slave-4tdj"
server_key: "e0fa0d940baa8c4ee4e536437d49af57"
server_key_iv: "d643db34e6c3c679d6f612fa4e4dbb71"
server_key_version: "encryptionkey@0"
I20260809 19:13:11.330387 808 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:13:11.344193 808 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:13:11.348039 808 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:13:11.348275 808 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:13:11.349252 808 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:13:11.351155 872 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260809 19:13:11.358276 872 ts_tablet_manager.cc:1852] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260809 19:13:11.359707 872 ts_tablet_manager.cc:1905] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:13:11.367640 872 ts_tablet_manager.cc:1918] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:13:11.367865 872 ts_tablet_manager.cc:1939] T 8f02c94bc9b24d1c821dbdedbef8642e P 296846bc52c94340a527f868acf50cb9: Deleting consensus metadata
I20260809 19:13:11.368191 808 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260809 19:13:11.368304 808 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.018s user 0.001s sys 0.000s
I20260809 19:13:11.368415 808 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:13:11.368485 808 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:11.398940 808 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.1:38539
I20260809 19:13:11.398999 1052 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.1:38539 every 8 connection(s)
I20260809 19:13:11.400133 808 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
I20260809 19:13:11.408239 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 808
I20260809 19:13:11.408854 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.2:35517
--local_ip_for_outbound_sockets=127.7.39.2
--tserver_master_addrs=127.7.39.62:39609
--webserver_port=39429
--webserver_interface=127.7.39.2
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:42951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 19:13:11 dist-test-slave-4tdj krb5kdc[32200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302791, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:13:11.421495 1056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:11.402729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:53813 (local address 127.7.39.62:39609)
0809 19:13:11.403336 (+ 607us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:11.403351 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:11.403790 (+ 439us) server_negotiation.cc:407] Connection header received
0809 19:13:11.405793 (+ 2003us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:11.405806 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:11.406119 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:11.406467 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:13:11.407911 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:11.409236 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:11.410792 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:11.411415 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:11.411595 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:11.414963 (+ 3368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:13:11.414971 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:13:11.414983 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:13:11.415019 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:13:11.417620 (+ 2601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:11.418375 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:11.418382 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:11.418387 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:11.418562 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:11.418979 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:11.418983 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:11.418985 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:11.419400 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:13:11.419538 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:11.420332 (+ 794us) server_negotiation.cc:299] Negotiation successful
0809 19:13:11.420646 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":223,"threads_started":1}
I20260809 19:13:11.421780 1061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:11.402854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.1:53813)
0809 19:13:11.403627 (+ 773us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:11.403668 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 19:13:11.405319 (+ 1651us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:13:11.406608 (+ 1289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:13:11.406618 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:13:11.407208 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:13:11.407729 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:11.407747 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:11.409385 (+ 1638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:11.409389 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:11.410657 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:11.410669 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:11.411639 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:11.411646 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:11.411891 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:11.412491 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:13:11.412513 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:13:11.414715 (+ 2202us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:13:11.417754 (+ 3039us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:13:11.417763 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:13:11.417777 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:13:11.418185 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:13:11.418666 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:13:11.418671 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:13:11.418675 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:13:11.418884 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:13:11.419535 (+ 651us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:13:11.419543 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:13:11.419901 (+ 358us) client_negotiation.cc:769] Sending connection context
0809 19:13:11.420176 (+ 275us) client_negotiation.cc:240] Negotiation successful
0809 19:13:11.420637 (+ 461us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":338,"threads_started":1}
I20260809 19:13:11.424526 1053 heartbeater.cc:347] Connected to a master server at 127.7.39.62:39609
I20260809 19:13:11.424795 1053 heartbeater.cc:464] Registering TS with master...
I20260809 19:13:11.425444 1053 heartbeater.cc:511] Master 127.7.39.62:39609 requested a full tablet report, sending...
I20260809 19:13:11.427456 752 ts_manager.cc:194] Registered new tserver with Master: 296846bc52c94340a527f868acf50cb9 (127.7.39.1:38539)
I20260809 19:13:11.428911 752 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.1@KRBTEST.COM'} at 127.7.39.1:53813
W20260809 19:13:11.728490 1062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:13:11.728771 1062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:13:11.728905 1062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:13:11.735929 1062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:13:11.736035 1062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:13:11.736177 1062 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.2
I20260809 19:13:11.745430 1062 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:42951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.2:35517
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.39.2
--webserver_port=39429
--tserver_master_addrs=127.7.39.62:39609
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.2
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:13:11.746631 1062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:13:11.747860 1062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:13:11.759826 1073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:11.759873 1076 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:11.759895 1072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:13:11.760820 1062 server_base.cc:1034] running on GCE node
I20260809 19:13:11.761324 1062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:13:11.762533 1062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:13:11.763754 1062 hybrid_clock.cc:648] HybridClock initialized: now 1786302791763700 us; error 47 us; skew 500 ppm
I20260809 19:13:11.764032 1062 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:13:11 dist-test-slave-4tdj krb5kdc[32200](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302791, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:13:11.766933 1062 init.cc:377] Logged in from keytab as kudu/127.7.39.2@KRBTEST.COM (short username kudu)
I20260809 19:13:11.768220 1062 webserver.cc:460] Webserver started at http://127.7.39.2:39429/ using document root <none> and password file <none>
I20260809 19:13:11.768838 1062 fs_manager.cc:359] Metadata directory not provided
I20260809 19:13:11.768962 1062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:13:11.773904 1062 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 19:13:11.776455 1085 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:11.777653 1062 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 19:13:11.777802 1062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/wal
uuid: "a85a90adc4ba4b51a8c0fc0e4110b5dd"
format_stamp: "Formatted at 2026-08-09 19:12:49 on dist-test-slave-4tdj"
server_key: "d5ee79502b62d457784eaa04aa71214a"
server_key_iv: "d5dceb6b4877b352a2921207f9243f24"
server_key_version: "encryptionkey@0"
I20260809 19:13:11.778750 1062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:13:11.807619 1062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:13:11.811183 1062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:13:11.811424 1062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:13:11.812304 1062 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:13:11.813540 1062 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:13:11.813642 1062 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:11.813740 1062 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:13:11.813813 1062 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:11.843539 1062 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.2:35517
I20260809 19:13:11.843616 1277 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.2:35517 every 8 connection(s)
I20260809 19:13:11.844871 1062 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
I20260809 19:13:11.845788 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 1062
I20260809 19:13:11.846531 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.3:35861
--local_ip_for_outbound_sockets=127.7.39.3
--tserver_master_addrs=127.7.39.62:39609
--webserver_port=43793
--webserver_interface=127.7.39.3
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:42951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 19:13:11 dist-test-slave-4tdj krb5kdc[32200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302791, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:13:11.867151 1056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:11.847395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:40805 (local address 127.7.39.62:39609)
0809 19:13:11.847609 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:11.847615 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:11.848774 (+ 1159us) server_negotiation.cc:407] Connection header received
0809 19:13:11.850587 (+ 1813us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:11.850592 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:11.850678 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:11.850785 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:13:11.852171 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:11.853092 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:11.854612 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:11.855166 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:11.855287 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:11.858623 (+ 3336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:13:11.858631 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:13:11.858636 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:13:11.858679 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:13:11.863948 (+ 5269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:11.864674 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:11.864680 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:11.864683 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:11.864834 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:11.865343 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:11.865348 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:11.865351 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:11.865716 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:13:11.865863 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:11.866597 (+ 734us) server_negotiation.cc:299] Negotiation successful
0809 19:13:11.866826 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 19:13:11.868139 1282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:11.847839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.2:40805)
0809 19:13:11.848612 (+ 773us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:11.848658 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 19:13:11.850325 (+ 1667us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:13:11.850977 (+ 652us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:13:11.850985 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:13:11.851473 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:13:11.851991 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:11.852007 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:11.853222 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:11.853225 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:11.854458 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:11.854470 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:11.855342 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:11.855347 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:11.855533 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:11.856138 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:13:11.856161 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:13:11.858332 (+ 2171us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:13:11.864117 (+ 5785us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:13:11.864126 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:13:11.864142 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:13:11.864536 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:13:11.864939 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:13:11.864944 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:13:11.864948 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:13:11.865221 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:13:11.865927 (+ 706us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:13:11.865932 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:13:11.866215 (+ 283us) client_negotiation.cc:769] Sending connection context
0809 19:13:11.866466 (+ 251us) client_negotiation.cc:240] Negotiation successful
0809 19:13:11.866931 (+ 465us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":320,"threads_started":1}
I20260809 19:13:11.869426 1279 heartbeater.cc:347] Connected to a master server at 127.7.39.62:39609
I20260809 19:13:11.869719 1279 heartbeater.cc:464] Registering TS with master...
I20260809 19:13:11.870556 1279 heartbeater.cc:511] Master 127.7.39.62:39609 requested a full tablet report, sending...
I20260809 19:13:11.872001 752 ts_manager.cc:194] Registered new tserver with Master: a85a90adc4ba4b51a8c0fc0e4110b5dd (127.7.39.2:35517)
I20260809 19:13:11.872766 752 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.2@KRBTEST.COM'} at 127.7.39.2:40805
W20260809 19:13:12.256721 1283 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:13:12.256974 1283 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:13:12.257114 1283 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:13:12.264142 1283 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:13:12.264237 1283 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:13:12.264379 1283 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.3
I20260809 19:13:12.273607 1283 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:42951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.3:35861
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.39.3
--webserver_port=43793
--tserver_master_addrs=127.7.39.62:39609
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.3
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:13:12.274827 1283 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:13:12.276109 1283 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:13:12.288347 1297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:12.288398 1308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:12.288482 1301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:13:12.289288 1283 server_base.cc:1034] running on GCE node
I20260809 19:13:12.289848 1283 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:13:12.290769 1283 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:13:12.291961 1283 hybrid_clock.cc:648] HybridClock initialized: now 1786302792291911 us; error 45 us; skew 500 ppm
I20260809 19:13:12.292228 1283 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:13:12 dist-test-slave-4tdj krb5kdc[32200](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302792, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:13:12.295073 1283 init.cc:377] Logged in from keytab as kudu/127.7.39.3@KRBTEST.COM (short username kudu)
I20260809 19:13:12.296465 1283 webserver.cc:460] Webserver started at http://127.7.39.3:43793/ using document root <none> and password file <none>
I20260809 19:13:12.297178 1283 fs_manager.cc:359] Metadata directory not provided
I20260809 19:13:12.297304 1283 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:13:12.302564 1283 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:13:12.305058 1322 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:12.306320 1283 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 19:13:12.306459 1283 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/wal
uuid: "1b9580420508435a861cee7610aeb01f"
format_stamp: "Formatted at 2026-08-09 19:12:49 on dist-test-slave-4tdj"
server_key: "8ad041f0f1ea27118ea10b1019dd9ced"
server_key_iv: "f9000d12aec8874c98e7c84f99747c69"
server_key_version: "encryptionkey@0"
I20260809 19:13:12.307339 1283 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:13:12.326864 1283 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:13:12.330485 1283 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:13:12.330709 1283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:13:12.331590 1283 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:13:12.332834 1283 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:13:12.332934 1283 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:12.333022 1283 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:13:12.333089 1283 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:12.360591 1283 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.3:35861
I20260809 19:13:12.360656 1523 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.3:35861 every 8 connection(s)
I20260809 19:13:12.361907 1283 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
I20260809 19:13:12.364811 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 1283
Aug 09 19:13:12 dist-test-slave-4tdj krb5kdc[32200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302792, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:13:12.383687 1056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:12.364341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:32961 (local address 127.7.39.62:39609)
0809 19:13:12.364588 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:12.364595 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:12.365759 (+ 1164us) server_negotiation.cc:407] Connection header received
0809 19:13:12.368579 (+ 2820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:12.368587 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:12.368686 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:12.368810 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:13:12.370378 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.371226 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.373365 (+ 2139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.374042 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.374163 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:12.377798 (+ 3635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:13:12.377803 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:13:12.377806 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:13:12.377835 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:13:12.380689 (+ 2854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:12.381375 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:12.381380 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:12.381384 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:12.381529 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:12.381950 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:12.381955 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:12.381958 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:12.382256 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:13:12.382421 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:12.383123 (+ 702us) server_negotiation.cc:299] Negotiation successful
0809 19:13:12.383329 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260809 19:13:12.384223 1531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:12.365759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50724 (local address 127.7.39.62:39609)
0809 19:13:12.369236 (+ 3477us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:12.369241 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:12.370785 (+ 1544us) server_negotiation.cc:407] Connection header received
0809 19:13:12.370949 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:12.370954 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:12.371018 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:12.371116 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:13:12.373053 (+ 1937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.374050 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.375817 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.376223 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.376313 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:12.378918 (+ 2605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:13:12.378923 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:13:12.378929 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:13:12.378972 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:13:12.381425 (+ 2453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:12.382084 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:12.382090 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:12.382093 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:12.382235 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:12.382648 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:12.382653 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:12.382656 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:12.382903 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:13:12.383142 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:12.383531 (+ 389us) server_negotiation.cc:299] Negotiation successful
0809 19:13:12.383948 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3370,"thread_start_us":2979,"threads_started":1}
I20260809 19:13:12.384630 1530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:12.364798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.3:32961)
0809 19:13:12.365600 (+ 802us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:12.365648 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 19:13:12.368237 (+ 2589us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:13:12.369159 (+ 922us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:13:12.369170 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:13:12.369699 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:13:12.370213 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:12.370232 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.371418 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.371423 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:12.373234 (+ 1811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:12.373245 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.374276 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.374284 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:12.374604 (+ 320us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:12.375249 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:13:12.375282 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:13:12.377601 (+ 2319us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:13:12.380813 (+ 3212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:13:12.380821 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:13:12.380836 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:13:12.381228 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:13:12.381643 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:13:12.381648 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:13:12.381652 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:13:12.381833 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:13:12.382394 (+ 561us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:13:12.382402 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:13:12.382754 (+ 352us) client_negotiation.cc:769] Sending connection context
0809 19:13:12.382972 (+ 218us) client_negotiation.cc:240] Negotiation successful
0809 19:13:12.383425 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":323,"threads_started":1}
I20260809 19:13:12.386004 1526 heartbeater.cc:347] Connected to a master server at 127.7.39.62:39609
I20260809 19:13:12.386266 1526 heartbeater.cc:464] Registering TS with master...
I20260809 19:13:12.387038 1526 heartbeater.cc:511] Master 127.7.39.62:39609 requested a full tablet report, sending...
I20260809 19:13:12.388326 752 ts_manager.cc:194] Registered new tserver with Master: 1b9580420508435a861cee7610aeb01f (127.7.39.3:35861)
I20260809 19:13:12.389096 752 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.3@KRBTEST.COM'} at 127.7.39.3:32961
I20260809 19:13:12.399040 7324 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 19:13:12.405462 1531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:12.399994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50726 (local address 127.7.39.62:39609)
0809 19:13:12.400435 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:12.400441 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:12.400533 (+ 92us) server_negotiation.cc:407] Connection header received
0809 19:13:12.400742 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:12.400746 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:12.400862 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:12.400981 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:13:12.401503 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.402185 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.403603 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.404019 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.404124 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:12.404621 (+ 497us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:13:12.404867 (+ 246us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0809 19:13:12.405189 (+ 322us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50726: token expired
Metrics: {"server-negotiator.queue_time_us":304}
W20260809 19:13:12.405571 1531 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50726: token expired
W20260809 19:13:12.406061 624 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.7.39.62:39609)
I20260809 19:13:12.417506 1531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:12.406654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50736 (local address 127.7.39.62:39609)
0809 19:13:12.406798 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:12.406802 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:12.406845 (+ 43us) server_negotiation.cc:407] Connection header received
0809 19:13:12.406941 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:12.406944 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:12.406996 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:12.407074 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:13:12.408199 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.408850 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.410084 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.410519 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.410619 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:12.413048 (+ 2429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:13:12.413053 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:13:12.413056 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:13:12.413084 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:13:12.415383 (+ 2299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:12.415974 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:12.415977 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:12.415979 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:12.416097 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:12.416363 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:12.416366 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:12.416368 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:12.416641 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:13:12.416810 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:12.417072 (+ 262us) server_negotiation.cc:299] Negotiation successful
0809 19:13:12.417223 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 19:13:12.420498 752 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50736:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:13:12.427532 752 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:13:12.431820 1053 heartbeater.cc:503] Master 127.7.39.62:39609 was elected leader, sending a full tablet report...
I20260809 19:13:12.459266 1541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:12.438599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42450 (local address 127.7.39.3:35861)
0809 19:13:12.439313 (+ 714us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:12.439322 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:12.449083 (+ 9761us) server_negotiation.cc:407] Connection header received
0809 19:13:12.449346 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:12.449356 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:12.449636 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:12.449820 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:13:12.451767 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.453512 (+ 1745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.456606 (+ 3094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.457996 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.458131 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:12.458392 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:12.458735 (+ 343us) server_negotiation.cc:299] Negotiation successful
0809 19:13:12.458901 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":531,"thread_start_us":1050,"threads_started":1}
I20260809 19:13:12.459355 1542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:12.438515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:35861 (local address 127.0.0.1:42450)
0809 19:13:12.448925 (+ 10410us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:12.448969 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 19:13:12.449152 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:13:12.450401 (+ 1249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:13:12.450409 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:13:12.450446 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:13:12.450872 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:12.450885 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.453751 (+ 2866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.453757 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:12.456397 (+ 2640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:12.456415 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.458221 (+ 1806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.458227 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:12.458473 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:12.458534 (+ 61us) client_negotiation.cc:769] Sending connection context
0809 19:13:12.458667 (+ 133us) client_negotiation.cc:240] Negotiation successful
0809 19:13:12.458920 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10145,"mutex_wait_us":111,"thread_start_us":18277,"threads_started":1}
I20260809 19:13:12.463263 1546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:12.438519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:38539 (local address 127.0.0.1:60674)
0809 19:13:12.453713 (+ 15194us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:12.453739 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 19:13:12.453863 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:13:12.456025 (+ 2162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:13:12.456030 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:13:12.456069 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:13:12.456540 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:12.456552 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.458344 (+ 1792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.458349 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:12.460693 (+ 2344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:12.460708 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.462483 (+ 1775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.462490 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:12.462656 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:12.462688 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 19:13:12.462786 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 19:13:12.462903 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15053,"mutex_wait_us":239,"thread_start_us":9752,"threads_started":1}
I20260809 19:13:12.463276 1543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:12.438854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60674 (local address 127.7.39.1:38539)
0809 19:13:12.454575 (+ 15721us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:12.454585 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:12.454616 (+ 31us) server_negotiation.cc:407] Connection header received
0809 19:13:12.454710 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:12.454718 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:12.454961 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:12.456459 (+ 1498us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:13:12.456714 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.458162 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.460862 (+ 2700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.462242 (+ 1380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.462413 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:12.462615 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:12.462828 (+ 213us) server_negotiation.cc:299] Negotiation successful
0809 19:13:12.462978 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15543,"thread_start_us":17326,"threads_started":1}
I20260809 19:13:12.464105 1540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:12.439121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:35517 (local address 127.0.0.1:53150)
0809 19:13:12.457073 (+ 17952us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:12.457093 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 19:13:12.457199 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:13:12.457657 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:13:12.457661 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:13:12.457684 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:13:12.457979 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:12.457988 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.459731 (+ 1743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.459737 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:12.461628 (+ 1891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:12.461642 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.463581 (+ 1939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.463591 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:12.463725 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:12.463747 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 19:13:12.463806 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 19:13:12.463881 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17818,"thread_start_us":14834,"threads_started":1}
I20260809 19:13:12.463335 1407 tablet_service.cc:1467] Processing CreateTablet for tablet 15801e7cec434a9c98af9d6777bf2e6e (DEFAULT_TABLE table=test-table [id=a4f656c3ea354850853ed0a686623e33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:13:12.464814 1547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:12.439759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53150 (local address 127.7.39.2:35517)
0809 19:13:12.455751 (+ 15992us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:12.455760 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:12.457197 (+ 1437us) server_negotiation.cc:407] Connection header received
0809 19:13:12.457323 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:12.457328 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:12.457484 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:12.457651 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:13:12.458130 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.459596 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.461793 (+ 2197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.463003 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.463136 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:12.463314 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:12.464457 (+ 1143us) server_negotiation.cc:299] Negotiation successful
0809 19:13:12.464590 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15826,"thread_start_us":15993,"threads_started":1}
I20260809 19:13:12.465272 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15801e7cec434a9c98af9d6777bf2e6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:13:12.465271 945 tablet_service.cc:1467] Processing CreateTablet for tablet 15801e7cec434a9c98af9d6777bf2e6e (DEFAULT_TABLE table=test-table [id=a4f656c3ea354850853ed0a686623e33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:13:12.466614 945 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15801e7cec434a9c98af9d6777bf2e6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:13:12.467585 1169 tablet_service.cc:1467] Processing CreateTablet for tablet 15801e7cec434a9c98af9d6777bf2e6e (DEFAULT_TABLE table=test-table [id=a4f656c3ea354850853ed0a686623e33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:13:12.468731 1169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15801e7cec434a9c98af9d6777bf2e6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:13:12.476135 1549 tablet_bootstrap.cc:492] T 15801e7cec434a9c98af9d6777bf2e6e P 296846bc52c94340a527f868acf50cb9: Bootstrap starting.
I20260809 19:13:12.479583 1551 tablet_bootstrap.cc:492] T 15801e7cec434a9c98af9d6777bf2e6e P 1b9580420508435a861cee7610aeb01f: Bootstrap starting.
I20260809 19:13:12.480430 1553 tablet_bootstrap.cc:492] T 15801e7cec434a9c98af9d6777bf2e6e P a85a90adc4ba4b51a8c0fc0e4110b5dd: Bootstrap starting.
I20260809 19:13:12.480787 1549 tablet_bootstrap.cc:654] T 15801e7cec434a9c98af9d6777bf2e6e P 296846bc52c94340a527f868acf50cb9: Neither blocks nor log segments found. Creating new log.
I20260809 19:13:12.481959 1549 log.cc:824] T 15801e7cec434a9c98af9d6777bf2e6e P 296846bc52c94340a527f868acf50cb9: Log is configured to *not* fsync() on all Append() calls
I20260809 19:13:12.483752 1553 tablet_bootstrap.cc:654] T 15801e7cec434a9c98af9d6777bf2e6e P a85a90adc4ba4b51a8c0fc0e4110b5dd: Neither blocks nor log segments found. Creating new log.
I20260809 19:13:12.484181 1551 tablet_bootstrap.cc:654] T 15801e7cec434a9c98af9d6777bf2e6e P 1b9580420508435a861cee7610aeb01f: Neither blocks nor log segments found. Creating new log.
I20260809 19:13:12.484537 1549 tablet_bootstrap.cc:492] T 15801e7cec434a9c98af9d6777bf2e6e P 296846bc52c94340a527f868acf50cb9: No bootstrap required, opened a new log
I20260809 19:13:12.484767 1549 ts_tablet_manager.cc:1397] T 15801e7cec434a9c98af9d6777bf2e6e P 296846bc52c94340a527f868acf50cb9: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260809 19:13:12.484956 1553 log.cc:824] T 15801e7cec434a9c98af9d6777bf2e6e P a85a90adc4ba4b51a8c0fc0e4110b5dd: Log is configured to *not* fsync() on all Append() calls
I20260809 19:13:12.485325 1551 log.cc:824] T 15801e7cec434a9c98af9d6777bf2e6e P 1b9580420508435a861cee7610aeb01f: Log is configured to *not* fsync() on all Append() calls
I20260809 19:13:12.488188 1551 tablet_bootstrap.cc:492] T 15801e7cec434a9c98af9d6777bf2e6e P 1b9580420508435a861cee7610aeb01f: No bootstrap required, opened a new log
I20260809 19:13:12.488400 1551 ts_tablet_manager.cc:1397] T 15801e7cec434a9c98af9d6777bf2e6e P 1b9580420508435a861cee7610aeb01f: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260809 19:13:12.492229 1549 raft_consensus.cc:348] T 15801e7cec434a9c98af9d6777bf2e6e P 296846bc52c94340a527f868acf50cb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b9580420508435a861cee7610aeb01f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 35861 } } peers { permanent_uuid: "296846bc52c94340a527f868acf50cb9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38539 } } peers { permanent_uuid: "a85a90adc4ba4b51a8c0fc0e4110b5dd" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35517 } }
I20260809 19:13:12.492543 1549 raft_consensus.cc:374] T 15801e7cec434a9c98af9d6777bf2e6e P 296846bc52c94340a527f868acf50cb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:13:12.492657 1549 raft_consensus.cc:729] T 15801e7cec434a9c98af9d6777bf2e6e P 296846bc52c94340a527f868acf50cb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 296846bc52c94340a527f868acf50cb9, State: Initialized, Role: FOLLOWER
I20260809 19:13:12.493247 1549 consensus_queue.cc:260] T 15801e7cec434a9c98af9d6777bf2e6e P 296846bc52c94340a527f868acf50cb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b9580420508435a861cee7610aeb01f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 35861 } } peers { permanent_uuid: "296846bc52c94340a527f868acf50cb9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38539 } } peers { permanent_uuid: "a85a90adc4ba4b51a8c0fc0e4110b5dd" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35517 } }
I20260809 19:13:12.494225 1553 tablet_bootstrap.cc:492] T 15801e7cec434a9c98af9d6777bf2e6e P a85a90adc4ba4b51a8c0fc0e4110b5dd: No bootstrap required, opened a new log
I20260809 19:13:12.494509 1553 ts_tablet_manager.cc:1397] T 15801e7cec434a9c98af9d6777bf2e6e P a85a90adc4ba4b51a8c0fc0e4110b5dd: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.003s
I20260809 19:13:12.495007 1549 ts_tablet_manager.cc:1428] T 15801e7cec434a9c98af9d6777bf2e6e P 296846bc52c94340a527f868acf50cb9: Time spent starting tablet: real 0.010s user 0.007s sys 0.004s
I20260809 19:13:12.495877 1551 raft_consensus.cc:348] T 15801e7cec434a9c98af9d6777bf2e6e P 1b9580420508435a861cee7610aeb01f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b9580420508435a861cee7610aeb01f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 35861 } } peers { permanent_uuid: "296846bc52c94340a527f868acf50cb9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38539 } } peers { permanent_uuid: "a85a90adc4ba4b51a8c0fc0e4110b5dd" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35517 } }
I20260809 19:13:12.496280 1551 raft_consensus.cc:374] T 15801e7cec434a9c98af9d6777bf2e6e P 1b9580420508435a861cee7610aeb01f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:13:12.496385 1551 raft_consensus.cc:729] T 15801e7cec434a9c98af9d6777bf2e6e P 1b9580420508435a861cee7610aeb01f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b9580420508435a861cee7610aeb01f, State: Initialized, Role: FOLLOWER
I20260809 19:13:12.496975 1551 consensus_queue.cc:260] T 15801e7cec434a9c98af9d6777bf2e6e P 1b9580420508435a861cee7610aeb01f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b9580420508435a861cee7610aeb01f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 35861 } } peers { permanent_uuid: "296846bc52c94340a527f868acf50cb9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38539 } } peers { permanent_uuid: "a85a90adc4ba4b51a8c0fc0e4110b5dd" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35517 } }
I20260809 19:13:12.498103 1526 heartbeater.cc:503] Master 127.7.39.62:39609 was elected leader, sending a full tablet report...
I20260809 19:13:12.498668 1551 ts_tablet_manager.cc:1428] T 15801e7cec434a9c98af9d6777bf2e6e P 1b9580420508435a861cee7610aeb01f: Time spent starting tablet: real 0.010s user 0.011s sys 0.001s
I20260809 19:13:12.503369 1553 raft_consensus.cc:348] T 15801e7cec434a9c98af9d6777bf2e6e P a85a90adc4ba4b51a8c0fc0e4110b5dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b9580420508435a861cee7610aeb01f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 35861 } } peers { permanent_uuid: "296846bc52c94340a527f868acf50cb9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38539 } } peers { permanent_uuid: "a85a90adc4ba4b51a8c0fc0e4110b5dd" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35517 } }
I20260809 19:13:12.503680 1553 raft_consensus.cc:374] T 15801e7cec434a9c98af9d6777bf2e6e P a85a90adc4ba4b51a8c0fc0e4110b5dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:13:12.503750 1553 raft_consensus.cc:729] T 15801e7cec434a9c98af9d6777bf2e6e P a85a90adc4ba4b51a8c0fc0e4110b5dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a85a90adc4ba4b51a8c0fc0e4110b5dd, State: Initialized, Role: FOLLOWER
I20260809 19:13:12.504232 1553 consensus_queue.cc:260] T 15801e7cec434a9c98af9d6777bf2e6e P a85a90adc4ba4b51a8c0fc0e4110b5dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b9580420508435a861cee7610aeb01f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 35861 } } peers { permanent_uuid: "296846bc52c94340a527f868acf50cb9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38539 } } peers { permanent_uuid: "a85a90adc4ba4b51a8c0fc0e4110b5dd" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35517 } }
I20260809 19:13:12.505091 1279 heartbeater.cc:503] Master 127.7.39.62:39609 was elected leader, sending a full tablet report...
I20260809 19:13:12.505682 1553 ts_tablet_manager.cc:1428] T 15801e7cec434a9c98af9d6777bf2e6e P a85a90adc4ba4b51a8c0fc0e4110b5dd: Time spent starting tablet: real 0.011s user 0.006s sys 0.004s
I20260809 19:13:12.531298 1560 raft_consensus.cc:482] T 15801e7cec434a9c98af9d6777bf2e6e P 1b9580420508435a861cee7610aeb01f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:13:12.531518 1560 raft_consensus.cc:504] T 15801e7cec434a9c98af9d6777bf2e6e P 1b9580420508435a861cee7610aeb01f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b9580420508435a861cee7610aeb01f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 35861 } } peers { permanent_uuid: "296846bc52c94340a527f868acf50cb9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38539 } } peers { permanent_uuid: "a85a90adc4ba4b51a8c0fc0e4110b5dd" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35517 } }
I20260809 19:13:12.532976 1560 leader_election.cc:288] T 15801e7cec434a9c98af9d6777bf2e6e P 1b9580420508435a861cee7610aeb01f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 296846bc52c94340a527f868acf50cb9 (127.7.39.1:38539), a85a90adc4ba4b51a8c0fc0e4110b5dd (127.7.39.2:35517)
I20260809 19:13:12.538442 1543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:12.533372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:42341 (local address 127.7.39.1:38539)
0809 19:13:12.533574 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:12.533580 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:12.533599 (+ 19us) server_negotiation.cc:407] Connection header received
0809 19:13:12.533734 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:12.533738 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:12.533796 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:12.533867 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:13:12.534259 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.535374 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.536906 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.537632 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.537740 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:12.537828 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:12.538074 (+ 246us) server_negotiation.cc:299] Negotiation successful
0809 19:13:12.538189 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 19:13:12.538456 1530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:12.533161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:38539 (local address 127.7.39.3:42341)
0809 19:13:12.533432 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:12.533455 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 19:13:12.533585 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:13:12.533918 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:13:12.533923 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:13:12.533953 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:13:12.534127 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:12.534139 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.535475 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.535481 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:12.536762 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:12.536774 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.537767 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.537772 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:12.537928 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:12.537951 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 19:13:12.538029 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 19:13:12.538147 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"mutex_wait_us":28}
I20260809 19:13:12.539250 1563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:12.533383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:35517 (local address 127.7.39.3:39319)
0809 19:13:12.534147 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:12.534161 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 19:13:12.534276 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:13:12.534689 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:13:12.534694 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:13:12.534721 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:13:12.535070 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:12.535080 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.536149 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.536154 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:12.537443 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:12.537454 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.538562 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.538568 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:12.538738 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:12.538769 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 19:13:12.538861 (+ 92us) client_negotiation.cc:240] Negotiation successful
0809 19:13:12.538974 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":639,"mutex_wait_us":4,"thread_start_us":424,"threads_started":1}
I20260809 19:13:12.539253 1547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:12.533471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:39319 (local address 127.7.39.2:35517)
0809 19:13:12.533650 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:12.533656 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:12.534244 (+ 588us) server_negotiation.cc:407] Connection header received
0809 19:13:12.534432 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:12.534436 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:12.534488 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:12.534575 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:13:12.535247 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.536010 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.537594 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.538367 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.538482 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:12.538568 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:12.538903 (+ 335us) server_negotiation.cc:299] Negotiation successful
0809 19:13:12.539021 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 19:13:12.539475 980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15801e7cec434a9c98af9d6777bf2e6e" candidate_uuid: "1b9580420508435a861cee7610aeb01f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "296846bc52c94340a527f868acf50cb9" is_pre_election: true
I20260809 19:13:12.539919 980 raft_consensus.cc:2454] T 15801e7cec434a9c98af9d6777bf2e6e P 296846bc52c94340a527f868acf50cb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b9580420508435a861cee7610aeb01f in term 0.
I20260809 19:13:12.540087 1204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15801e7cec434a9c98af9d6777bf2e6e" candidate_uuid: "1b9580420508435a861cee7610aeb01f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85a90adc4ba4b51a8c0fc0e4110b5dd" is_pre_election: true
I20260809 19:13:12.540504 1332 leader_election.cc:302] T 15801e7cec434a9c98af9d6777bf2e6e P 1b9580420508435a861cee7610aeb01f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b9580420508435a861cee7610aeb01f, 296846bc52c94340a527f868acf50cb9; no voters:
I20260809 19:13:12.540495 1204 raft_consensus.cc:2454] T 15801e7cec434a9c98af9d6777bf2e6e P a85a90adc4ba4b51a8c0fc0e4110b5dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b9580420508435a861cee7610aeb01f in term 0.
I20260809 19:13:12.540841 1560 raft_consensus.cc:2781] T 15801e7cec434a9c98af9d6777bf2e6e P 1b9580420508435a861cee7610aeb01f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:13:12.540994 1560 raft_consensus.cc:482] T 15801e7cec434a9c98af9d6777bf2e6e P 1b9580420508435a861cee7610aeb01f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:13:12.541105 1560 raft_consensus.cc:3037] T 15801e7cec434a9c98af9d6777bf2e6e P 1b9580420508435a861cee7610aeb01f [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:13:12.543287 1560 raft_consensus.cc:504] T 15801e7cec434a9c98af9d6777bf2e6e P 1b9580420508435a861cee7610aeb01f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b9580420508435a861cee7610aeb01f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 35861 } } peers { permanent_uuid: "296846bc52c94340a527f868acf50cb9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38539 } } peers { permanent_uuid: "a85a90adc4ba4b51a8c0fc0e4110b5dd" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35517 } }
I20260809 19:13:12.543841 1560 leader_election.cc:288] T 15801e7cec434a9c98af9d6777bf2e6e P 1b9580420508435a861cee7610aeb01f [CANDIDATE]: Term 1 election: Requested vote from peers 296846bc52c94340a527f868acf50cb9 (127.7.39.1:38539), a85a90adc4ba4b51a8c0fc0e4110b5dd (127.7.39.2:35517)
I20260809 19:13:12.544147 980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15801e7cec434a9c98af9d6777bf2e6e" candidate_uuid: "1b9580420508435a861cee7610aeb01f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "296846bc52c94340a527f868acf50cb9"
I20260809 19:13:12.544248 1204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15801e7cec434a9c98af9d6777bf2e6e" candidate_uuid: "1b9580420508435a861cee7610aeb01f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85a90adc4ba4b51a8c0fc0e4110b5dd"
I20260809 19:13:12.544308 980 raft_consensus.cc:3037] T 15801e7cec434a9c98af9d6777bf2e6e P 296846bc52c94340a527f868acf50cb9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:13:12.544425 1204 raft_consensus.cc:3037] T 15801e7cec434a9c98af9d6777bf2e6e P a85a90adc4ba4b51a8c0fc0e4110b5dd [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:13:12.546419 980 raft_consensus.cc:2454] T 15801e7cec434a9c98af9d6777bf2e6e P 296846bc52c94340a527f868acf50cb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b9580420508435a861cee7610aeb01f in term 1.
I20260809 19:13:12.546607 1204 raft_consensus.cc:2454] T 15801e7cec434a9c98af9d6777bf2e6e P a85a90adc4ba4b51a8c0fc0e4110b5dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b9580420508435a861cee7610aeb01f in term 1.
I20260809 19:13:12.546778 1332 leader_election.cc:302] T 15801e7cec434a9c98af9d6777bf2e6e P 1b9580420508435a861cee7610aeb01f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b9580420508435a861cee7610aeb01f, 296846bc52c94340a527f868acf50cb9; no voters:
I20260809 19:13:12.547015 1560 raft_consensus.cc:2781] T 15801e7cec434a9c98af9d6777bf2e6e P 1b9580420508435a861cee7610aeb01f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:13:12.547410 1560 raft_consensus.cc:686] T 15801e7cec434a9c98af9d6777bf2e6e P 1b9580420508435a861cee7610aeb01f [term 1 LEADER]: Becoming Leader. State: Replica: 1b9580420508435a861cee7610aeb01f, State: Running, Role: LEADER
I20260809 19:13:12.547868 1560 consensus_queue.cc:237] T 15801e7cec434a9c98af9d6777bf2e6e P 1b9580420508435a861cee7610aeb01f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b9580420508435a861cee7610aeb01f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 35861 } } peers { permanent_uuid: "296846bc52c94340a527f868acf50cb9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38539 } } peers { permanent_uuid: "a85a90adc4ba4b51a8c0fc0e4110b5dd" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35517 } }
I20260809 19:13:12.551882 752 catalog_manager.cc:5495] T 15801e7cec434a9c98af9d6777bf2e6e P 1b9580420508435a861cee7610aeb01f reported cstate change: term changed from 0 to 1, leader changed from <none> to 1b9580420508435a861cee7610aeb01f (127.7.39.3). New cstate: current_term: 1 leader_uuid: "1b9580420508435a861cee7610aeb01f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b9580420508435a861cee7610aeb01f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 35861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "296846bc52c94340a527f868acf50cb9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a85a90adc4ba4b51a8c0fc0e4110b5dd" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35517 } health_report { overall_health: UNKNOWN } } }
I20260809 19:13:12.569649 1541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:12.564836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42456 (local address 127.7.39.3:35861)
0809 19:13:12.565022 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:12.565028 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:12.565149 (+ 121us) server_negotiation.cc:407] Connection header received
0809 19:13:12.565327 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:12.565330 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:12.565398 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:12.565506 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:13:12.565795 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.566513 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.567877 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.568262 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.568345 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:12.568735 (+ 390us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:13:12.569182 (+ 447us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:13:12.569287 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:12.569365 (+ 78us) server_negotiation.cc:299] Negotiation successful
0809 19:13:12.569422 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 19:13:12.576764 1204 raft_consensus.cc:1261] T 15801e7cec434a9c98af9d6777bf2e6e P a85a90adc4ba4b51a8c0fc0e4110b5dd [term 1 FOLLOWER]: Refusing update from remote peer 1b9580420508435a861cee7610aeb01f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:13:12.576768 980 raft_consensus.cc:1261] T 15801e7cec434a9c98af9d6777bf2e6e P 296846bc52c94340a527f868acf50cb9 [term 1 FOLLOWER]: Refusing update from remote peer 1b9580420508435a861cee7610aeb01f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:13:12.577625 1568 consensus_queue.cc:1035] T 15801e7cec434a9c98af9d6777bf2e6e P 1b9580420508435a861cee7610aeb01f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a85a90adc4ba4b51a8c0fc0e4110b5dd" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:13:12.577911 1560 consensus_queue.cc:1035] T 15801e7cec434a9c98af9d6777bf2e6e P 1b9580420508435a861cee7610aeb01f [LEADER]: Connected to new peer: Peer: permanent_uuid: "296846bc52c94340a527f868acf50cb9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 38539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:13:12.591912 1573 mvcc.cc:205] Tried to move back new op lower bound from 7316696238386053120 to 7316696238279835648. Current Snapshot: MvccSnapshot[applied={T|T < 7316696238386053120}]
I20260809 19:13:12.597990 1574 mvcc.cc:205] Tried to move back new op lower bound from 7316696238386053120 to 7316696238279835648. Current Snapshot: MvccSnapshot[applied={T|T < 7316696238386053120}]
I20260809 19:13:12.603384 748 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50736:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:13:12.603619 748 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50736:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:13:12.606920 748 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7: Sending DeleteTablet for 3 replicas of tablet 15801e7cec434a9c98af9d6777bf2e6e
I20260809 19:13:12.607964 1407 tablet_service.cc:1514] Processing DeleteTablet for tablet 15801e7cec434a9c98af9d6777bf2e6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:13:12 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:42450
I20260809 19:13:12.608564 945 tablet_service.cc:1514] Processing DeleteTablet for tablet 15801e7cec434a9c98af9d6777bf2e6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:13:12 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:60674
I20260809 19:13:12.608769 1587 tablet_replica.cc:330] T 15801e7cec434a9c98af9d6777bf2e6e P 1b9580420508435a861cee7610aeb01f: stopping tablet replica
I20260809 19:13:12.609174 1587 raft_consensus.cc:2229] T 15801e7cec434a9c98af9d6777bf2e6e P 1b9580420508435a861cee7610aeb01f [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:13:12.609598 1169 tablet_service.cc:1514] Processing DeleteTablet for tablet 15801e7cec434a9c98af9d6777bf2e6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:13:12 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:53150
I20260809 19:13:12.609845 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 808
I20260809 19:13:12.610267 1588 tablet_replica.cc:330] T 15801e7cec434a9c98af9d6777bf2e6e P 296846bc52c94340a527f868acf50cb9: stopping tablet replica
I20260809 19:13:12.610663 1588 raft_consensus.cc:2229] T 15801e7cec434a9c98af9d6777bf2e6e P 296846bc52c94340a527f868acf50cb9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:13:12.610692 1587 raft_consensus.cc:2258] T 15801e7cec434a9c98af9d6777bf2e6e P 1b9580420508435a861cee7610aeb01f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:13:12.611138 1588 raft_consensus.cc:2258] T 15801e7cec434a9c98af9d6777bf2e6e P 296846bc52c94340a527f868acf50cb9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:13:12.612882 1588 ts_tablet_manager.cc:1905] T 15801e7cec434a9c98af9d6777bf2e6e P 296846bc52c94340a527f868acf50cb9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:13:12.614708 1587 ts_tablet_manager.cc:1905] T 15801e7cec434a9c98af9d6777bf2e6e P 1b9580420508435a861cee7610aeb01f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:13:12.619794 1588 ts_tablet_manager.cc:1918] T 15801e7cec434a9c98af9d6777bf2e6e P 296846bc52c94340a527f868acf50cb9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:13:12.619951 1588 log.cc:1196] T 15801e7cec434a9c98af9d6777bf2e6e P 296846bc52c94340a527f868acf50cb9: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/wal/wals/15801e7cec434a9c98af9d6777bf2e6e
I20260809 19:13:12.620175 1587 ts_tablet_manager.cc:1918] T 15801e7cec434a9c98af9d6777bf2e6e P 1b9580420508435a861cee7610aeb01f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:13:12.620340 1587 log.cc:1196] T 15801e7cec434a9c98af9d6777bf2e6e P 1b9580420508435a861cee7610aeb01f: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/wal/wals/15801e7cec434a9c98af9d6777bf2e6e
I20260809 19:13:12.620468 1588 ts_tablet_manager.cc:1939] T 15801e7cec434a9c98af9d6777bf2e6e P 296846bc52c94340a527f868acf50cb9: Deleting consensus metadata
I20260809 19:13:12.620886 1587 ts_tablet_manager.cc:1939] T 15801e7cec434a9c98af9d6777bf2e6e P 1b9580420508435a861cee7610aeb01f: Deleting consensus metadata
I20260809 19:13:12.621570 1589 tablet_replica.cc:330] T 15801e7cec434a9c98af9d6777bf2e6e P a85a90adc4ba4b51a8c0fc0e4110b5dd: stopping tablet replica
I20260809 19:13:12.622006 1589 raft_consensus.cc:2229] T 15801e7cec434a9c98af9d6777bf2e6e P a85a90adc4ba4b51a8c0fc0e4110b5dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:13:12.622109 728 catalog_manager.cc:4841] TS 296846bc52c94340a527f868acf50cb9 (127.7.39.1:38539): tablet 15801e7cec434a9c98af9d6777bf2e6e (table test-table [id=a4f656c3ea354850853ed0a686623e33]) successfully deleted
I20260809 19:13:12.622496 1589 raft_consensus.cc:2258] T 15801e7cec434a9c98af9d6777bf2e6e P a85a90adc4ba4b51a8c0fc0e4110b5dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:13:12.622967 723 catalog_manager.cc:4841] TS 1b9580420508435a861cee7610aeb01f (127.7.39.3:35861): tablet 15801e7cec434a9c98af9d6777bf2e6e (table test-table [id=a4f656c3ea354850853ed0a686623e33]) successfully deleted
I20260809 19:13:12.624452 1589 ts_tablet_manager.cc:1905] T 15801e7cec434a9c98af9d6777bf2e6e P a85a90adc4ba4b51a8c0fc0e4110b5dd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:13:12.629130 1543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:12.611067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60676 (local address 127.7.39.1:38539)
0809 19:13:12.611228 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:12.611233 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:12.611249 (+ 16us) server_negotiation.cc:407] Connection header received
0809 19:13:12.611303 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:12.611308 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:12.611396 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:12.611477 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:13:12.612959 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.614054 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.619733 (+ 5679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.620392 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.620526 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:12.623866 (+ 3340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:13:12.623879 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:13:12.623891 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:13:12.623924 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:13:12.626574 (+ 2650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:12.627195 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:12.627201 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:12.627203 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:12.627321 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:12.627682 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:12.627686 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:12.627688 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:12.628017 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:13:12.628305 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:12.628600 (+ 295us) server_negotiation.cc:299] Negotiation successful
0809 19:13:12.628796 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 19:13:12.629730 1046 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:13:12.631577 1589 ts_tablet_manager.cc:1918] T 15801e7cec434a9c98af9d6777bf2e6e P a85a90adc4ba4b51a8c0fc0e4110b5dd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:13:12.631734 1589 log.cc:1196] T 15801e7cec434a9c98af9d6777bf2e6e P a85a90adc4ba4b51a8c0fc0e4110b5dd: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/wal/wals/15801e7cec434a9c98af9d6777bf2e6e
I20260809 19:13:12.632290 1589 ts_tablet_manager.cc:1939] T 15801e7cec434a9c98af9d6777bf2e6e P a85a90adc4ba4b51a8c0fc0e4110b5dd: Deleting consensus metadata
I20260809 19:13:12.633936 729 catalog_manager.cc:4841] TS a85a90adc4ba4b51a8c0fc0e4110b5dd (127.7.39.2:35517): tablet 15801e7cec434a9c98af9d6777bf2e6e (table test-table [id=a4f656c3ea354850853ed0a686623e33]) successfully deleted
I20260809 19:13:12.716387 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 808
I20260809 19:13:12.739710 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 1062
I20260809 19:13:12.756789 1547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:12.740682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53154 (local address 127.7.39.2:35517)
0809 19:13:12.740873 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:12.740879 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:12.740900 (+ 21us) server_negotiation.cc:407] Connection header received
0809 19:13:12.740997 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:12.741002 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:12.741070 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:12.741154 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:13:12.742523 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.743278 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.744603 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.744981 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.745087 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:12.751230 (+ 6143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:13:12.751244 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:13:12.751261 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:13:12.751300 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:13:12.753966 (+ 2666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:12.754700 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:12.754708 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:12.754710 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:12.754835 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:12.755201 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:12.755204 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:12.755206 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:12.755570 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:13:12.755845 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:12.756141 (+ 296us) server_negotiation.cc:299] Negotiation successful
0809 19:13:12.756383 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 19:13:12.757491 1270 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:13:12.843336 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 1062
I20260809 19:13:12.869451 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 1283
I20260809 19:13:12.885146 1541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:12.870346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42466 (local address 127.7.39.3:35861)
0809 19:13:12.870494 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:12.870501 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:12.870519 (+ 18us) server_negotiation.cc:407] Connection header received
0809 19:13:12.870632 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:12.870636 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:12.870697 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:12.870777 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:13:12.872533 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.873326 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.875323 (+ 1997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:12.875767 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:12.875860 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:12.879052 (+ 3192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:13:12.879063 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:13:12.879078 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:13:12.879114 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:13:12.881867 (+ 2753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:12.882918 (+ 1051us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:12.882928 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:12.882932 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:12.883147 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:12.883617 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:12.883621 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:12.883623 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:12.883951 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:13:12.884285 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:12.884578 (+ 293us) server_negotiation.cc:299] Negotiation successful
0809 19:13:12.884795 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 19:13:12.885830 1512 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:13:13.004007 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 1283
I20260809 19:13:13.029618 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 701
I20260809 19:13:13.030792 796 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:13:13.141808 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 701
I20260809 19:13:33.170724 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:39609
--webserver_interface=127.7.39.62
--webserver_port=42409
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:42951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:39609
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:13:33.496490 1596 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:13:33.496798 1596 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:13:33.496899 1596 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:13:33.504160 1596 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 19:13:33.504251 1596 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 19:13:33.504293 1596 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 19:13:33.504344 1596 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:13:33.504395 1596 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:13:33.504460 1596 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:13:33.504503 1596 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:13:33.504562 1596 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:13:33.514914 1596 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:42951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:39609
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:39609
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=42409
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:13:33.516072 1596 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:13:33.517289 1596 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:13:33.528680 1605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:33.528607 1610 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:33.528644 1606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:13:33.529634 1596 server_base.cc:1034] running on GCE node
I20260809 19:13:33.530345 1596 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:13:33.531668 1596 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:13:33.532878 1596 hybrid_clock.cc:648] HybridClock initialized: now 1786302813532811 us; error 51 us; skew 500 ppm
I20260809 19:13:33.533201 1596 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:13:33 dist-test-slave-4tdj krb5kdc[32200](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302813, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:13:33.536278 1596 init.cc:377] Logged in from keytab as kudu/127.7.39.62@KRBTEST.COM (short username kudu)
I20260809 19:13:33.537669 1596 webserver.cc:460] Webserver started at http://127.7.39.62:42409/ using document root <none> and password file <none>
I20260809 19:13:33.538329 1596 fs_manager.cc:359] Metadata directory not provided
I20260809 19:13:33.538434 1596 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:13:33.543576 1596 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260809 19:13:33.546200 1623 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:33.547423 1596 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 19:13:33.547590 1596 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "1b0b7554a35d45659eca0632e44e6fd7"
format_stamp: "Formatted at 2026-08-09 19:12:48 on dist-test-slave-4tdj"
server_key: "2995d2ffd76738940c389ff15fd012e0"
server_key_iv: "1e9d2ad618bf5674a2b80fd5d1cf57bb"
server_key_version: "encryptionkey@0"
I20260809 19:13:33.548463 1596 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:13:33.571763 1596 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:13:33.575574 1596 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:13:33.575855 1596 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:13:33.593640 1596 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:39609
I20260809 19:13:33.593693 1713 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:39609 every 8 connection(s)
I20260809 19:13:33.595142 1596 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:13:33.601818 1715 sys_catalog.cc:263] Verifying existing consensus state
I20260809 19:13:33.605029 1715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7: Bootstrap starting.
I20260809 19:13:33.605403 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 1596
I20260809 19:13:33.606447 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.1:38539
--local_ip_for_outbound_sockets=127.7.39.1
--tserver_master_addrs=127.7.39.62:39609
--webserver_port=36709
--webserver_interface=127.7.39.1
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:42951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 19:13:33.627656 1715 log.cc:824] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7: Log is configured to *not* fsync() on all Append() calls
I20260809 19:13:33.645646 1715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 19:13:33.646135 1715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7: Bootstrap complete.
I20260809 19:13:33.655233 1715 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b0b7554a35d45659eca0632e44e6fd7" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39609 } }
I20260809 19:13:33.656081 1715 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b0b7554a35d45659eca0632e44e6fd7, State: Initialized, Role: FOLLOWER
I20260809 19:13:33.656656 1715 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b0b7554a35d45659eca0632e44e6fd7" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39609 } }
I20260809 19:13:33.656867 1715 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:13:33.656977 1715 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:13:33.657150 1715 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [term 2 FOLLOWER]: Advancing to term 3
I20260809 19:13:33.660844 1715 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b0b7554a35d45659eca0632e44e6fd7" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39609 } }
I20260809 19:13:33.661299 1715 leader_election.cc:302] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1b0b7554a35d45659eca0632e44e6fd7; no voters:
I20260809 19:13:33.661926 1715 leader_election.cc:288] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 19:13:33.662050 1722 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [term 3 FOLLOWER]: Leader election won for term 3
I20260809 19:13:33.663208 1722 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [term 3 LEADER]: Becoming Leader. State: Replica: 1b0b7554a35d45659eca0632e44e6fd7, State: Running, Role: LEADER
I20260809 19:13:33.663806 1722 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b0b7554a35d45659eca0632e44e6fd7" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39609 } }
I20260809 19:13:33.664083 1715 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:13:33.666217 1724 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "1b0b7554a35d45659eca0632e44e6fd7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b0b7554a35d45659eca0632e44e6fd7" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39609 } } }
I20260809 19:13:33.666610 1724 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [sys.catalog]: This master's current role is: LEADER
I20260809 19:13:33.668974 1725 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b0b7554a35d45659eca0632e44e6fd7. Latest consensus state: current_term: 3 leader_uuid: "1b0b7554a35d45659eca0632e44e6fd7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b0b7554a35d45659eca0632e44e6fd7" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39609 } } }
I20260809 19:13:33.669373 1725 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7 [sys.catalog]: This master's current role is: LEADER
I20260809 19:13:33.669896 1730 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:13:33.678519 1730 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:13:33.680089 1730 catalog_manager.cc:1259] Loaded cluster ID: f2c79448e8cb4ff58c4eea441eac657a
I20260809 19:13:33.680250 1730 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:13:33.684464 1730 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:13:33.686262 1730 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7: Loaded TSK: 0
I20260809 19:13:33.686510 1730 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1b0b7554a35d45659eca0632e44e6fd7: Loaded TSK: 1
F20260809 19:13:33.687698 1730 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f3ae030c9ad google::LogMessage::Fail() at ??:0
@ 0x7f3ae030f88a google::LogMessage::SendToLog() at ??:0
@ 0x7f3ae030c4de google::LogMessage::Flush() at ??:0
@ 0x7f3ae030da19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f3ae40707d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f3ae405f73e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f3af5d3b1c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f3af5d3a783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f3af5dc62a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7f3af5dc60c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f3af5e105e9 std::function<>::operator()() at ??:0
@ 0x7f3af5d3ecdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f3af5d3cc36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f3af5dc4610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f3af5dc4439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f3ae2f58345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f3ae2f5b91c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f3ae2f5b799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f3ae2f36eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f3ae62106db start_thread at ??:0
@ 0x7f3adf1a661f clone at ??:0
W20260809 19:13:34.013248 1717 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:13:34.013506 1717 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:13:34.013607 1717 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:13:34.020627 1717 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:13:34.020720 1717 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:13:34.020833 1717 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.1
I20260809 19:13:34.029891 1717 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:42951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.1:38539
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.39.1
--webserver_port=36709
--tserver_master_addrs=127.7.39.62:39609
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.1
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:13:34.031015 1717 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:13:34.032188 1717 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:13:34.044579 1792 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:34.044642 1796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:34.044618 1793 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:13:34.045224 1717 server_base.cc:1034] running on GCE node
I20260809 19:13:34.045938 1717 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:13:34.046900 1717 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:13:34.048110 1717 hybrid_clock.cc:648] HybridClock initialized: now 1786302814048063 us; error 52 us; skew 500 ppm
I20260809 19:13:34.048410 1717 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:13:34 dist-test-slave-4tdj krb5kdc[32200](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302814, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:13:34.051411 1717 init.cc:377] Logged in from keytab as kudu/127.7.39.1@KRBTEST.COM (short username kudu)
I20260809 19:13:34.052805 1717 webserver.cc:460] Webserver started at http://127.7.39.1:36709/ using document root <none> and password file <none>
I20260809 19:13:34.053427 1717 fs_manager.cc:359] Metadata directory not provided
I20260809 19:13:34.053560 1717 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:13:34.058701 1717 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 19:13:34.061285 1804 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:34.062626 1717 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:13:34.062776 1717 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/wal
uuid: "296846bc52c94340a527f868acf50cb9"
format_stamp: "Formatted at 2026-08-09 19:12:48 on dist-test-slave-4tdj"
server_key: "e0fa0d940baa8c4ee4e536437d49af57"
server_key_iv: "d643db34e6c3c679d6f612fa4e4dbb71"
server_key_version: "encryptionkey@0"
I20260809 19:13:34.063674 1717 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:13:34.080363 1717 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:13:34.083963 1717 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:13:34.084193 1717 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:13:34.085072 1717 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:13:34.086283 1717 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:13:34.086411 1717 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:34.086509 1717 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:13:34.086597 1717 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:34.117203 1717 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.1:38539
I20260809 19:13:34.117295 1992 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.1:38539 every 8 connection(s)
I20260809 19:13:34.118618 1717 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
I20260809 19:13:34.124828 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 1717
I20260809 19:13:34.125615 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.2:35517
--local_ip_for_outbound_sockets=127.7.39.2
--tserver_master_addrs=127.7.39.62:39609
--webserver_port=39429
--webserver_interface=127.7.39.2
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:42951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 19:13:34.126335 1996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:34.121739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.1:33577)
0809 19:13:34.122710 (+ 971us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:34.122972 (+ 262us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":628,"thread_start_us":345,"threads_started":1}
W20260809 19:13:34.127102 1993 heartbeater.cc:644] Failed to heartbeat to 127.7.39.62:39609 (0 consecutive failures): Network error: Failed to ping master at 127.7.39.62:39609: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
I20260809 19:13:34.127945 1996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:34.127608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.1:56717)
0809 19:13:34.127753 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:34.127824 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 19:13:34.129194 1996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:34.128671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.1:35525)
0809 19:13:34.128954 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:34.129057 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182}
W20260809 19:13:34.129535 1993 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 19:13:34.452646 1998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:13:34.452888 1998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:13:34.452979 1998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:13:34.460083 1998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:13:34.460189 1998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:13:34.460304 1998 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.2
I20260809 19:13:34.469679 1998 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:42951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.2:35517
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.39.2
--webserver_port=39429
--tserver_master_addrs=127.7.39.62:39609
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.2
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:13:34.470890 1998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:13:34.472154 1998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:13:34.484371 2005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:34.484449 2007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:34.484459 2010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:13:34.485754 1998 server_base.cc:1034] running on GCE node
I20260809 19:13:34.486394 1998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:13:34.487273 1998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:13:34.488471 1998 hybrid_clock.cc:648] HybridClock initialized: now 1786302814488431 us; error 31 us; skew 500 ppm
I20260809 19:13:34.488768 1998 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:13:34 dist-test-slave-4tdj krb5kdc[32200](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302814, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:13:34.491685 1998 init.cc:377] Logged in from keytab as kudu/127.7.39.2@KRBTEST.COM (short username kudu)
I20260809 19:13:34.493036 1998 webserver.cc:460] Webserver started at http://127.7.39.2:39429/ using document root <none> and password file <none>
I20260809 19:13:34.493678 1998 fs_manager.cc:359] Metadata directory not provided
I20260809 19:13:34.493794 1998 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:13:34.498885 1998 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:13:34.501376 2031 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:34.502640 1998 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 19:13:34.502797 1998 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/wal
uuid: "a85a90adc4ba4b51a8c0fc0e4110b5dd"
format_stamp: "Formatted at 2026-08-09 19:12:49 on dist-test-slave-4tdj"
server_key: "d5ee79502b62d457784eaa04aa71214a"
server_key_iv: "d5dceb6b4877b352a2921207f9243f24"
server_key_version: "encryptionkey@0"
I20260809 19:13:34.503710 1998 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:13:34.514112 1998 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:13:34.518731 1998 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:13:34.518970 1998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:13:34.519850 1998 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:13:34.521129 1998 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:13:34.521225 1998 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:34.521330 1998 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:13:34.521404 1998 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:34.551373 1998 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.2:35517
I20260809 19:13:34.551440 2215 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.2:35517 every 8 connection(s)
I20260809 19:13:34.552788 1998 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
I20260809 19:13:34.557379 2218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:34.555611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.2:59701)
0809 19:13:34.556328 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:34.556522 (+ 194us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":266,"threads_started":1}
W20260809 19:13:34.557976 2216 heartbeater.cc:644] Failed to heartbeat to 127.7.39.62:39609 (0 consecutive failures): Network error: Failed to ping master at 127.7.39.62:39609: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
I20260809 19:13:34.558745 2218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:34.558455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.2:42883)
0809 19:13:34.558579 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:34.558644 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260809 19:13:34.559595 2218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:34.559300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.2:45537)
0809 19:13:34.559420 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:34.559488 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 19:13:34.559825 2216 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 19:13:34.561499 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 1998
I20260809 19:13:34.562071 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.3:35861
--local_ip_for_outbound_sockets=127.7.39.3
--tserver_master_addrs=127.7.39.62:39609
--webserver_port=43793
--webserver_interface=127.7.39.3
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:42951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:13:34.878677 2221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:13:34.878907 2221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:13:34.879001 2221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:13:34.885969 2221 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:13:34.886062 2221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:13:34.886181 2221 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.3
I20260809 19:13:34.895251 2221 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:42951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.3:35861
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.39.3
--webserver_port=43793
--tserver_master_addrs=127.7.39.62:39609
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.3
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:13:34.896251 2221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:13:34.897400 2221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:13:34.909468 2238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:34.909536 2233 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:34.909504 2236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:13:34.910223 2221 server_base.cc:1034] running on GCE node
I20260809 19:13:34.910785 2221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:13:34.911597 2221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:13:34.912789 2221 hybrid_clock.cc:648] HybridClock initialized: now 1786302814912745 us; error 36 us; skew 500 ppm
I20260809 19:13:34.913054 2221 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:13:34 dist-test-slave-4tdj krb5kdc[32200](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302814, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:13:34.915953 2221 init.cc:377] Logged in from keytab as kudu/127.7.39.3@KRBTEST.COM (short username kudu)
I20260809 19:13:34.917220 2221 webserver.cc:460] Webserver started at http://127.7.39.3:43793/ using document root <none> and password file <none>
I20260809 19:13:34.917809 2221 fs_manager.cc:359] Metadata directory not provided
I20260809 19:13:34.917923 2221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:13:34.922729 2221 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 19:13:34.925133 2247 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:34.926376 2221 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 19:13:34.926524 2221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/wal
uuid: "1b9580420508435a861cee7610aeb01f"
format_stamp: "Formatted at 2026-08-09 19:12:49 on dist-test-slave-4tdj"
server_key: "8ad041f0f1ea27118ea10b1019dd9ced"
server_key_iv: "f9000d12aec8874c98e7c84f99747c69"
server_key_version: "encryptionkey@0"
I20260809 19:13:34.927402 2221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:13:34.940145 2221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:13:34.943653 2221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:13:34.943873 2221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:13:34.944715 2221 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:13:34.945942 2221 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:13:34.946034 2221 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:34.946144 2221 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:13:34.946214 2221 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:34.975112 2221 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.3:35861
I20260809 19:13:34.975176 2439 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.3:35861 every 8 connection(s)
I20260809 19:13:34.976366 2221 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
I20260809 19:13:34.980650 2442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:34.978978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.3:55217)
0809 19:13:34.979667 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:34.979850 (+ 183us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":263,"threads_started":1}
W20260809 19:13:34.981221 2440 heartbeater.cc:644] Failed to heartbeat to 127.7.39.62:39609 (0 consecutive failures): Network error: Failed to ping master at 127.7.39.62:39609: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
I20260809 19:13:34.981923 2442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:34.981643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.3:49747)
0809 19:13:34.981763 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:34.981825 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260809 19:13:34.982642 2442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:34.982365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.3:55609)
0809 19:13:34.982464 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:34.982532 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260809 19:13:34.982846 2440 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 19:13:34.986109 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 2221
I20260809 19:13:35.130805 2445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:35.129974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.1:38769)
0809 19:13:35.130478 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:35.130586 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":231,"threads_started":1}
I20260809 19:13:35.561004 2446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:35.560275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.2:57063)
0809 19:13:35.560694 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:35.560793 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":198,"threads_started":1}
I20260809 19:13:35.984184 2448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:35.983336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.3:41431)
0809 19:13:35.983829 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:35.983921 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":245,"threads_started":1}
I20260809 19:13:36.132339 2450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:36.131588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.1:60753)
0809 19:13:36.132070 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:36.132170 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":241,"threads_started":1}
I20260809 19:13:36.562469 2455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:36.561737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.2:48741)
0809 19:13:36.562202 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:36.562274 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":244,"threads_started":1}
I20260809 19:13:36.985606 2462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:36.984945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.3:32987)
0809 19:13:36.985365 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:36.985452 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":200,"threads_started":1}
I20260809 19:13:37.133728 2463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:37.133092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.1:45251)
0809 19:13:37.133490 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:37.133572 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":202,"threads_started":1}
I20260809 19:13:37.563859 2464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:37.563198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.2:48103)
0809 19:13:37.563620 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:37.563696 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":214,"threads_started":1}
I20260809 19:13:37.986989 2465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:37.986347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.3:44543)
0809 19:13:37.986754 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:37.986833 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":214,"threads_started":1}
I20260809 19:13:38.135279 2467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:38.134538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.1:33741)
0809 19:13:38.135020 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:38.135095 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":243,"threads_started":1}
I20260809 19:13:38.565515 2469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:38.564767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.2:60801)
0809 19:13:38.565219 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:38.565310 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":202,"threads_started":1}
I20260809 19:13:38.988651 2471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:38.987881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.3:53939)
0809 19:13:38.988351 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:38.988442 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":227,"threads_started":1}
I20260809 19:13:39.138850 2473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:39.138024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.1:57989)
0809 19:13:39.138552 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:39.138663 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":260,"threads_started":1}
I20260809 19:13:39.567229 2474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:39.566492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.2:42911)
0809 19:13:39.566959 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:39.567046 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":244,"threads_started":1}
I20260809 19:13:39.990278 2475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:39.989531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.3:59817)
0809 19:13:39.990021 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:39.990119 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":249,"threads_started":1}
I20260809 19:13:40.140535 2476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:40.139793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.1:40813)
0809 19:13:40.140276 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:40.140371 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":255,"threads_started":1}
I20260809 19:13:40.568689 2477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:40.568018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.2:43287)
0809 19:13:40.568438 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:40.568520 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":217,"threads_started":1}
I20260809 19:13:40.991734 2478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:40.991041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.3:43401)
0809 19:13:40.991494 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:40.991580 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":234,"threads_started":1}
I20260809 19:13:41.142189 2479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:41.141351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.1:43461)
0809 19:13:41.141857 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:41.141946 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":211,"threads_started":1}
I20260809 19:13:41.570209 2481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:41.569434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.2:53731)
0809 19:13:41.569913 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:41.569990 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":223,"threads_started":1}
I20260809 19:13:41.993409 2483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:41.992542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.3:38195)
0809 19:13:41.993040 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:41.993146 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":223,"threads_started":1}
I20260809 19:13:42.143711 2484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:42.143018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.1:36911)
0809 19:13:42.143457 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:42.143540 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":198,"threads_started":1}
I20260809 19:13:42.571699 2485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:42.571018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.2:53563)
0809 19:13:42.571431 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:42.571507 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":211,"threads_started":1}
I20260809 19:13:42.994972 2486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:42.994207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.3:39653)
0809 19:13:42.994701 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:42.994794 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":247,"threads_started":1}
I20260809 19:13:43.145227 2488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:43.144471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.1:60403)
0809 19:13:43.144955 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:43.145038 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":246,"threads_started":1}
I20260809 19:13:43.573201 2489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:43.572467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.2:33341)
0809 19:13:43.572941 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:43.573022 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":248,"threads_started":1}
I20260809 19:13:43.996595 2490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:43.995782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.3:34685)
0809 19:13:43.996290 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:43.996377 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":239,"threads_started":1}
I20260809 19:13:44.148638 2491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:44.147780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.1:43437)
0809 19:13:44.148362 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:44.148447 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":251,"threads_started":1}
I20260809 19:13:44.574662 2492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:44.573978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.2:60967)
0809 19:13:44.574412 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:44.574488 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":217,"threads_started":1}
I20260809 19:13:44.998111 2494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:44.997450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.3:57257)
0809 19:13:44.997878 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:44.997951 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":238,"threads_started":1}
I20260809 19:13:45.150400 2495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:45.149596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.1:40525)
0809 19:13:45.150059 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:45.150154 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":235,"threads_started":1}
I20260809 19:13:45.576148 2498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:45.575412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.2:37555)
0809 19:13:45.575862 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:45.575942 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":206,"threads_started":1}
I20260809 19:13:45.999706 2499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:45.998937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.3:46201)
0809 19:13:45.999459 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:45.999542 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":252,"threads_started":1}
I20260809 19:13:46.151892 2500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:46.151189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.1:57761)
0809 19:13:46.151637 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:46.151719 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":216,"threads_started":1}
I20260809 19:13:46.577670 2503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:46.577011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.2:49271)
0809 19:13:46.577432 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:46.577510 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":215,"threads_started":1}
I20260809 19:13:47.001214 2506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:47.000456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.3:59643)
0809 19:13:47.000932 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:47.001025 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":247,"threads_started":1}
I20260809 19:13:47.153421 2508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:47.152684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.1:33569)
0809 19:13:47.153128 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:47.153212 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":205,"threads_started":1}
I20260809 19:13:47.579246 2509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:47.578498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.2:48831)
0809 19:13:47.578989 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:47.579072 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":252,"threads_started":1}
I20260809 19:13:48.002825 2510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:48.002065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.3:50937)
0809 19:13:48.002539 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:48.002638 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":249,"threads_started":1}
I20260809 19:13:48.155077 2511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:48.154333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.1:57103)
0809 19:13:48.154796 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:48.154873 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":252,"threads_started":1}
I20260809 19:13:48.580729 2514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:48.580037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.2:49761)
0809 19:13:48.580473 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:48.580552 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":217,"threads_started":1}
I20260809 19:13:49.004245 2516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:49.003575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.3:53111)
0809 19:13:49.003997 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:49.004073 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":208,"threads_started":1}
I20260809 19:13:49.160163 2517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:49.156057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.1:38765)
0809 19:13:49.159873 (+ 3816us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:49.159952 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3699,"thread_start_us":3597,"threads_started":1}
I20260809 19:13:49.582414 2518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:49.581714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.2:49231)
0809 19:13:49.582103 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:49.582187 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":197,"threads_started":1}
I20260809 19:13:49.989276 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 1717
I20260809 19:13:50.005982 2520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:50.005289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39609 (local address 127.7.39.3:52275)
0809 19:13:50.005728 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:50.005806 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.62:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":217,"threads_started":1}
I20260809 19:13:50.009579 2519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:49.990266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52172 (local address 127.7.39.1:38539)
0809 19:13:49.990846 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:49.990864 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:49.990910 (+ 46us) server_negotiation.cc:407] Connection header received
0809 19:13:49.992524 (+ 1614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:49.992534 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:49.992947 (+ 413us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:49.993238 (+ 291us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:13:49.994579 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:49.995793 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:49.996938 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:49.997572 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:49.997704 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:50.003608 (+ 5904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:13:50.003617 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:13:50.003632 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:13:50.003673 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:13:50.006753 (+ 3080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:50.007394 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:50.007401 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:50.007407 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:50.007570 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:50.007888 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:50.007891 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:50.007893 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:50.008435 (+ 542us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:13:50.008669 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:50.009001 (+ 332us) server_negotiation.cc:299] Negotiation successful
0809 19:13:50.009316 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":224,"threads_started":1}
I20260809 19:13:50.010999 1988 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:13:50.091475 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 1717
I20260809 19:13:50.116303 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 1998
I20260809 19:13:50.133144 2526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:50.117242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54032 (local address 127.7.39.2:35517)
0809 19:13:50.117768 (+ 526us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:50.117783 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:50.117819 (+ 36us) server_negotiation.cc:407] Connection header received
0809 19:13:50.119396 (+ 1577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:50.119407 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:50.119837 (+ 430us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:50.120131 (+ 294us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:13:50.121419 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:50.122753 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:50.123931 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:50.124559 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:50.124686 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:50.127197 (+ 2511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:13:50.127205 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:13:50.127218 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:13:50.127254 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:13:50.130048 (+ 2794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:50.130938 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:50.130944 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:50.130951 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:50.131135 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:50.131445 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:50.131448 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:50.131450 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:50.131959 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:13:50.132180 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:50.132540 (+ 360us) server_negotiation.cc:299] Negotiation successful
0809 19:13:50.132867 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":227,"threads_started":1}
I20260809 19:13:50.134502 2207 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:13:50.215803 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 1998
I20260809 19:13:50.243993 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 2221
I20260809 19:13:50.260848 2529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:50.244998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41770 (local address 127.7.39.3:35861)
0809 19:13:50.245605 (+ 607us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:50.245619 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:50.245663 (+ 44us) server_negotiation.cc:407] Connection header received
0809 19:13:50.247342 (+ 1679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:50.247354 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:50.247792 (+ 438us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:50.248089 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:13:50.249396 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:50.250759 (+ 1363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:50.251962 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:50.252605 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:50.252735 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:50.255159 (+ 2424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:13:50.255168 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:13:50.255182 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:13:50.255220 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:13:50.257983 (+ 2763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:50.258658 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:50.258664 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:50.258670 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:50.258834 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:50.259112 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:50.259115 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:50.259116 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:50.259622 (+ 506us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:13:50.259843 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:50.260176 (+ 333us) server_negotiation.cc:299] Negotiation successful
0809 19:13:50.260557 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":440,"thread_start_us":280,"threads_started":1}
I20260809 19:13:50.262228 2433 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:13:50.343288 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 2221
2026-08-09T19:13:50Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (64066 ms)
[----------] 30 tests from SecurityITest (291664 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:13:50 dist-test-slave-4tdj krb5kdc[2536](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:13:50 dist-test-slave-4tdj krb5kdc[2536](info): set up 2 sockets
Aug 09 19:13:50 dist-test-slave-4tdj krb5kdc[2536](info): commencing operation
krb5kdc: starting...
W20260809 19:13:51.560118 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.174s user 0.003s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:13:51 dist-test-slave-4tdj krb5kdc[2536](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302831, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:13:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:13:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.39.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
I20260809 19:13:51.795006 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:32981
--webserver_interface=127.7.39.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:36373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:32981
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:13:52.115015 2557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:13:52.115267 2557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:13:52.115362 2557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:13:52.122165 2557 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:13:52.122262 2557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:13:52.122344 2557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:13:52.122406 2557 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:13:52.122449 2557 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:13:52.131696 2557 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:36373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:32981
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:32981
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:13:52.132807 2557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:13:52.134016 2557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:13:52.145354 2568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:52.145576 2575 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:52.145948 2569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:13:52.147536 2557 server_base.cc:1034] running on GCE node
I20260809 19:13:52.148475 2557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:13:52.151816 2557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:13:52.153062 2557 hybrid_clock.cc:648] HybridClock initialized: now 1786302832152980 us; error 54 us; skew 500 ppm
I20260809 19:13:52.153447 2557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:13:52 dist-test-slave-4tdj krb5kdc[2536](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302832, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:13:52.157030 2557 init.cc:377] Logged in from keytab as kudu/127.7.39.62@KRBTEST.COM (short username kudu)
I20260809 19:13:52.158663 2557 webserver.cc:460] Webserver started at http://127.7.39.62:38293/ using document root <none> and password file <none>
I20260809 19:13:52.159446 2557 fs_manager.cc:359] Metadata directory not provided
I20260809 19:13:52.159584 2557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:13:52.159863 2557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:13:52.162940 2557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "b198f3dfeefe4b788cd7b0160ea8f5b8"
format_stamp: "Formatted at 2026-08-09 19:13:52 on dist-test-slave-4tdj"
server_key: "51bc5fe1fa5da6a889a8b1eeaaba30c2"
server_key_iv: "54fce36364269cbdc334bb43744268eb"
server_key_version: "encryptionkey@0"
I20260809 19:13:52.163894 2557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "b198f3dfeefe4b788cd7b0160ea8f5b8"
format_stamp: "Formatted at 2026-08-09 19:13:52 on dist-test-slave-4tdj"
server_key: "51bc5fe1fa5da6a889a8b1eeaaba30c2"
server_key_iv: "54fce36364269cbdc334bb43744268eb"
server_key_version: "encryptionkey@0"
I20260809 19:13:52.170147 2557 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260809 19:13:52.174531 2587 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:52.176160 2557 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 19:13:52.176326 2557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "b198f3dfeefe4b788cd7b0160ea8f5b8"
format_stamp: "Formatted at 2026-08-09 19:13:52 on dist-test-slave-4tdj"
server_key: "51bc5fe1fa5da6a889a8b1eeaaba30c2"
server_key_iv: "54fce36364269cbdc334bb43744268eb"
server_key_version: "encryptionkey@0"
I20260809 19:13:52.176558 2557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:13:52.195524 2557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:13:52.199290 2557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:13:52.199509 2557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:13:52.215582 2557 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:32981
I20260809 19:13:52.215610 2686 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:32981 every 8 connection(s)
I20260809 19:13:52.216881 2557 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:13:52.220443 2689 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:13:52.226372 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 2557
I20260809 19:13:52.226554 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:13:52.227185 7324 external_mini_cluster.cc:1428] Setting key 7b9675cbd0778c82a3829bc480901ae8
I20260809 19:13:52.231024 2689 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b198f3dfeefe4b788cd7b0160ea8f5b8: Bootstrap starting.
I20260809 19:13:52.234035 2689 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b198f3dfeefe4b788cd7b0160ea8f5b8: Neither blocks nor log segments found. Creating new log.
I20260809 19:13:52.235111 2689 log.cc:824] T 00000000000000000000000000000000 P b198f3dfeefe4b788cd7b0160ea8f5b8: Log is configured to *not* fsync() on all Append() calls
I20260809 19:13:52.237900 2689 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b198f3dfeefe4b788cd7b0160ea8f5b8: No bootstrap required, opened a new log
Aug 09 19:13:52 dist-test-slave-4tdj krb5kdc[2536](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302831, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:13:52.246102 2689 raft_consensus.cc:348] T 00000000000000000000000000000000 P b198f3dfeefe4b788cd7b0160ea8f5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b198f3dfeefe4b788cd7b0160ea8f5b8" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 32981 } }
I20260809 19:13:52.246510 2689 raft_consensus.cc:374] T 00000000000000000000000000000000 P b198f3dfeefe4b788cd7b0160ea8f5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:13:52.246613 2689 raft_consensus.cc:729] T 00000000000000000000000000000000 P b198f3dfeefe4b788cd7b0160ea8f5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b198f3dfeefe4b788cd7b0160ea8f5b8, State: Initialized, Role: FOLLOWER
I20260809 19:13:52.247262 2689 consensus_queue.cc:260] T 00000000000000000000000000000000 P b198f3dfeefe4b788cd7b0160ea8f5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b198f3dfeefe4b788cd7b0160ea8f5b8" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 32981 } }
I20260809 19:13:52.247555 2689 raft_consensus.cc:388] T 00000000000000000000000000000000 P b198f3dfeefe4b788cd7b0160ea8f5b8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:13:52.247713 2689 raft_consensus.cc:482] T 00000000000000000000000000000000 P b198f3dfeefe4b788cd7b0160ea8f5b8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:13:52.247881 2689 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b198f3dfeefe4b788cd7b0160ea8f5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:13:52.249990 2698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:52.229085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52714 (local address 127.7.39.62:32981)
0809 19:13:52.229880 (+ 795us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:52.229894 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:52.229946 (+ 52us) server_negotiation.cc:407] Connection header received
0809 19:13:52.231929 (+ 1983us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:52.231951 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:52.232292 (+ 341us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:52.232645 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:13:52.234052 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:52.235424 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:52.237154 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:52.237789 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:52.237912 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:52.242576 (+ 4664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:13:52.242583 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:13:52.242600 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:13:52.242646 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:13:52.245555 (+ 2909us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:52.246188 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:52.246194 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:52.246200 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:52.246398 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:52.246779 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:52.246784 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:52.246787 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:52.247475 (+ 688us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:13:52.247802 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:52.248198 (+ 396us) server_negotiation.cc:299] Negotiation successful
0809 19:13:52.248650 (+ 452us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":370,"threads_started":1}
I20260809 19:13:52.251061 2689 raft_consensus.cc:504] T 00000000000000000000000000000000 P b198f3dfeefe4b788cd7b0160ea8f5b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b198f3dfeefe4b788cd7b0160ea8f5b8" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 32981 } }
I20260809 19:13:52.251559 2689 leader_election.cc:302] T 00000000000000000000000000000000 P b198f3dfeefe4b788cd7b0160ea8f5b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b198f3dfeefe4b788cd7b0160ea8f5b8; no voters:
I20260809 19:13:52.252161 2689 leader_election.cc:288] T 00000000000000000000000000000000 P b198f3dfeefe4b788cd7b0160ea8f5b8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:13:52.252303 2704 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b198f3dfeefe4b788cd7b0160ea8f5b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:13:52.253502 2704 raft_consensus.cc:686] T 00000000000000000000000000000000 P b198f3dfeefe4b788cd7b0160ea8f5b8 [term 1 LEADER]: Becoming Leader. State: Replica: b198f3dfeefe4b788cd7b0160ea8f5b8, State: Running, Role: LEADER
I20260809 19:13:52.253973 2704 consensus_queue.cc:237] T 00000000000000000000000000000000 P b198f3dfeefe4b788cd7b0160ea8f5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b198f3dfeefe4b788cd7b0160ea8f5b8" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 32981 } }
I20260809 19:13:52.254431 2689 sys_catalog.cc:564] T 00000000000000000000000000000000 P b198f3dfeefe4b788cd7b0160ea8f5b8 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:13:52.256371 2706 sys_catalog.cc:455] T 00000000000000000000000000000000 P b198f3dfeefe4b788cd7b0160ea8f5b8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b198f3dfeefe4b788cd7b0160ea8f5b8. Latest consensus state: current_term: 1 leader_uuid: "b198f3dfeefe4b788cd7b0160ea8f5b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b198f3dfeefe4b788cd7b0160ea8f5b8" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 32981 } } }
I20260809 19:13:52.256726 2706 sys_catalog.cc:458] T 00000000000000000000000000000000 P b198f3dfeefe4b788cd7b0160ea8f5b8 [sys.catalog]: This master's current role is: LEADER
I20260809 19:13:52.257263 2705 sys_catalog.cc:455] T 00000000000000000000000000000000 P b198f3dfeefe4b788cd7b0160ea8f5b8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b198f3dfeefe4b788cd7b0160ea8f5b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b198f3dfeefe4b788cd7b0160ea8f5b8" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 32981 } } }
I20260809 19:13:52.257961 2705 sys_catalog.cc:458] T 00000000000000000000000000000000 P b198f3dfeefe4b788cd7b0160ea8f5b8 [sys.catalog]: This master's current role is: LEADER
I20260809 19:13:52.259140 2714 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:13:52.264561 2714 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:13:52.274137 2714 catalog_manager.cc:1347] Generated new cluster ID: a110d5b2415145d9b42c593794cceb56
I20260809 19:13:52.274232 2714 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:13:52.293663 2714 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:13:52.295387 2714 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:13:52.305321 2714 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b198f3dfeefe4b788cd7b0160ea8f5b8: Generated new TSK 0
I20260809 19:13:52.306160 2714 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.39.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
I20260809 19:13:52.374878 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.1:0
--local_ip_for_outbound_sockets=127.7.39.1
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:32981
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:36373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:13:52.694545 2743 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:13:52.694783 2743 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:13:52.694908 2743 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:13:52.701769 2743 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:13:52.701864 2743 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:13:52.702015 2743 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.1
I20260809 19:13:52.711246 2743 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:36373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:32981
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.1
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:13:52.712373 2743 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:13:52.713596 2743 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:13:52.725736 2751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:52.725787 2753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:52.725929 2756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:13:52.726657 2743 server_base.cc:1034] running on GCE node
I20260809 19:13:52.727195 2743 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:13:52.728003 2743 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:13:52.729199 2743 hybrid_clock.cc:648] HybridClock initialized: now 1786302832729154 us; error 40 us; skew 500 ppm
I20260809 19:13:52.729472 2743 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:13:52 dist-test-slave-4tdj krb5kdc[2536](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302832, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:13:52.732352 2743 init.cc:377] Logged in from keytab as kudu/127.7.39.1@KRBTEST.COM (short username kudu)
I20260809 19:13:52.733642 2743 webserver.cc:460] Webserver started at http://127.7.39.1:41057/ using document root <none> and password file <none>
I20260809 19:13:52.734256 2743 fs_manager.cc:359] Metadata directory not provided
I20260809 19:13:52.734390 2743 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:13:52.734668 2743 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:13:52.737367 2743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-0/data/instance:
uuid: "1585978bc8da40fa86fad950f4df5b6f"
format_stamp: "Formatted at 2026-08-09 19:13:52 on dist-test-slave-4tdj"
server_key: "949e14b590c2df7558bf915d55adca07"
server_key_iv: "2159874f2c93ea8cf7b92af0f7ae0fca"
server_key_version: "encryptionkey@0"
I20260809 19:13:52.738090 2743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance:
uuid: "1585978bc8da40fa86fad950f4df5b6f"
format_stamp: "Formatted at 2026-08-09 19:13:52 on dist-test-slave-4tdj"
server_key: "949e14b590c2df7558bf915d55adca07"
server_key_iv: "2159874f2c93ea8cf7b92af0f7ae0fca"
server_key_version: "encryptionkey@0"
I20260809 19:13:52.742803 2743 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 19:13:52.745954 2764 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:52.747215 2743 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:13:52.747354 2743 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-0/wal
uuid: "1585978bc8da40fa86fad950f4df5b6f"
format_stamp: "Formatted at 2026-08-09 19:13:52 on dist-test-slave-4tdj"
server_key: "949e14b590c2df7558bf915d55adca07"
server_key_iv: "2159874f2c93ea8cf7b92af0f7ae0fca"
server_key_version: "encryptionkey@0"
I20260809 19:13:52.747532 2743 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:13:52.784317 2743 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:13:52.788446 2743 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:13:52.788741 2743 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:13:52.789640 2743 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:13:52.790920 2743 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:13:52.791010 2743 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:52.791133 2743 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:13:52.791190 2743 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:52.820637 2743 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.1:45473
I20260809 19:13:52.820693 2964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.1:45473 every 8 connection(s)
I20260809 19:13:52.821813 2743 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
I20260809 19:13:52.827028 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 2743
I20260809 19:13:52.827222 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance
I20260809 19:13:52.827852 7324 external_mini_cluster.cc:1428] Setting key beb43e9fbae8f55f7295bb777f87e02d
Aug 09 19:13:52 dist-test-slave-4tdj krb5kdc[2536](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302832, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:13:52.840188 2969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:52.824123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:39019 (local address 127.7.39.62:32981)
0809 19:13:52.824531 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:52.824535 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:52.825424 (+ 889us) server_negotiation.cc:407] Connection header received
0809 19:13:52.827228 (+ 1804us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:52.827233 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:52.827316 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:52.827420 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:13:52.828943 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:52.829778 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:52.831285 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:52.831673 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:52.831788 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:52.835042 (+ 3254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:13:52.835047 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:13:52.835050 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:13:52.835089 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:13:52.837339 (+ 2250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:52.837998 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:52.838002 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:52.838004 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:52.838132 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:52.838566 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:52.838571 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:52.838573 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:52.838822 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:13:52.838954 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:52.839612 (+ 658us) server_negotiation.cc:299] Negotiation successful
0809 19:13:52.839831 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":203,"threads_started":1}
I20260809 19:13:52.840981 2971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:52.824617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:32981 (local address 127.7.39.1:39019)
0809 19:13:52.825274 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:52.825313 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 19:13:52.826966 (+ 1653us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:13:52.827657 (+ 691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:13:52.827665 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:13:52.828162 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:13:52.828772 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:52.828804 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:52.829920 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:52.829924 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:52.831137 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:52.831150 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:52.831888 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:52.831896 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:52.832122 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:52.832714 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:13:52.832736 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:13:52.834847 (+ 2111us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:13:52.837462 (+ 2615us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:13:52.837470 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:13:52.837484 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:13:52.837876 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:13:52.838233 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:13:52.838238 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:13:52.838242 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:13:52.838451 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:13:52.838944 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:13:52.838951 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:13:52.839246 (+ 295us) client_negotiation.cc:769] Sending connection context
0809 19:13:52.839458 (+ 212us) client_negotiation.cc:240] Negotiation successful
0809 19:13:52.839920 (+ 462us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":257,"threads_started":1}
I20260809 19:13:52.842375 2966 heartbeater.cc:347] Connected to a master server at 127.7.39.62:32981
I20260809 19:13:52.842635 2966 heartbeater.cc:464] Registering TS with master...
I20260809 19:13:52.843287 2966 heartbeater.cc:511] Master 127.7.39.62:32981 requested a full tablet report, sending...
I20260809 19:13:52.845445 2623 ts_manager.cc:194] Registered new tserver with Master: 1585978bc8da40fa86fad950f4df5b6f (127.7.39.1:45473)
I20260809 19:13:52.847431 2623 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.1@KRBTEST.COM'} at 127.7.39.1:39019
WARNING: no policy specified for kudu/127.7.39.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
I20260809 19:13:52.885129 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.2:0
--local_ip_for_outbound_sockets=127.7.39.2
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:32981
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:36373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:13:53.205519 2978 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:13:53.205786 2978 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:13:53.205930 2978 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:13:53.212839 2978 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:13:53.212949 2978 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:13:53.213104 2978 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.2
I20260809 19:13:53.226609 2978 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:36373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:32981
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.2
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:13:53.227924 2978 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:13:53.229496 2978 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:13:53.243269 2987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:53.243232 2992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:53.243314 2988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:13:53.244029 2978 server_base.cc:1034] running on GCE node
I20260809 19:13:53.244576 2978 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:13:53.245434 2978 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:13:53.246649 2978 hybrid_clock.cc:648] HybridClock initialized: now 1786302833246589 us; error 52 us; skew 500 ppm
I20260809 19:13:53.246938 2978 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:13:53 dist-test-slave-4tdj krb5kdc[2536](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302833, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:13:53.249866 2978 init.cc:377] Logged in from keytab as kudu/127.7.39.2@KRBTEST.COM (short username kudu)
I20260809 19:13:53.251271 2978 webserver.cc:460] Webserver started at http://127.7.39.2:41319/ using document root <none> and password file <none>
I20260809 19:13:53.251958 2978 fs_manager.cc:359] Metadata directory not provided
I20260809 19:13:53.252071 2978 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:13:53.252352 2978 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:13:53.255321 2978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-1/data/instance:
uuid: "b526d2ab2f904c9a9a50c50aa11f9f75"
format_stamp: "Formatted at 2026-08-09 19:13:53 on dist-test-slave-4tdj"
server_key: "34d6b3088877917f8bc992c5b3ab2219"
server_key_iv: "aaee8a458f99e099c17234d3fec75313"
server_key_version: "encryptionkey@0"
I20260809 19:13:53.256081 2978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance:
uuid: "b526d2ab2f904c9a9a50c50aa11f9f75"
format_stamp: "Formatted at 2026-08-09 19:13:53 on dist-test-slave-4tdj"
server_key: "34d6b3088877917f8bc992c5b3ab2219"
server_key_iv: "aaee8a458f99e099c17234d3fec75313"
server_key_version: "encryptionkey@0"
I20260809 19:13:53.260870 2978 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 19:13:53.264042 2999 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:53.265309 2978 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 19:13:53.265455 2978 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-1/wal
uuid: "b526d2ab2f904c9a9a50c50aa11f9f75"
format_stamp: "Formatted at 2026-08-09 19:13:53 on dist-test-slave-4tdj"
server_key: "34d6b3088877917f8bc992c5b3ab2219"
server_key_iv: "aaee8a458f99e099c17234d3fec75313"
server_key_version: "encryptionkey@0"
I20260809 19:13:53.265667 2978 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:13:53.283833 2978 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:13:53.288295 2978 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:13:53.288551 2978 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:13:53.289522 2978 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:13:53.291023 2978 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:13:53.291117 2978 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:53.291235 2978 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:13:53.291299 2978 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:53.321825 2978 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.2:38833
I20260809 19:13:53.321879 3200 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.2:38833 every 8 connection(s)
I20260809 19:13:53.323064 2978 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
I20260809 19:13:53.326972 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 2978
I20260809 19:13:53.327135 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance
I20260809 19:13:53.327567 7324 external_mini_cluster.cc:1428] Setting key 1efc9922a25dbb55a1e3b8ef99810833
Aug 09 19:13:53 dist-test-slave-4tdj krb5kdc[2536](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302833, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:13:53.342940 2969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:53.325405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:35895 (local address 127.7.39.62:32981)
0809 19:13:53.325575 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:53.325580 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:53.326697 (+ 1117us) server_negotiation.cc:407] Connection header received
0809 19:13:53.328609 (+ 1912us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:53.328614 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:53.328686 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:53.328771 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:13:53.330461 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:53.331450 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:53.332952 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:53.333488 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:53.333618 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:53.336974 (+ 3356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:13:53.336980 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:13:53.336985 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:13:53.337025 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:13:53.339944 (+ 2919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:53.340593 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:53.340598 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:53.340601 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:53.340751 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:53.341189 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:53.341193 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:53.341195 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:53.341453 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:13:53.341589 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:53.342372 (+ 783us) server_negotiation.cc:299] Negotiation successful
0809 19:13:53.342603 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 19:13:53.343808 3205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:53.325835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:32981 (local address 127.7.39.2:35895)
0809 19:13:53.326527 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:53.326579 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 19:13:53.328373 (+ 1794us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:13:53.329023 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:13:53.329034 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:13:53.329727 (+ 693us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:13:53.330272 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:53.330314 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:53.331616 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:53.331620 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:53.332809 (+ 1189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:53.332820 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:53.333697 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:53.333703 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:53.333890 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:53.334517 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:13:53.334545 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:13:53.336736 (+ 2191us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:13:53.340067 (+ 3331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:13:53.340073 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:13:53.340084 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:13:53.340469 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:13:53.340876 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:13:53.340879 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:13:53.340882 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:13:53.341057 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:13:53.341594 (+ 537us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:13:53.341602 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:13:53.341944 (+ 342us) client_negotiation.cc:769] Sending connection context
0809 19:13:53.342208 (+ 264us) client_negotiation.cc:240] Negotiation successful
0809 19:13:53.342724 (+ 516us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":265,"threads_started":1}
I20260809 19:13:53.345090 3201 heartbeater.cc:347] Connected to a master server at 127.7.39.62:32981
I20260809 19:13:53.345360 3201 heartbeater.cc:464] Registering TS with master...
I20260809 19:13:53.346017 3201 heartbeater.cc:511] Master 127.7.39.62:32981 requested a full tablet report, sending...
I20260809 19:13:53.347420 2623 ts_manager.cc:194] Registered new tserver with Master: b526d2ab2f904c9a9a50c50aa11f9f75 (127.7.39.2:38833)
I20260809 19:13:53.348459 2623 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.2@KRBTEST.COM'} at 127.7.39.2:35895
WARNING: no policy specified for kudu/127.7.39.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
I20260809 19:13:53.383446 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.3:0
--local_ip_for_outbound_sockets=127.7.39.3
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:32981
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:36373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:13:53.699328 3209 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:13:53.699581 3209 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:13:53.699712 3209 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:13:53.706681 3209 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:13:53.706776 3209 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:13:53.706918 3209 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.3
I20260809 19:13:53.716126 3209 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:36373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:32981
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.3
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:13:53.717291 3209 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:13:53.718614 3209 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:13:53.730770 3218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:53.730859 3214 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:53.730837 3215 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:13:53.731992 3209 server_base.cc:1034] running on GCE node
I20260809 19:13:53.732524 3209 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:13:53.733364 3209 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:13:53.734537 3209 hybrid_clock.cc:648] HybridClock initialized: now 1786302833734490 us; error 45 us; skew 500 ppm
I20260809 19:13:53.734807 3209 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:13:53 dist-test-slave-4tdj krb5kdc[2536](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302833, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:13:53.737648 3209 init.cc:377] Logged in from keytab as kudu/127.7.39.3@KRBTEST.COM (short username kudu)
I20260809 19:13:53.738976 3209 webserver.cc:460] Webserver started at http://127.7.39.3:39607/ using document root <none> and password file <none>
I20260809 19:13:53.739567 3209 fs_manager.cc:359] Metadata directory not provided
I20260809 19:13:53.739661 3209 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:13:53.739904 3209 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:13:53.742601 3209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-2/data/instance:
uuid: "42039ba6188d47a4b892087120231332"
format_stamp: "Formatted at 2026-08-09 19:13:53 on dist-test-slave-4tdj"
server_key: "8c2111ac464545245a567f0c741f3102"
server_key_iv: "020f59af22649cd8743a51afce2e0f6a"
server_key_version: "encryptionkey@0"
I20260809 19:13:53.743312 3209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance:
uuid: "42039ba6188d47a4b892087120231332"
format_stamp: "Formatted at 2026-08-09 19:13:53 on dist-test-slave-4tdj"
server_key: "8c2111ac464545245a567f0c741f3102"
server_key_iv: "020f59af22649cd8743a51afce2e0f6a"
server_key_version: "encryptionkey@0"
I20260809 19:13:53.747921 3209 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260809 19:13:53.751078 3229 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:53.752295 3209 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260809 19:13:53.752429 3209 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-2/wal
uuid: "42039ba6188d47a4b892087120231332"
format_stamp: "Formatted at 2026-08-09 19:13:53 on dist-test-slave-4tdj"
server_key: "8c2111ac464545245a567f0c741f3102"
server_key_iv: "020f59af22649cd8743a51afce2e0f6a"
server_key_version: "encryptionkey@0"
I20260809 19:13:53.752592 3209 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:13:53.774559 3209 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:13:53.777864 3209 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:13:53.778110 3209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:13:53.778963 3209 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:13:53.780123 3209 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:13:53.780203 3209 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:53.780315 3209 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:13:53.780368 3209 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:53.808676 3209 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.3:34867
I20260809 19:13:53.808729 3436 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.3:34867 every 8 connection(s)
I20260809 19:13:53.809778 3209 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
I20260809 19:13:53.814502 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 3209
I20260809 19:13:53.814646 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance
I20260809 19:13:53.815133 7324 external_mini_cluster.cc:1428] Setting key a60b3b866c6f6f0e707c55265e351b28
Aug 09 19:13:53 dist-test-slave-4tdj krb5kdc[2536](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302833, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:13:53.828222 2969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:53.812007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:57945 (local address 127.7.39.62:32981)
0809 19:13:53.812182 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:53.812187 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:53.813170 (+ 983us) server_negotiation.cc:407] Connection header received
0809 19:13:53.814965 (+ 1795us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:53.814971 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:53.815056 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:53.815168 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:13:53.816568 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:53.817500 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:53.819144 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:53.819518 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:53.819616 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:53.822750 (+ 3134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:13:53.822756 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:13:53.822760 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:13:53.822812 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:13:53.825435 (+ 2623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:53.826097 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:53.826101 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:53.826103 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:53.826223 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:53.826650 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:53.826653 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:53.826655 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:53.826907 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:13:53.827036 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:53.827679 (+ 643us) server_negotiation.cc:299] Negotiation successful
0809 19:13:53.827894 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 19:13:53.829071 3440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:53.812370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:32981 (local address 127.7.39.3:57945)
0809 19:13:53.813010 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:53.813052 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 19:13:53.814709 (+ 1657us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:13:53.815353 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:13:53.815360 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:13:53.815806 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:13:53.816398 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:53.816420 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:53.817662 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:53.817667 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:53.819016 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:53.819028 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:53.819688 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:53.819693 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:53.819868 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:53.820512 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:13:53.820533 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:13:53.822546 (+ 2013us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:13:53.825559 (+ 3013us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:13:53.825575 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:13:53.825590 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:13:53.825966 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:13:53.826343 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:13:53.826348 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:13:53.826352 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:13:53.826529 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:13:53.827027 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:13:53.827034 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:13:53.827309 (+ 275us) client_negotiation.cc:769] Sending connection context
0809 19:13:53.827518 (+ 209us) client_negotiation.cc:240] Negotiation successful
0809 19:13:53.827975 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":255,"threads_started":1}
I20260809 19:13:53.830375 3437 heartbeater.cc:347] Connected to a master server at 127.7.39.62:32981
I20260809 19:13:53.830631 3437 heartbeater.cc:464] Registering TS with master...
I20260809 19:13:53.831244 3437 heartbeater.cc:511] Master 127.7.39.62:32981 requested a full tablet report, sending...
I20260809 19:13:53.832504 2623 ts_manager.cc:194] Registered new tserver with Master: 42039ba6188d47a4b892087120231332 (127.7.39.3:34867)
I20260809 19:13:53.833214 2623 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.3@KRBTEST.COM'} at 127.7.39.3:57945
I20260809 19:13:53.842036 7324 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 19:13:53.850013 2966 heartbeater.cc:503] Master 127.7.39.62:32981 was elected leader, sending a full tablet report...
I20260809 19:13:53.858276 2969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:53.846376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52718 (local address 127.7.39.62:32981)
0809 19:13:53.846525 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:53.846531 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:53.846934 (+ 403us) server_negotiation.cc:407] Connection header received
0809 19:13:53.847086 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:53.847091 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:53.847155 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:53.847231 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:13:53.848664 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:53.849327 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:53.850780 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:53.851217 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:53.851324 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:53.853699 (+ 2375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:13:53.853703 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:13:53.853707 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:13:53.853735 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:13:53.856170 (+ 2435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:53.856792 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:53.856796 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:53.856798 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:53.856901 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:53.857182 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:53.857185 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:53.857187 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:53.857455 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:13:53.857646 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:53.857876 (+ 230us) server_negotiation.cc:299] Negotiation successful
0809 19:13:53.858015 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 19:13:53.861637 2623 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52718:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:13:53.868476 2623 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:13:53.902249 3455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:53.879420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:45473 (local address 127.0.0.1:50094)
0809 19:13:53.894620 (+ 15200us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:53.894677 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 19:13:53.894877 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:13:53.896066 (+ 1189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:13:53.896073 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:13:53.896104 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:13:53.896419 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:53.896431 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:53.897786 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:53.897791 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:53.899380 (+ 1589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:53.899396 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:53.901226 (+ 1830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:53.901233 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:53.901480 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:53.901547 (+ 67us) client_negotiation.cc:769] Sending connection context
0809 19:13:53.901650 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 19:13:53.901842 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14908,"thread_start_us":15642,"threads_started":1}
I20260809 19:13:53.903348 3457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:53.879618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50094 (local address 127.7.39.1:45473)
0809 19:13:53.894899 (+ 15281us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:53.894907 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:53.894940 (+ 33us) server_negotiation.cc:407] Connection header received
0809 19:13:53.895649 (+ 709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:53.895656 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:53.895850 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:53.896021 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:13:53.896580 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:53.897652 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:53.899543 (+ 1891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:53.900983 (+ 1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:53.902602 (+ 1619us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:53.902834 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:53.902909 (+ 75us) server_negotiation.cc:299] Negotiation successful
0809 19:13:53.903089 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15106,"thread_start_us":15352,"threads_started":1}
I20260809 19:13:53.907413 2859 tablet_service.cc:1467] Processing CreateTablet for tablet beff661a549e4f5084f03070ce332143 (DEFAULT_TABLE table=test-table [id=df94bb6a0fd04be88ddfd9e5bbe14f69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:13:53.908986 3460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:53.879690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:34867 (local address 127.0.0.1:37418)
0809 19:13:53.900863 (+ 21173us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:53.900883 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 19:13:53.901022 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:13:53.901935 (+ 913us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:13:53.901939 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:13:53.901962 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:13:53.902406 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:53.902419 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:53.904363 (+ 1944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:53.904368 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:53.906628 (+ 2260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:53.906645 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:53.907901 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:53.907907 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:53.908266 (+ 359us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:53.908299 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 19:13:53.908379 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 19:13:53.908495 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21048,"mutex_wait_us":1,"thread_start_us":21549,"threads_started":1}
I20260809 19:13:53.909050 2859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet beff661a549e4f5084f03070ce332143. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:13:53.909557 3459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:53.879979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:38833 (local address 127.0.0.1:35060)
0809 19:13:53.901518 (+ 21539us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:53.901536 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 19:13:53.901727 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:13:53.902531 (+ 804us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:13:53.902535 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:13:53.902573 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:13:53.902961 (+ 388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:53.902974 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:53.905019 (+ 2045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:53.905023 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:53.906697 (+ 1674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:53.906710 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:53.908787 (+ 2077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:53.908794 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:53.908958 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:53.908994 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 19:13:53.909079 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 19:13:53.909200 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21407,"mutex_wait_us":30,"thread_start_us":20618,"threads_started":1}
I20260809 19:13:53.909663 3462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:53.880576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37418 (local address 127.7.39.3:34867)
0809 19:13:53.900448 (+ 19872us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:53.900457 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:53.901006 (+ 549us) server_negotiation.cc:407] Connection header received
0809 19:13:53.901164 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:53.901172 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:53.901432 (+ 260us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:53.901624 (+ 192us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:13:53.902605 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:53.904185 (+ 1580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:53.906817 (+ 2632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:53.907705 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:53.907818 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:53.908042 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:53.909287 (+ 1245us) server_negotiation.cc:299] Negotiation successful
0809 19:13:53.909411 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19700,"thread_start_us":19538,"threads_started":1}
I20260809 19:13:53.910342 3463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:53.881110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35060 (local address 127.7.39.2:38833)
0809 19:13:53.899950 (+ 18840us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:53.899960 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:53.901626 (+ 1666us) server_negotiation.cc:407] Connection header received
0809 19:13:53.901905 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:53.901913 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:53.902139 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:53.902335 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:13:53.903166 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:53.904857 (+ 1691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:53.906908 (+ 2051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:53.908303 (+ 1395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:53.908430 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:53.908620 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:53.909837 (+ 1217us) server_negotiation.cc:299] Negotiation successful
0809 19:13:53.909999 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18678,"thread_start_us":18545,"threads_started":1}
I20260809 19:13:53.913026 3318 tablet_service.cc:1467] Processing CreateTablet for tablet beff661a549e4f5084f03070ce332143 (DEFAULT_TABLE table=test-table [id=df94bb6a0fd04be88ddfd9e5bbe14f69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:13:53.914161 3318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet beff661a549e4f5084f03070ce332143. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:13:53.913826 3075 tablet_service.cc:1467] Processing CreateTablet for tablet beff661a549e4f5084f03070ce332143 (DEFAULT_TABLE table=test-table [id=df94bb6a0fd04be88ddfd9e5bbe14f69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:13:53.915200 3075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet beff661a549e4f5084f03070ce332143. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:13:53.924261 3464 tablet_bootstrap.cc:492] T beff661a549e4f5084f03070ce332143 P 1585978bc8da40fa86fad950f4df5b6f: Bootstrap starting.
I20260809 19:13:53.927340 3464 tablet_bootstrap.cc:654] T beff661a549e4f5084f03070ce332143 P 1585978bc8da40fa86fad950f4df5b6f: Neither blocks nor log segments found. Creating new log.
I20260809 19:13:53.928323 3464 log.cc:824] T beff661a549e4f5084f03070ce332143 P 1585978bc8da40fa86fad950f4df5b6f: Log is configured to *not* fsync() on all Append() calls
I20260809 19:13:53.928936 3466 tablet_bootstrap.cc:492] T beff661a549e4f5084f03070ce332143 P b526d2ab2f904c9a9a50c50aa11f9f75: Bootstrap starting.
I20260809 19:13:53.931064 3465 tablet_bootstrap.cc:492] T beff661a549e4f5084f03070ce332143 P 42039ba6188d47a4b892087120231332: Bootstrap starting.
I20260809 19:13:53.932556 3466 tablet_bootstrap.cc:654] T beff661a549e4f5084f03070ce332143 P b526d2ab2f904c9a9a50c50aa11f9f75: Neither blocks nor log segments found. Creating new log.
I20260809 19:13:53.933773 3465 tablet_bootstrap.cc:654] T beff661a549e4f5084f03070ce332143 P 42039ba6188d47a4b892087120231332: Neither blocks nor log segments found. Creating new log.
I20260809 19:13:53.933774 3466 log.cc:824] T beff661a549e4f5084f03070ce332143 P b526d2ab2f904c9a9a50c50aa11f9f75: Log is configured to *not* fsync() on all Append() calls
I20260809 19:13:53.934841 3465 log.cc:824] T beff661a549e4f5084f03070ce332143 P 42039ba6188d47a4b892087120231332: Log is configured to *not* fsync() on all Append() calls
I20260809 19:13:53.936852 3466 tablet_bootstrap.cc:492] T beff661a549e4f5084f03070ce332143 P b526d2ab2f904c9a9a50c50aa11f9f75: No bootstrap required, opened a new log
I20260809 19:13:53.936853 3464 tablet_bootstrap.cc:492] T beff661a549e4f5084f03070ce332143 P 1585978bc8da40fa86fad950f4df5b6f: No bootstrap required, opened a new log
I20260809 19:13:53.937120 3466 ts_tablet_manager.cc:1397] T beff661a549e4f5084f03070ce332143 P b526d2ab2f904c9a9a50c50aa11f9f75: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260809 19:13:53.937122 3464 ts_tablet_manager.cc:1397] T beff661a549e4f5084f03070ce332143 P 1585978bc8da40fa86fad950f4df5b6f: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.004s
I20260809 19:13:53.937199 3465 tablet_bootstrap.cc:492] T beff661a549e4f5084f03070ce332143 P 42039ba6188d47a4b892087120231332: No bootstrap required, opened a new log
I20260809 19:13:53.937433 3465 ts_tablet_manager.cc:1397] T beff661a549e4f5084f03070ce332143 P 42039ba6188d47a4b892087120231332: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260809 19:13:53.944556 3465 raft_consensus.cc:348] T beff661a549e4f5084f03070ce332143 P 42039ba6188d47a4b892087120231332 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1585978bc8da40fa86fad950f4df5b6f" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 45473 } } peers { permanent_uuid: "42039ba6188d47a4b892087120231332" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34867 } } peers { permanent_uuid: "b526d2ab2f904c9a9a50c50aa11f9f75" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 38833 } }
I20260809 19:13:53.944907 3465 raft_consensus.cc:374] T beff661a549e4f5084f03070ce332143 P 42039ba6188d47a4b892087120231332 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:13:53.945004 3465 raft_consensus.cc:729] T beff661a549e4f5084f03070ce332143 P 42039ba6188d47a4b892087120231332 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42039ba6188d47a4b892087120231332, State: Initialized, Role: FOLLOWER
I20260809 19:13:53.945580 3465 consensus_queue.cc:260] T beff661a549e4f5084f03070ce332143 P 42039ba6188d47a4b892087120231332 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1585978bc8da40fa86fad950f4df5b6f" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 45473 } } peers { permanent_uuid: "42039ba6188d47a4b892087120231332" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34867 } } peers { permanent_uuid: "b526d2ab2f904c9a9a50c50aa11f9f75" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 38833 } }
I20260809 19:13:53.946586 3437 heartbeater.cc:503] Master 127.7.39.62:32981 was elected leader, sending a full tablet report...
I20260809 19:13:53.947084 3465 ts_tablet_manager.cc:1428] T beff661a549e4f5084f03070ce332143 P 42039ba6188d47a4b892087120231332: Time spent starting tablet: real 0.010s user 0.009s sys 0.000s
I20260809 19:13:53.947139 3466 raft_consensus.cc:348] T beff661a549e4f5084f03070ce332143 P b526d2ab2f904c9a9a50c50aa11f9f75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1585978bc8da40fa86fad950f4df5b6f" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 45473 } } peers { permanent_uuid: "42039ba6188d47a4b892087120231332" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34867 } } peers { permanent_uuid: "b526d2ab2f904c9a9a50c50aa11f9f75" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 38833 } }
I20260809 19:13:53.947525 3466 raft_consensus.cc:374] T beff661a549e4f5084f03070ce332143 P b526d2ab2f904c9a9a50c50aa11f9f75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:13:53.947647 3466 raft_consensus.cc:729] T beff661a549e4f5084f03070ce332143 P b526d2ab2f904c9a9a50c50aa11f9f75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b526d2ab2f904c9a9a50c50aa11f9f75, State: Initialized, Role: FOLLOWER
I20260809 19:13:53.948071 3464 raft_consensus.cc:348] T beff661a549e4f5084f03070ce332143 P 1585978bc8da40fa86fad950f4df5b6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1585978bc8da40fa86fad950f4df5b6f" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 45473 } } peers { permanent_uuid: "42039ba6188d47a4b892087120231332" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34867 } } peers { permanent_uuid: "b526d2ab2f904c9a9a50c50aa11f9f75" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 38833 } }
I20260809 19:13:53.948196 3466 consensus_queue.cc:260] T beff661a549e4f5084f03070ce332143 P b526d2ab2f904c9a9a50c50aa11f9f75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1585978bc8da40fa86fad950f4df5b6f" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 45473 } } peers { permanent_uuid: "42039ba6188d47a4b892087120231332" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34867 } } peers { permanent_uuid: "b526d2ab2f904c9a9a50c50aa11f9f75" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 38833 } }
I20260809 19:13:53.948455 3464 raft_consensus.cc:374] T beff661a549e4f5084f03070ce332143 P 1585978bc8da40fa86fad950f4df5b6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:13:53.948556 3464 raft_consensus.cc:729] T beff661a549e4f5084f03070ce332143 P 1585978bc8da40fa86fad950f4df5b6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1585978bc8da40fa86fad950f4df5b6f, State: Initialized, Role: FOLLOWER
I20260809 19:13:53.949765 3464 consensus_queue.cc:260] T beff661a549e4f5084f03070ce332143 P 1585978bc8da40fa86fad950f4df5b6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1585978bc8da40fa86fad950f4df5b6f" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 45473 } } peers { permanent_uuid: "42039ba6188d47a4b892087120231332" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34867 } } peers { permanent_uuid: "b526d2ab2f904c9a9a50c50aa11f9f75" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 38833 } }
I20260809 19:13:53.955214 3201 heartbeater.cc:503] Master 127.7.39.62:32981 was elected leader, sending a full tablet report...
I20260809 19:13:53.956192 3466 ts_tablet_manager.cc:1428] T beff661a549e4f5084f03070ce332143 P b526d2ab2f904c9a9a50c50aa11f9f75: Time spent starting tablet: real 0.019s user 0.012s sys 0.007s
I20260809 19:13:53.957815 3464 ts_tablet_manager.cc:1428] T beff661a549e4f5084f03070ce332143 P 1585978bc8da40fa86fad950f4df5b6f: Time spent starting tablet: real 0.021s user 0.015s sys 0.004s
I20260809 19:13:53.997704 3471 raft_consensus.cc:482] T beff661a549e4f5084f03070ce332143 P b526d2ab2f904c9a9a50c50aa11f9f75 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:13:53.997964 3471 raft_consensus.cc:504] T beff661a549e4f5084f03070ce332143 P b526d2ab2f904c9a9a50c50aa11f9f75 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1585978bc8da40fa86fad950f4df5b6f" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 45473 } } peers { permanent_uuid: "42039ba6188d47a4b892087120231332" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34867 } } peers { permanent_uuid: "b526d2ab2f904c9a9a50c50aa11f9f75" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 38833 } }
I20260809 19:13:53.999598 3471 leader_election.cc:288] T beff661a549e4f5084f03070ce332143 P b526d2ab2f904c9a9a50c50aa11f9f75 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1585978bc8da40fa86fad950f4df5b6f (127.7.39.1:45473), 42039ba6188d47a4b892087120231332 (127.7.39.3:34867)
I20260809 19:13:54.006224 3457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:53.999989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:49687 (local address 127.7.39.1:45473)
0809 19:13:54.000202 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:54.000208 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:54.000808 (+ 600us) server_negotiation.cc:407] Connection header received
0809 19:13:54.000958 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:54.000963 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:54.001036 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:54.001119 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:13:54.001683 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:54.002463 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:54.004344 (+ 1881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:54.005271 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:54.005390 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:54.005513 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:54.005827 (+ 314us) server_negotiation.cc:299] Negotiation successful
0809 19:13:54.005965 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260809 19:13:54.006234 3462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:53.999946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:52767 (local address 127.7.39.3:34867)
0809 19:13:54.000147 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:54.000154 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:54.000945 (+ 791us) server_negotiation.cc:407] Connection header received
0809 19:13:54.001106 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:54.001111 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:54.001188 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:54.001281 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:13:54.001865 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:54.002646 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:54.004589 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:54.005337 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:54.005461 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:54.005554 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:54.005893 (+ 339us) server_negotiation.cc:299] Negotiation successful
0809 19:13:54.006013 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 19:13:54.006284 3474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:53.999742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:45473 (local address 127.7.39.2:49687)
0809 19:13:54.000705 (+ 963us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:54.000725 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 19:13:54.000840 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:13:54.001142 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:13:54.001146 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:13:54.001167 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:13:54.001535 (+ 368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:54.001556 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:54.002589 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:54.002595 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:54.004162 (+ 1567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:54.004174 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:54.005510 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:54.005517 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:54.005670 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:54.005696 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 19:13:54.005767 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 19:13:54.005863 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":831,"mutex_wait_us":19,"thread_start_us":611,"threads_started":1}
I20260809 19:13:54.006637 3476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:54.000001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:34867 (local address 127.7.39.2:52767)
0809 19:13:54.000831 (+ 830us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:54.000848 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:13:54.000973 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:13:54.001309 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:13:54.001312 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:13:54.001335 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:13:54.001717 (+ 382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:54.001729 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:54.002816 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:54.002820 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:54.004429 (+ 1609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:54.004445 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:54.005577 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:54.005583 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:54.005724 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:54.005750 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 19:13:54.005855 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 19:13:54.005990 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":713,"mutex_wait_us":25,"thread_start_us":497,"threads_started":1}
I20260809 19:13:54.007287 2894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "beff661a549e4f5084f03070ce332143" candidate_uuid: "b526d2ab2f904c9a9a50c50aa11f9f75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1585978bc8da40fa86fad950f4df5b6f" is_pre_election: true
I20260809 19:13:54.007668 3359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "beff661a549e4f5084f03070ce332143" candidate_uuid: "b526d2ab2f904c9a9a50c50aa11f9f75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42039ba6188d47a4b892087120231332" is_pre_election: true
I20260809 19:13:54.007912 2894 raft_consensus.cc:2454] T beff661a549e4f5084f03070ce332143 P 1585978bc8da40fa86fad950f4df5b6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b526d2ab2f904c9a9a50c50aa11f9f75 in term 0.
I20260809 19:13:54.008239 3359 raft_consensus.cc:2454] T beff661a549e4f5084f03070ce332143 P 42039ba6188d47a4b892087120231332 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b526d2ab2f904c9a9a50c50aa11f9f75 in term 0.
I20260809 19:13:54.008657 3001 leader_election.cc:302] T beff661a549e4f5084f03070ce332143 P b526d2ab2f904c9a9a50c50aa11f9f75 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1585978bc8da40fa86fad950f4df5b6f, b526d2ab2f904c9a9a50c50aa11f9f75; no voters:
I20260809 19:13:54.009052 3471 raft_consensus.cc:2781] T beff661a549e4f5084f03070ce332143 P b526d2ab2f904c9a9a50c50aa11f9f75 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:13:54.009227 3471 raft_consensus.cc:482] T beff661a549e4f5084f03070ce332143 P b526d2ab2f904c9a9a50c50aa11f9f75 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:13:54.009330 3471 raft_consensus.cc:3037] T beff661a549e4f5084f03070ce332143 P b526d2ab2f904c9a9a50c50aa11f9f75 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:13:54.011600 3471 raft_consensus.cc:504] T beff661a549e4f5084f03070ce332143 P b526d2ab2f904c9a9a50c50aa11f9f75 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1585978bc8da40fa86fad950f4df5b6f" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 45473 } } peers { permanent_uuid: "42039ba6188d47a4b892087120231332" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34867 } } peers { permanent_uuid: "b526d2ab2f904c9a9a50c50aa11f9f75" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 38833 } }
I20260809 19:13:54.012183 3471 leader_election.cc:288] T beff661a549e4f5084f03070ce332143 P b526d2ab2f904c9a9a50c50aa11f9f75 [CANDIDATE]: Term 1 election: Requested vote from peers 1585978bc8da40fa86fad950f4df5b6f (127.7.39.1:45473), 42039ba6188d47a4b892087120231332 (127.7.39.3:34867)
I20260809 19:13:54.012562 2894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "beff661a549e4f5084f03070ce332143" candidate_uuid: "b526d2ab2f904c9a9a50c50aa11f9f75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1585978bc8da40fa86fad950f4df5b6f"
I20260809 19:13:54.012594 3359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "beff661a549e4f5084f03070ce332143" candidate_uuid: "b526d2ab2f904c9a9a50c50aa11f9f75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42039ba6188d47a4b892087120231332"
I20260809 19:13:54.012740 3359 raft_consensus.cc:3037] T beff661a549e4f5084f03070ce332143 P 42039ba6188d47a4b892087120231332 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:13:54.012741 2894 raft_consensus.cc:3037] T beff661a549e4f5084f03070ce332143 P 1585978bc8da40fa86fad950f4df5b6f [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:13:54.014870 3359 raft_consensus.cc:2454] T beff661a549e4f5084f03070ce332143 P 42039ba6188d47a4b892087120231332 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b526d2ab2f904c9a9a50c50aa11f9f75 in term 1.
I20260809 19:13:54.015189 2894 raft_consensus.cc:2454] T beff661a549e4f5084f03070ce332143 P 1585978bc8da40fa86fad950f4df5b6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b526d2ab2f904c9a9a50c50aa11f9f75 in term 1.
I20260809 19:13:54.015208 3002 leader_election.cc:302] T beff661a549e4f5084f03070ce332143 P b526d2ab2f904c9a9a50c50aa11f9f75 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42039ba6188d47a4b892087120231332, b526d2ab2f904c9a9a50c50aa11f9f75; no voters:
I20260809 19:13:54.015599 3471 raft_consensus.cc:2781] T beff661a549e4f5084f03070ce332143 P b526d2ab2f904c9a9a50c50aa11f9f75 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:13:54.015971 3471 raft_consensus.cc:686] T beff661a549e4f5084f03070ce332143 P b526d2ab2f904c9a9a50c50aa11f9f75 [term 1 LEADER]: Becoming Leader. State: Replica: b526d2ab2f904c9a9a50c50aa11f9f75, State: Running, Role: LEADER
I20260809 19:13:54.016397 3471 consensus_queue.cc:237] T beff661a549e4f5084f03070ce332143 P b526d2ab2f904c9a9a50c50aa11f9f75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1585978bc8da40fa86fad950f4df5b6f" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 45473 } } peers { permanent_uuid: "42039ba6188d47a4b892087120231332" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34867 } } peers { permanent_uuid: "b526d2ab2f904c9a9a50c50aa11f9f75" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 38833 } }
I20260809 19:13:54.020432 2622 catalog_manager.cc:5495] T beff661a549e4f5084f03070ce332143 P b526d2ab2f904c9a9a50c50aa11f9f75 reported cstate change: term changed from 0 to 1, leader changed from <none> to b526d2ab2f904c9a9a50c50aa11f9f75 (127.7.39.2). New cstate: current_term: 1 leader_uuid: "b526d2ab2f904c9a9a50c50aa11f9f75" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1585978bc8da40fa86fad950f4df5b6f" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42039ba6188d47a4b892087120231332" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b526d2ab2f904c9a9a50c50aa11f9f75" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 38833 } health_report { overall_health: HEALTHY } } }
W20260809 19:13:54.061211 3438 tablet.cc:2369] T beff661a549e4f5084f03070ce332143 P 42039ba6188d47a4b892087120231332: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:13:54.062043 3463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:54.057277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35074 (local address 127.7.39.2:38833)
0809 19:13:54.057441 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:54.057445 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:54.057500 (+ 55us) server_negotiation.cc:407] Connection header received
0809 19:13:54.057691 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:54.057694 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:54.057771 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:54.057887 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:13:54.058189 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:54.058906 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:54.060143 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:54.060517 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:54.060604 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:54.061024 (+ 420us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:13:54.061529 (+ 505us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:13:54.061640 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:54.061759 (+ 119us) server_negotiation.cc:299] Negotiation successful
0809 19:13:54.061822 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 19:13:54.069856 3359 raft_consensus.cc:1261] T beff661a549e4f5084f03070ce332143 P 42039ba6188d47a4b892087120231332 [term 1 FOLLOWER]: Refusing update from remote peer b526d2ab2f904c9a9a50c50aa11f9f75: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:13:54.070142 2894 raft_consensus.cc:1261] T beff661a549e4f5084f03070ce332143 P 1585978bc8da40fa86fad950f4df5b6f [term 1 FOLLOWER]: Refusing update from remote peer b526d2ab2f904c9a9a50c50aa11f9f75: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:13:54.070820 3477 consensus_queue.cc:1035] T beff661a549e4f5084f03070ce332143 P b526d2ab2f904c9a9a50c50aa11f9f75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42039ba6188d47a4b892087120231332" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:13:54.071149 3471 consensus_queue.cc:1035] T beff661a549e4f5084f03070ce332143 P b526d2ab2f904c9a9a50c50aa11f9f75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1585978bc8da40fa86fad950f4df5b6f" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 19:13:54.074122 2967 tablet.cc:2369] T beff661a549e4f5084f03070ce332143 P 1585978bc8da40fa86fad950f4df5b6f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 19:13:54.074805 3204 tablet.cc:2369] T beff661a549e4f5084f03070ce332143 P b526d2ab2f904c9a9a50c50aa11f9f75: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:13:54.083473 3485 mvcc.cc:205] Tried to move back new op lower bound from 7316696408340897792 to 7316696408134696960. Current Snapshot: MvccSnapshot[applied={T|T < 7316696408340897792}]
I20260809 19:13:54.090673 3486 mvcc.cc:205] Tried to move back new op lower bound from 7316696408340897792 to 7316696408134696960. Current Snapshot: MvccSnapshot[applied={T|T < 7316696408340897792}]
I20260809 19:13:54.099766 2622 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52718:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:13:54.100005 2622 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52718:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:13:54.103364 2622 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b198f3dfeefe4b788cd7b0160ea8f5b8: Sending DeleteTablet for 3 replicas of tablet beff661a549e4f5084f03070ce332143
I20260809 19:13:54.104355 2859 tablet_service.cc:1514] Processing DeleteTablet for tablet beff661a549e4f5084f03070ce332143 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:13:54 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:50094
I20260809 19:13:54.104485 3318 tablet_service.cc:1514] Processing DeleteTablet for tablet beff661a549e4f5084f03070ce332143 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:13:54 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:37418
I20260809 19:13:54.105589 3075 tablet_service.cc:1514] Processing DeleteTablet for tablet beff661a549e4f5084f03070ce332143 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:13:54 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:35060
I20260809 19:13:54.107054 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 2743
I20260809 19:13:54.115396 3496 tablet_replica.cc:330] T beff661a549e4f5084f03070ce332143 P 42039ba6188d47a4b892087120231332: stopping tablet replica
I20260809 19:13:54.115980 3496 raft_consensus.cc:2229] T beff661a549e4f5084f03070ce332143 P 42039ba6188d47a4b892087120231332 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:13:54.116605 3496 raft_consensus.cc:2258] T beff661a549e4f5084f03070ce332143 P 42039ba6188d47a4b892087120231332 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:13:54.118965 3496 ts_tablet_manager.cc:1905] T beff661a549e4f5084f03070ce332143 P 42039ba6188d47a4b892087120231332: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:13:54.123390 3495 tablet_replica.cc:330] T beff661a549e4f5084f03070ce332143 P 1585978bc8da40fa86fad950f4df5b6f: stopping tablet replica
I20260809 19:13:54.123858 3495 raft_consensus.cc:2229] T beff661a549e4f5084f03070ce332143 P 1585978bc8da40fa86fad950f4df5b6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:13:54.124269 3497 tablet_replica.cc:330] T beff661a549e4f5084f03070ce332143 P b526d2ab2f904c9a9a50c50aa11f9f75: stopping tablet replica
I20260809 19:13:54.124480 3495 raft_consensus.cc:2258] T beff661a549e4f5084f03070ce332143 P 1585978bc8da40fa86fad950f4df5b6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:13:54.124680 3497 raft_consensus.cc:2229] T beff661a549e4f5084f03070ce332143 P b526d2ab2f904c9a9a50c50aa11f9f75 [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:13:54.125487 3497 raft_consensus.cc:2258] T beff661a549e4f5084f03070ce332143 P b526d2ab2f904c9a9a50c50aa11f9f75 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:13:54.127398 3495 ts_tablet_manager.cc:1905] T beff661a549e4f5084f03070ce332143 P 1585978bc8da40fa86fad950f4df5b6f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:13:54.127497 3497 ts_tablet_manager.cc:1905] T beff661a549e4f5084f03070ce332143 P b526d2ab2f904c9a9a50c50aa11f9f75: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:13:54.130362 3496 ts_tablet_manager.cc:1918] T beff661a549e4f5084f03070ce332143 P 42039ba6188d47a4b892087120231332: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
Aug 09 19:13:54 dist-test-slave-4tdj krb5kdc[2536](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302831, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.1@KRBTEST.COM
I20260809 19:13:54.134104 3496 log.cc:1196] T beff661a549e4f5084f03070ce332143 P 42039ba6188d47a4b892087120231332: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-2/wal/wals/beff661a549e4f5084f03070ce332143
I20260809 19:13:54.134559 3497 ts_tablet_manager.cc:1918] T beff661a549e4f5084f03070ce332143 P b526d2ab2f904c9a9a50c50aa11f9f75: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:13:54.134747 3497 log.cc:1196] T beff661a549e4f5084f03070ce332143 P b526d2ab2f904c9a9a50c50aa11f9f75: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-1/wal/wals/beff661a549e4f5084f03070ce332143
I20260809 19:13:54.135205 3496 ts_tablet_manager.cc:1939] T beff661a549e4f5084f03070ce332143 P 42039ba6188d47a4b892087120231332: Deleting consensus metadata
I20260809 19:13:54.135313 3497 ts_tablet_manager.cc:1939] T beff661a549e4f5084f03070ce332143 P b526d2ab2f904c9a9a50c50aa11f9f75: Deleting consensus metadata
I20260809 19:13:54.137174 2591 catalog_manager.cc:4841] TS b526d2ab2f904c9a9a50c50aa11f9f75 (127.7.39.2:38833): tablet beff661a549e4f5084f03070ce332143 (table test-table [id=df94bb6a0fd04be88ddfd9e5bbe14f69]) successfully deleted
I20260809 19:13:54.139114 2590 catalog_manager.cc:4841] TS 42039ba6188d47a4b892087120231332 (127.7.39.3:34867): tablet beff661a549e4f5084f03070ce332143 (table test-table [id=df94bb6a0fd04be88ddfd9e5bbe14f69]) successfully deleted
I20260809 19:13:54.139880 3495 ts_tablet_manager.cc:1918] T beff661a549e4f5084f03070ce332143 P 1585978bc8da40fa86fad950f4df5b6f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:13:54.140033 3495 log.cc:1196] T beff661a549e4f5084f03070ce332143 P 1585978bc8da40fa86fad950f4df5b6f: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786302538618573-7324-0/minicluster-data/ts-0/wal/wals/beff661a549e4f5084f03070ce332143
I20260809 19:13:54.140517 3495 ts_tablet_manager.cc:1939] T beff661a549e4f5084f03070ce332143 P 1585978bc8da40fa86fad950f4df5b6f: Deleting consensus metadata
I20260809 19:13:54.142138 3457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:54.108605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50102 (local address 127.7.39.1:45473)
0809 19:13:54.108788 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:54.108795 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:54.123611 (+ 14816us) server_negotiation.cc:407] Connection header received
0809 19:13:54.123804 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:54.123809 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:54.123917 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:54.124032 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:13:54.126104 (+ 2072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:54.127204 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:54.128992 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:54.129614 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:54.129712 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:54.135105 (+ 5393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:13:54.135121 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:13:54.135138 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:13:54.135187 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:13:54.138841 (+ 3654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:54.139652 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:54.139662 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:54.139666 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:54.139849 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:54.140327 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:54.140332 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:54.140336 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:54.140836 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:13:54.141148 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:54.141483 (+ 335us) server_negotiation.cc:299] Negotiation successful
0809 19:13:54.141725 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 19:13:54.142128 2588 catalog_manager.cc:4841] TS 1585978bc8da40fa86fad950f4df5b6f (127.7.39.1:45473): tablet beff661a549e4f5084f03070ce332143 (table test-table [id=df94bb6a0fd04be88ddfd9e5bbe14f69]) successfully deleted
I20260809 19:13:54.142904 2958 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:13:54.292105 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 2743
I20260809 19:13:54.321813 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 2978
Aug 09 19:13:54 dist-test-slave-4tdj krb5kdc[2536](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302831, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.2@KRBTEST.COM
I20260809 19:13:54.341110 3463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:54.322901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35086 (local address 127.7.39.2:38833)
0809 19:13:54.323087 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:54.323093 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:54.323114 (+ 21us) server_negotiation.cc:407] Connection header received
0809 19:13:54.323183 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:54.323188 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:54.323277 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:54.323402 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:13:54.325025 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:54.326280 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:54.328265 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:54.328940 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:54.329075 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:54.334093 (+ 5018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:13:54.334105 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:13:54.334121 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:13:54.334163 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:13:54.338042 (+ 3879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:54.338896 (+ 854us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:54.338905 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:54.338909 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:54.339081 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:54.339464 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:54.339468 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:54.339472 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:54.339898 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:13:54.340239 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:54.340490 (+ 251us) server_negotiation.cc:299] Negotiation successful
0809 19:13:54.340726 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 19:13:54.341843 3191 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:13:54.451081 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 2978
I20260809 19:13:54.472894 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 3209
Aug 09 19:13:54 dist-test-slave-4tdj krb5kdc[2536](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302831, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.3@KRBTEST.COM
I20260809 19:13:54.487298 3462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:54.473623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37434 (local address 127.7.39.3:34867)
0809 19:13:54.473800 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:54.473806 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:54.473841 (+ 35us) server_negotiation.cc:407] Connection header received
0809 19:13:54.474015 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:54.474019 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:54.474093 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:54.474175 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:13:54.475487 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:54.476207 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:54.477444 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:54.477819 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:54.477927 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:54.482200 (+ 4273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:13:54.482212 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:13:54.482247 (+ 35us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:13:54.482285 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:13:54.484717 (+ 2432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:54.485330 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:54.485338 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:54.485340 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:54.485482 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:54.485823 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:54.485826 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:54.485828 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:54.486171 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:13:54.486455 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:54.486789 (+ 334us) server_negotiation.cc:299] Negotiation successful
0809 19:13:54.486991 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 19:13:54.487890 3429 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:13:54.572865 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 3209
I20260809 19:13:54.594828 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 2557
I20260809 19:13:54.595957 2681 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:13:54.701694 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 2557
2026-08-09T19:13:54Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4357 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-09T19:13:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:13:54Z Disabled control of system clock
I20260809 19:13:54.779218 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:38749
--webserver_interface=127.7.39.62
--webserver_port=0
--builtin_ntp_servers=127.7.39.20:33223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:38749
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 19:13:55.098090 3513 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:13:55.098371 3513 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:13:55.098498 3513 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:13:55.105403 3513 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:13:55.105496 3513 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:13:55.105568 3513 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:13:55.105643 3513 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:13:55.105702 3513 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:13:55.114473 3513 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:33223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:38749
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:38749
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:13:55.115631 3513 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:13:55.117360 3513 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:13:55.128327 3521 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:55.128393 3529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:55.128352 3523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:13:55.129228 3513 server_base.cc:1034] running on GCE node
I20260809 19:13:55.129951 3513 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:13:55.131227 3513 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:13:55.132416 3513 hybrid_clock.cc:648] HybridClock initialized: now 1786302835132371 us; error 36 us; skew 500 ppm
I20260809 19:13:55.132736 3513 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:13:55.137434 3513 webserver.cc:460] Webserver started at http://127.7.39.62:35201/ using document root <none> and password file <none>
I20260809 19:13:55.138098 3513 fs_manager.cc:359] Metadata directory not provided
I20260809 19:13:55.138199 3513 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:13:55.138541 3513 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:13:55.141280 3513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "8c19a330cf944229b0e6f06e57c0ca41"
format_stamp: "Formatted at 2026-08-09 19:13:55 on dist-test-slave-4tdj"
server_key: "662545c68d6d9065b871875eb4d7ba2a"
server_key_iv: "4e87250d9ccf095e79fb0fcfecd9231a"
server_key_version: "encryptionkey@0"
I20260809 19:13:55.142071 3513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "8c19a330cf944229b0e6f06e57c0ca41"
format_stamp: "Formatted at 2026-08-09 19:13:55 on dist-test-slave-4tdj"
server_key: "662545c68d6d9065b871875eb4d7ba2a"
server_key_iv: "4e87250d9ccf095e79fb0fcfecd9231a"
server_key_version: "encryptionkey@0"
I20260809 19:13:55.146859 3513 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 19:13:55.150125 3539 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:55.151367 3513 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:13:55.151530 3513 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "8c19a330cf944229b0e6f06e57c0ca41"
format_stamp: "Formatted at 2026-08-09 19:13:55 on dist-test-slave-4tdj"
server_key: "662545c68d6d9065b871875eb4d7ba2a"
server_key_iv: "4e87250d9ccf095e79fb0fcfecd9231a"
server_key_version: "encryptionkey@0"
I20260809 19:13:55.151728 3513 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:13:55.174132 3513 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:13:55.174902 3513 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:13:55.175158 3513 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:13:55.192039 3513 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:38749
I20260809 19:13:55.192070 3637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:38749 every 8 connection(s)
I20260809 19:13:55.193215 3513 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:13:55.196661 3639 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:13:55.198745 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 3513
I20260809 19:13:55.198904 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:13:55.199342 7324 external_mini_cluster.cc:1428] Setting key 4c0f6feca747ba4f925bad749efd9000
I20260809 19:13:55.207784 3639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c19a330cf944229b0e6f06e57c0ca41: Bootstrap starting.
I20260809 19:13:55.211222 3639 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8c19a330cf944229b0e6f06e57c0ca41: Neither blocks nor log segments found. Creating new log.
I20260809 19:13:55.212298 3639 log.cc:824] T 00000000000000000000000000000000 P 8c19a330cf944229b0e6f06e57c0ca41: Log is configured to *not* fsync() on all Append() calls
I20260809 19:13:55.212393 3645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:55.201125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36108 (local address 127.7.39.62:38749)
0809 19:13:55.202059 (+ 934us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:55.202076 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:55.202116 (+ 40us) server_negotiation.cc:407] Connection header received
0809 19:13:55.203743 (+ 1627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:55.203765 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:55.204177 (+ 412us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:55.204492 (+ 315us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:13:55.205070 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:55.206362 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:55.208207 (+ 1845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:55.208845 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:55.208965 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:55.210187 (+ 1222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:13:55.210194 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:13:55.210206 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:13:55.210771 (+ 565us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:13:55.210863 (+ 92us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:13:55.210885 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:13:55.210987 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:55.211227 (+ 240us) server_negotiation.cc:299] Negotiation successful
0809 19:13:55.211487 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":575,"thread_start_us":350,"threads_started":1}
I20260809 19:13:55.215024 3639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c19a330cf944229b0e6f06e57c0ca41: No bootstrap required, opened a new log
I20260809 19:13:55.222672 3639 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8c19a330cf944229b0e6f06e57c0ca41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c19a330cf944229b0e6f06e57c0ca41" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 38749 } }
I20260809 19:13:55.222986 3639 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8c19a330cf944229b0e6f06e57c0ca41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:13:55.223085 3639 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8c19a330cf944229b0e6f06e57c0ca41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c19a330cf944229b0e6f06e57c0ca41, State: Initialized, Role: FOLLOWER
I20260809 19:13:55.223587 3639 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8c19a330cf944229b0e6f06e57c0ca41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c19a330cf944229b0e6f06e57c0ca41" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 38749 } }
I20260809 19:13:55.223795 3639 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8c19a330cf944229b0e6f06e57c0ca41 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:13:55.223932 3639 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8c19a330cf944229b0e6f06e57c0ca41 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:13:55.224089 3639 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8c19a330cf944229b0e6f06e57c0ca41 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:13:55.226082 3639 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8c19a330cf944229b0e6f06e57c0ca41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c19a330cf944229b0e6f06e57c0ca41" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 38749 } }
I20260809 19:13:55.226574 3639 leader_election.cc:302] T 00000000000000000000000000000000 P 8c19a330cf944229b0e6f06e57c0ca41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8c19a330cf944229b0e6f06e57c0ca41; no voters:
I20260809 19:13:55.227105 3639 leader_election.cc:288] T 00000000000000000000000000000000 P 8c19a330cf944229b0e6f06e57c0ca41 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:13:55.227243 3647 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8c19a330cf944229b0e6f06e57c0ca41 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:13:55.227907 3647 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8c19a330cf944229b0e6f06e57c0ca41 [term 1 LEADER]: Becoming Leader. State: Replica: 8c19a330cf944229b0e6f06e57c0ca41, State: Running, Role: LEADER
I20260809 19:13:55.228381 3647 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8c19a330cf944229b0e6f06e57c0ca41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c19a330cf944229b0e6f06e57c0ca41" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 38749 } }
I20260809 19:13:55.229023 3639 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8c19a330cf944229b0e6f06e57c0ca41 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:13:55.231225 3648 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c19a330cf944229b0e6f06e57c0ca41 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8c19a330cf944229b0e6f06e57c0ca41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c19a330cf944229b0e6f06e57c0ca41" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 38749 } } }
I20260809 19:13:55.231290 3649 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c19a330cf944229b0e6f06e57c0ca41 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8c19a330cf944229b0e6f06e57c0ca41. Latest consensus state: current_term: 1 leader_uuid: "8c19a330cf944229b0e6f06e57c0ca41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c19a330cf944229b0e6f06e57c0ca41" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 38749 } } }
I20260809 19:13:55.231604 3648 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c19a330cf944229b0e6f06e57c0ca41 [sys.catalog]: This master's current role is: LEADER
I20260809 19:13:55.231657 3649 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c19a330cf944229b0e6f06e57c0ca41 [sys.catalog]: This master's current role is: LEADER
I20260809 19:13:55.233116 3657 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:13:55.238444 3657 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:13:55.248023 3657 catalog_manager.cc:1347] Generated new cluster ID: 2bafe926ec2a4a0d8ec3b36959040e8b
I20260809 19:13:55.248132 3657 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:13:55.271627 3657 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:13:55.272802 3657 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:13:55.281822 3657 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8c19a330cf944229b0e6f06e57c0ca41: Generated new TSK 0
I20260809 19:13:55.282641 3657 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:13:55.291174 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.1:0
--local_ip_for_outbound_sockets=127.7.39.1
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:38749
--builtin_ntp_servers=127.7.39.20:33223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 19:13:55.613987 3678 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:13:55.614238 3678 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:13:55.614380 3678 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:13:55.621325 3678 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:13:55.621416 3678 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:13:55.621547 3678 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.1
I20260809 19:13:55.630513 3678 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:33223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:38749
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.1
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:13:55.631755 3678 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:13:55.633558 3678 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:13:55.646685 3686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:55.646745 3689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:55.646768 3685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:13:55.647796 3678 server_base.cc:1034] running on GCE node
I20260809 19:13:55.648375 3678 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:13:55.649286 3678 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:13:55.650492 3678 hybrid_clock.cc:648] HybridClock initialized: now 1786302835650454 us; error 33 us; skew 500 ppm
I20260809 19:13:55.650768 3678 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:13:55.652796 3678 webserver.cc:460] Webserver started at http://127.7.39.1:35411/ using document root <none> and password file <none>
I20260809 19:13:55.653409 3678 fs_manager.cc:359] Metadata directory not provided
I20260809 19:13:55.653494 3678 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:13:55.653759 3678 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:13:55.656760 3678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-0/data/instance:
uuid: "50f84a452ebf48b087453e31751c34a8"
format_stamp: "Formatted at 2026-08-09 19:13:55 on dist-test-slave-4tdj"
server_key: "2b4fbe7c139c4dc724e53b0e73056347"
server_key_iv: "44aac0d3b17141c3febabf3126b14946"
server_key_version: "encryptionkey@0"
I20260809 19:13:55.657488 3678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance:
uuid: "50f84a452ebf48b087453e31751c34a8"
format_stamp: "Formatted at 2026-08-09 19:13:55 on dist-test-slave-4tdj"
server_key: "2b4fbe7c139c4dc724e53b0e73056347"
server_key_iv: "44aac0d3b17141c3febabf3126b14946"
server_key_version: "encryptionkey@0"
I20260809 19:13:55.662388 3678 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260809 19:13:55.665664 3699 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:55.666922 3678 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:13:55.667057 3678 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-0/wal
uuid: "50f84a452ebf48b087453e31751c34a8"
format_stamp: "Formatted at 2026-08-09 19:13:55 on dist-test-slave-4tdj"
server_key: "2b4fbe7c139c4dc724e53b0e73056347"
server_key_iv: "44aac0d3b17141c3febabf3126b14946"
server_key_version: "encryptionkey@0"
I20260809 19:13:55.667234 3678 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:13:55.684355 3678 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:13:55.685050 3678 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:13:55.685282 3678 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:13:55.686168 3678 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:13:55.687593 3678 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:13:55.687677 3678 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:55.687752 3678 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:13:55.687815 3678 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:55.717660 3678 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.1:36539
I20260809 19:13:55.717734 3885 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.1:36539 every 8 connection(s)
I20260809 19:13:55.719015 3678 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
I20260809 19:13:55.726692 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 3678
I20260809 19:13:55.726866 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance
I20260809 19:13:55.727389 7324 external_mini_cluster.cc:1428] Setting key 0165945639b667ed0ecf1124592f496d
I20260809 19:13:55.730206 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.2:0
--local_ip_for_outbound_sockets=127.7.39.2
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:38749
--builtin_ntp_servers=127.7.39.20:33223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 19:13:55.731873 3890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:55.721457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:34091 (local address 127.7.39.62:38749)
0809 19:13:55.721889 (+ 432us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:55.721893 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:55.723234 (+ 1341us) server_negotiation.cc:407] Connection header received
0809 19:13:55.725127 (+ 1893us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:55.725131 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:55.725196 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:55.725298 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:13:55.726257 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:55.727299 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:55.729118 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:55.729595 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:55.729715 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:55.731075 (+ 1360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:13:55.731079 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:13:55.731083 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:13:55.731099 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:13:55.731151 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:13:55.731163 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:13:55.731238 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:55.731458 (+ 220us) server_negotiation.cc:299] Negotiation successful
0809 19:13:55.731553 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":219,"threads_started":1}
I20260809 19:13:55.732862 3891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:55.722040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:38749 (local address 127.7.39.1:34091)
0809 19:13:55.723083 (+ 1043us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:55.723127 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 19:13:55.724900 (+ 1773us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:13:55.725470 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:13:55.725478 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:13:55.725582 (+ 104us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:13:55.726129 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:55.726146 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:55.727470 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:55.727476 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:55.728979 (+ 1503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:55.728994 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:55.729808 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:55.729816 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:55.730082 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:55.730786 (+ 704us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:13:55.730789 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:13:55.730825 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:13:55.730899 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:13:55.731252 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:13:55.731264 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:13:55.731272 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 19:13:55.731431 (+ 159us) client_negotiation.cc:240] Negotiation successful
0809 19:13:55.731819 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":604,"thread_start_us":278,"threads_started":1}
I20260809 19:13:55.734270 3886 heartbeater.cc:347] Connected to a master server at 127.7.39.62:38749
I20260809 19:13:55.734570 3886 heartbeater.cc:464] Registering TS with master...
I20260809 19:13:55.735229 3886 heartbeater.cc:511] Master 127.7.39.62:38749 requested a full tablet report, sending...
I20260809 19:13:55.737170 3569 ts_manager.cc:194] Registered new tserver with Master: 50f84a452ebf48b087453e31751c34a8 (127.7.39.1:36539)
I20260809 19:13:55.738651 3569 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.39.1:34091
W20260809 19:13:56.053565 3892 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:13:56.053815 3892 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:13:56.053897 3892 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:13:56.060926 3892 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:13:56.061014 3892 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:13:56.061115 3892 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.2
I20260809 19:13:56.069685 3892 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:33223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:38749
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.2
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:13:56.070927 3892 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:13:56.072643 3892 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:13:56.084977 3899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:56.084903 3904 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:56.084945 3900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:13:56.085700 3892 server_base.cc:1034] running on GCE node
I20260809 19:13:56.086247 3892 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:13:56.087141 3892 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:13:56.088332 3892 hybrid_clock.cc:648] HybridClock initialized: now 1786302836088296 us; error 28 us; skew 500 ppm
I20260809 19:13:56.088616 3892 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:13:56.090742 3892 webserver.cc:460] Webserver started at http://127.7.39.2:44241/ using document root <none> and password file <none>
I20260809 19:13:56.091367 3892 fs_manager.cc:359] Metadata directory not provided
I20260809 19:13:56.091463 3892 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:13:56.091758 3892 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:13:56.094413 3892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-1/data/instance:
uuid: "18ede06b1f8646689ef74ba675f8c756"
format_stamp: "Formatted at 2026-08-09 19:13:56 on dist-test-slave-4tdj"
server_key: "a71f34a2f626affa184347a7204106e2"
server_key_iv: "37c1ed4f775498a9729b4055d27fb602"
server_key_version: "encryptionkey@0"
I20260809 19:13:56.095158 3892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance:
uuid: "18ede06b1f8646689ef74ba675f8c756"
format_stamp: "Formatted at 2026-08-09 19:13:56 on dist-test-slave-4tdj"
server_key: "a71f34a2f626affa184347a7204106e2"
server_key_iv: "37c1ed4f775498a9729b4055d27fb602"
server_key_version: "encryptionkey@0"
I20260809 19:13:56.099810 3892 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 19:13:56.102949 3912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:56.104126 3892 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 19:13:56.104276 3892 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-1/wal
uuid: "18ede06b1f8646689ef74ba675f8c756"
format_stamp: "Formatted at 2026-08-09 19:13:56 on dist-test-slave-4tdj"
server_key: "a71f34a2f626affa184347a7204106e2"
server_key_iv: "37c1ed4f775498a9729b4055d27fb602"
server_key_version: "encryptionkey@0"
I20260809 19:13:56.104461 3892 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:13:56.122537 3892 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:13:56.123273 3892 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:13:56.123525 3892 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:13:56.124423 3892 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:13:56.125813 3892 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:13:56.125908 3892 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:56.126029 3892 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:13:56.126101 3892 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:56.155745 3892 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.2:45717
I20260809 19:13:56.155797 4105 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.2:45717 every 8 connection(s)
I20260809 19:13:56.156945 3892 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
I20260809 19:13:56.166838 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 3892
I20260809 19:13:56.167008 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance
I20260809 19:13:56.167443 7324 external_mini_cluster.cc:1428] Setting key 8d351e88dc0c85d032696d8d0a6b2cc8
I20260809 19:13:56.168946 3890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:56.159360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:33631 (local address 127.7.39.62:38749)
0809 19:13:56.159528 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:56.159532 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:56.160879 (+ 1347us) server_negotiation.cc:407] Connection header received
0809 19:13:56.162819 (+ 1940us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:56.162824 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:56.162943 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:56.163030 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:13:56.164053 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.164746 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.166241 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.166722 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.166828 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:56.168122 (+ 1294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:13:56.168126 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:13:56.168129 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:13:56.168146 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:13:56.168178 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:13:56.168190 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:13:56.168264 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:56.168520 (+ 256us) server_negotiation.cc:299] Negotiation successful
0809 19:13:56.168610 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 19:13:56.169833 4111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:56.159851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:38749 (local address 127.7.39.2:33631)
0809 19:13:56.160733 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:56.160769 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 19:13:56.162513 (+ 1744us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:13:56.163262 (+ 749us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:13:56.163270 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:13:56.163348 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:13:56.163883 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:56.163899 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.164900 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.164906 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:56.166105 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:56.166117 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.166940 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.166948 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:56.167186 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:56.167811 (+ 625us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:13:56.167813 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:13:56.167854 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:13:56.167934 (+ 80us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:13:56.168290 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:13:56.168301 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:13:56.168309 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 19:13:56.168485 (+ 176us) client_negotiation.cc:240] Negotiation successful
0809 19:13:56.168751 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":286,"threads_started":1}
I20260809 19:13:56.170519 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.3:0
--local_ip_for_outbound_sockets=127.7.39.3
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:38749
--builtin_ntp_servers=127.7.39.20:33223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 19:13:56.171386 4106 heartbeater.cc:347] Connected to a master server at 127.7.39.62:38749
I20260809 19:13:56.171634 4106 heartbeater.cc:464] Registering TS with master...
I20260809 19:13:56.172291 4106 heartbeater.cc:511] Master 127.7.39.62:38749 requested a full tablet report, sending...
I20260809 19:13:56.173590 3569 ts_manager.cc:194] Registered new tserver with Master: 18ede06b1f8646689ef74ba675f8c756 (127.7.39.2:45717)
I20260809 19:13:56.174548 3569 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.39.2:33631
W20260809 19:13:56.488765 4112 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:13:56.489007 4112 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:13:56.489126 4112 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:13:56.496126 4112 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:13:56.496212 4112 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:13:56.496356 4112 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.3
I20260809 19:13:56.504913 4112 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:33223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:38749
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.3
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:13:56.506014 4112 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:13:56.507723 4112 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:13:56.519599 4120 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:56.519637 4125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:56.519680 4122 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:13:56.520603 4112 server_base.cc:1034] running on GCE node
I20260809 19:13:56.521118 4112 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:13:56.521926 4112 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:13:56.523113 4112 hybrid_clock.cc:648] HybridClock initialized: now 1786302836523073 us; error 31 us; skew 500 ppm
I20260809 19:13:56.523391 4112 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:13:56.525398 4112 webserver.cc:460] Webserver started at http://127.7.39.3:44959/ using document root <none> and password file <none>
I20260809 19:13:56.526131 4112 fs_manager.cc:359] Metadata directory not provided
I20260809 19:13:56.526225 4112 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:13:56.526533 4112 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:13:56.529155 4112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-2/data/instance:
uuid: "0fc3adce06fa4073a7fca7be0066dd1b"
format_stamp: "Formatted at 2026-08-09 19:13:56 on dist-test-slave-4tdj"
server_key: "c337e5070ff0bc6fdd6e6861bb438826"
server_key_iv: "123c9bf4448e8deb49c6e03b340f8c67"
server_key_version: "encryptionkey@0"
I20260809 19:13:56.529924 4112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance:
uuid: "0fc3adce06fa4073a7fca7be0066dd1b"
format_stamp: "Formatted at 2026-08-09 19:13:56 on dist-test-slave-4tdj"
server_key: "c337e5070ff0bc6fdd6e6861bb438826"
server_key_iv: "123c9bf4448e8deb49c6e03b340f8c67"
server_key_version: "encryptionkey@0"
I20260809 19:13:56.534478 4112 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.008s sys 0.000s
I20260809 19:13:56.537575 4132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:56.538769 4112 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 19:13:56.538906 4112 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-2/wal
uuid: "0fc3adce06fa4073a7fca7be0066dd1b"
format_stamp: "Formatted at 2026-08-09 19:13:56 on dist-test-slave-4tdj"
server_key: "c337e5070ff0bc6fdd6e6861bb438826"
server_key_iv: "123c9bf4448e8deb49c6e03b340f8c67"
server_key_version: "encryptionkey@0"
I20260809 19:13:56.539090 4112 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:13:56.552089 4112 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:13:56.552745 4112 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:13:56.552978 4112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:13:56.553785 4112 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:13:56.555123 4112 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:13:56.555224 4112 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:56.555323 4112 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:13:56.555403 4112 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:56.585367 4112 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.3:44019
I20260809 19:13:56.585409 4319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.3:44019 every 8 connection(s)
I20260809 19:13:56.586561 4112 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
I20260809 19:13:56.596129 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 4112
I20260809 19:13:56.596278 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance
I20260809 19:13:56.596690 7324 external_mini_cluster.cc:1428] Setting key e91dcf2d25da9645f744424b9169a20c
I20260809 19:13:56.597922 3890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:56.588794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:60129 (local address 127.7.39.62:38749)
0809 19:13:56.588979 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:56.588983 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:56.590207 (+ 1224us) server_negotiation.cc:407] Connection header received
0809 19:13:56.591910 (+ 1703us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:56.591915 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:56.591993 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:56.592092 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:13:56.593091 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.593809 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.595325 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.595732 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.595846 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:56.597087 (+ 1241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:13:56.597093 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:13:56.597097 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:13:56.597120 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:13:56.597161 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:13:56.597177 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:13:56.597270 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:56.597520 (+ 250us) server_negotiation.cc:299] Negotiation successful
0809 19:13:56.597611 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 19:13:56.598937 4325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:56.589244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:38749 (local address 127.7.39.3:60129)
0809 19:13:56.590058 (+ 814us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:56.590099 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 19:13:56.591658 (+ 1559us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:13:56.592309 (+ 651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:13:56.592316 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:13:56.592393 (+ 77us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:13:56.592914 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:56.592929 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.593962 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.593966 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:56.595183 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:56.595196 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.595959 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.595967 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:56.596163 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:56.596800 (+ 637us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:13:56.596804 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:13:56.596845 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:13:56.596911 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:13:56.597290 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:13:56.597303 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:13:56.597312 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 19:13:56.597507 (+ 195us) client_negotiation.cc:240] Negotiation successful
0809 19:13:56.597807 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":274,"threads_started":1}
I20260809 19:13:56.600066 4322 heartbeater.cc:347] Connected to a master server at 127.7.39.62:38749
I20260809 19:13:56.600322 4322 heartbeater.cc:464] Registering TS with master...
I20260809 19:13:56.600986 4322 heartbeater.cc:511] Master 127.7.39.62:38749 requested a full tablet report, sending...
I20260809 19:13:56.602165 3569 ts_manager.cc:194] Registered new tserver with Master: 0fc3adce06fa4073a7fca7be0066dd1b (127.7.39.3:44019)
I20260809 19:13:56.602985 3569 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.39.3:60129
I20260809 19:13:56.611233 7324 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 19:13:56.620038 3890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:56.615080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36110 (local address 127.7.39.62:38749)
0809 19:13:56.615211 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:56.615215 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:56.615637 (+ 422us) server_negotiation.cc:407] Connection header received
0809 19:13:56.615756 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:56.615759 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:56.615825 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:56.615896 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:13:56.616292 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.616924 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.618235 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.618657 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.618745 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:56.619571 (+ 826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:13:56.619575 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:13:56.619578 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:13:56.619595 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:13:56.619622 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:13:56.619633 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:13:56.619695 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:56.619776 (+ 81us) server_negotiation.cc:299] Negotiation successful
0809 19:13:56.619837 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 19:13:56.623198 3569 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36110:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:13:56.629657 3569 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:13:56.650998 4340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:56.640454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:36539 (local address 127.0.0.1:36832)
0809 19:13:56.641356 (+ 902us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:56.641395 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 19:13:56.641615 (+ 220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:13:56.642796 (+ 1181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:13:56.642807 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:13:56.642843 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:13:56.643251 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:56.643309 (+ 58us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.645343 (+ 2034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.645349 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:56.647789 (+ 2440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:56.647806 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.650028 (+ 2222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.650035 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:56.650272 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:56.650354 (+ 82us) client_negotiation.cc:769] Sending connection context
0809 19:13:56.650478 (+ 124us) client_negotiation.cc:240] Negotiation successful
0809 19:13:56.650663 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":635,"thread_start_us":696,"threads_started":1}
I20260809 19:13:56.651918 4341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:56.640602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36832 (local address 127.7.39.1:36539)
0809 19:13:56.641239 (+ 637us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:56.641248 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:56.641500 (+ 252us) server_negotiation.cc:407] Connection header received
0809 19:13:56.641822 (+ 322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:56.641828 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:56.642118 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:56.642423 (+ 305us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:13:56.643526 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.645155 (+ 1629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.648025 (+ 2870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.649511 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.649643 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:56.649884 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:56.651363 (+ 1479us) server_negotiation.cc:299] Negotiation successful
0809 19:13:56.651551 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":471,"thread_start_us":349,"threads_started":1}
I20260809 19:13:56.656965 3778 tablet_service.cc:1467] Processing CreateTablet for tablet 0ee3eee4d94247bdb88aa3f4346ef784 (DEFAULT_TABLE table=test-table [id=5f2dba09ff874c528398b41398ba1779]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:13:56.658473 3778 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ee3eee4d94247bdb88aa3f4346ef784. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:13:56.659940 4340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:56.642780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:45717 (local address 127.0.0.1:55744)
0809 19:13:56.652325 (+ 9545us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:56.652344 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 19:13:56.652444 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:13:56.654377 (+ 1933us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:13:56.654381 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:13:56.654406 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:13:56.654596 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:56.654607 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.656353 (+ 1746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.656357 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:56.657907 (+ 1550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:56.657920 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.659195 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.659201 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:56.659373 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:56.659407 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 19:13:56.659499 (+ 92us) client_negotiation.cc:240] Negotiation successful
0809 19:13:56.659635 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9451,"mutex_wait_us":24,"thread_start_us":10401,"threads_started":1}
I20260809 19:13:56.660037 4347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:56.643351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55744 (local address 127.7.39.2:45717)
0809 19:13:56.653725 (+ 10374us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:56.653733 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:56.653760 (+ 27us) server_negotiation.cc:407] Connection header received
0809 19:13:56.653849 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:56.653855 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:56.654081 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:56.654395 (+ 314us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:13:56.654750 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.656187 (+ 1437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.658053 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.659037 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.659164 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:56.659421 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:56.659540 (+ 119us) server_negotiation.cc:299] Negotiation successful
0809 19:13:56.659686 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10179,"thread_start_us":10060,"threads_started":1}
I20260809 19:13:56.661010 4344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:56.641835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:44019 (local address 127.0.0.1:54518)
0809 19:13:56.642722 (+ 887us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:56.642738 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:13:56.642838 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:13:56.653724 (+ 10886us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:13:56.653728 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:13:56.653754 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:13:56.654103 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:56.654116 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.656055 (+ 1939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.656060 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:56.658221 (+ 2161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:56.658237 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.660290 (+ 2053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.660297 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:56.660462 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:56.660494 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 19:13:56.660589 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 19:13:56.660705 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":755,"mutex_wait_us":4,"thread_start_us":630,"threads_started":1}
I20260809 19:13:56.661119 4345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:56.642062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54518 (local address 127.7.39.3:44019)
0809 19:13:56.653182 (+ 11120us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:56.653190 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:56.653225 (+ 35us) server_negotiation.cc:407] Connection header received
0809 19:13:56.653320 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:56.653328 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:56.653548 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:56.653732 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:13:56.654288 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.655905 (+ 1617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.658465 (+ 2560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.659763 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.659888 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:56.660146 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:56.660640 (+ 494us) server_negotiation.cc:299] Negotiation successful
0809 19:13:56.660785 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10951,"thread_start_us":10810,"threads_started":1}
I20260809 19:13:56.664187 4001 tablet_service.cc:1467] Processing CreateTablet for tablet 0ee3eee4d94247bdb88aa3f4346ef784 (DEFAULT_TABLE table=test-table [id=5f2dba09ff874c528398b41398ba1779]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:13:56.665237 4001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ee3eee4d94247bdb88aa3f4346ef784. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:13:56.665442 4212 tablet_service.cc:1467] Processing CreateTablet for tablet 0ee3eee4d94247bdb88aa3f4346ef784 (DEFAULT_TABLE table=test-table [id=5f2dba09ff874c528398b41398ba1779]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:13:56.666873 4212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ee3eee4d94247bdb88aa3f4346ef784. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:13:56.672462 4348 tablet_bootstrap.cc:492] T 0ee3eee4d94247bdb88aa3f4346ef784 P 50f84a452ebf48b087453e31751c34a8: Bootstrap starting.
I20260809 19:13:56.676237 4348 tablet_bootstrap.cc:654] T 0ee3eee4d94247bdb88aa3f4346ef784 P 50f84a452ebf48b087453e31751c34a8: Neither blocks nor log segments found. Creating new log.
I20260809 19:13:56.676816 4349 tablet_bootstrap.cc:492] T 0ee3eee4d94247bdb88aa3f4346ef784 P 18ede06b1f8646689ef74ba675f8c756: Bootstrap starting.
I20260809 19:13:56.677481 4348 log.cc:824] T 0ee3eee4d94247bdb88aa3f4346ef784 P 50f84a452ebf48b087453e31751c34a8: Log is configured to *not* fsync() on all Append() calls
I20260809 19:13:56.680056 4349 tablet_bootstrap.cc:654] T 0ee3eee4d94247bdb88aa3f4346ef784 P 18ede06b1f8646689ef74ba675f8c756: Neither blocks nor log segments found. Creating new log.
I20260809 19:13:56.680266 4348 tablet_bootstrap.cc:492] T 0ee3eee4d94247bdb88aa3f4346ef784 P 50f84a452ebf48b087453e31751c34a8: No bootstrap required, opened a new log
I20260809 19:13:56.680586 4354 tablet_bootstrap.cc:492] T 0ee3eee4d94247bdb88aa3f4346ef784 P 0fc3adce06fa4073a7fca7be0066dd1b: Bootstrap starting.
I20260809 19:13:56.680622 4348 ts_tablet_manager.cc:1397] T 0ee3eee4d94247bdb88aa3f4346ef784 P 50f84a452ebf48b087453e31751c34a8: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260809 19:13:56.681299 4349 log.cc:824] T 0ee3eee4d94247bdb88aa3f4346ef784 P 18ede06b1f8646689ef74ba675f8c756: Log is configured to *not* fsync() on all Append() calls
I20260809 19:13:56.683926 4354 tablet_bootstrap.cc:654] T 0ee3eee4d94247bdb88aa3f4346ef784 P 0fc3adce06fa4073a7fca7be0066dd1b: Neither blocks nor log segments found. Creating new log.
I20260809 19:13:56.684036 4349 tablet_bootstrap.cc:492] T 0ee3eee4d94247bdb88aa3f4346ef784 P 18ede06b1f8646689ef74ba675f8c756: No bootstrap required, opened a new log
I20260809 19:13:56.684280 4349 ts_tablet_manager.cc:1397] T 0ee3eee4d94247bdb88aa3f4346ef784 P 18ede06b1f8646689ef74ba675f8c756: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.007s
I20260809 19:13:56.685047 4354 log.cc:824] T 0ee3eee4d94247bdb88aa3f4346ef784 P 0fc3adce06fa4073a7fca7be0066dd1b: Log is configured to *not* fsync() on all Append() calls
I20260809 19:13:56.687809 4354 tablet_bootstrap.cc:492] T 0ee3eee4d94247bdb88aa3f4346ef784 P 0fc3adce06fa4073a7fca7be0066dd1b: No bootstrap required, opened a new log
I20260809 19:13:56.688031 4354 ts_tablet_manager.cc:1397] T 0ee3eee4d94247bdb88aa3f4346ef784 P 0fc3adce06fa4073a7fca7be0066dd1b: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.005s
I20260809 19:13:56.690958 4349 raft_consensus.cc:348] T 0ee3eee4d94247bdb88aa3f4346ef784 P 18ede06b1f8646689ef74ba675f8c756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50f84a452ebf48b087453e31751c34a8" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 36539 } } peers { permanent_uuid: "0fc3adce06fa4073a7fca7be0066dd1b" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 44019 } } peers { permanent_uuid: "18ede06b1f8646689ef74ba675f8c756" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 45717 } }
I20260809 19:13:56.691268 4349 raft_consensus.cc:374] T 0ee3eee4d94247bdb88aa3f4346ef784 P 18ede06b1f8646689ef74ba675f8c756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:13:56.691363 4349 raft_consensus.cc:729] T 0ee3eee4d94247bdb88aa3f4346ef784 P 18ede06b1f8646689ef74ba675f8c756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18ede06b1f8646689ef74ba675f8c756, State: Initialized, Role: FOLLOWER
I20260809 19:13:56.691912 4349 consensus_queue.cc:260] T 0ee3eee4d94247bdb88aa3f4346ef784 P 18ede06b1f8646689ef74ba675f8c756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50f84a452ebf48b087453e31751c34a8" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 36539 } } peers { permanent_uuid: "0fc3adce06fa4073a7fca7be0066dd1b" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 44019 } } peers { permanent_uuid: "18ede06b1f8646689ef74ba675f8c756" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 45717 } }
I20260809 19:13:56.692988 4106 heartbeater.cc:503] Master 127.7.39.62:38749 was elected leader, sending a full tablet report...
I20260809 19:13:56.693413 4348 raft_consensus.cc:348] T 0ee3eee4d94247bdb88aa3f4346ef784 P 50f84a452ebf48b087453e31751c34a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50f84a452ebf48b087453e31751c34a8" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 36539 } } peers { permanent_uuid: "0fc3adce06fa4073a7fca7be0066dd1b" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 44019 } } peers { permanent_uuid: "18ede06b1f8646689ef74ba675f8c756" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 45717 } }
I20260809 19:13:56.693816 4348 raft_consensus.cc:374] T 0ee3eee4d94247bdb88aa3f4346ef784 P 50f84a452ebf48b087453e31751c34a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:13:56.693913 4348 raft_consensus.cc:729] T 0ee3eee4d94247bdb88aa3f4346ef784 P 50f84a452ebf48b087453e31751c34a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f84a452ebf48b087453e31751c34a8, State: Initialized, Role: FOLLOWER
I20260809 19:13:56.694589 4348 consensus_queue.cc:260] T 0ee3eee4d94247bdb88aa3f4346ef784 P 50f84a452ebf48b087453e31751c34a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50f84a452ebf48b087453e31751c34a8" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 36539 } } peers { permanent_uuid: "0fc3adce06fa4073a7fca7be0066dd1b" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 44019 } } peers { permanent_uuid: "18ede06b1f8646689ef74ba675f8c756" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 45717 } }
I20260809 19:13:56.695230 4349 ts_tablet_manager.cc:1428] T 0ee3eee4d94247bdb88aa3f4346ef784 P 18ede06b1f8646689ef74ba675f8c756: Time spent starting tablet: real 0.011s user 0.006s sys 0.003s
I20260809 19:13:56.696091 3886 heartbeater.cc:503] Master 127.7.39.62:38749 was elected leader, sending a full tablet report...
I20260809 19:13:56.696671 4348 ts_tablet_manager.cc:1428] T 0ee3eee4d94247bdb88aa3f4346ef784 P 50f84a452ebf48b087453e31751c34a8: Time spent starting tablet: real 0.016s user 0.012s sys 0.000s
I20260809 19:13:56.697453 4354 raft_consensus.cc:348] T 0ee3eee4d94247bdb88aa3f4346ef784 P 0fc3adce06fa4073a7fca7be0066dd1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50f84a452ebf48b087453e31751c34a8" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 36539 } } peers { permanent_uuid: "0fc3adce06fa4073a7fca7be0066dd1b" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 44019 } } peers { permanent_uuid: "18ede06b1f8646689ef74ba675f8c756" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 45717 } }
I20260809 19:13:56.697849 4354 raft_consensus.cc:374] T 0ee3eee4d94247bdb88aa3f4346ef784 P 0fc3adce06fa4073a7fca7be0066dd1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:13:56.697965 4354 raft_consensus.cc:729] T 0ee3eee4d94247bdb88aa3f4346ef784 P 0fc3adce06fa4073a7fca7be0066dd1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fc3adce06fa4073a7fca7be0066dd1b, State: Initialized, Role: FOLLOWER
I20260809 19:13:56.698570 4354 consensus_queue.cc:260] T 0ee3eee4d94247bdb88aa3f4346ef784 P 0fc3adce06fa4073a7fca7be0066dd1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50f84a452ebf48b087453e31751c34a8" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 36539 } } peers { permanent_uuid: "0fc3adce06fa4073a7fca7be0066dd1b" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 44019 } } peers { permanent_uuid: "18ede06b1f8646689ef74ba675f8c756" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 45717 } }
I20260809 19:13:56.699523 4322 heartbeater.cc:503] Master 127.7.39.62:38749 was elected leader, sending a full tablet report...
I20260809 19:13:56.700138 4354 ts_tablet_manager.cc:1428] T 0ee3eee4d94247bdb88aa3f4346ef784 P 0fc3adce06fa4073a7fca7be0066dd1b: Time spent starting tablet: real 0.012s user 0.013s sys 0.000s
I20260809 19:13:56.717254 4357 raft_consensus.cc:482] T 0ee3eee4d94247bdb88aa3f4346ef784 P 18ede06b1f8646689ef74ba675f8c756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:13:56.717489 4357 raft_consensus.cc:504] T 0ee3eee4d94247bdb88aa3f4346ef784 P 18ede06b1f8646689ef74ba675f8c756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50f84a452ebf48b087453e31751c34a8" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 36539 } } peers { permanent_uuid: "0fc3adce06fa4073a7fca7be0066dd1b" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 44019 } } peers { permanent_uuid: "18ede06b1f8646689ef74ba675f8c756" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 45717 } }
I20260809 19:13:56.718977 4357 leader_election.cc:288] T 0ee3eee4d94247bdb88aa3f4346ef784 P 18ede06b1f8646689ef74ba675f8c756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50f84a452ebf48b087453e31751c34a8 (127.7.39.1:36539), 0fc3adce06fa4073a7fca7be0066dd1b (127.7.39.3:44019)
W20260809 19:13:56.721005 3888 tablet.cc:2369] T 0ee3eee4d94247bdb88aa3f4346ef784 P 50f84a452ebf48b087453e31751c34a8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:13:56.726157 4341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:56.719251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:49137 (local address 127.7.39.1:36539)
0809 19:13:56.719433 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:56.719439 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:56.719869 (+ 430us) server_negotiation.cc:407] Connection header received
0809 19:13:56.720094 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:56.720101 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:56.720192 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:56.720255 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:13:56.721064 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.722144 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.724463 (+ 2319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.725270 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.725382 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:56.725465 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:56.725796 (+ 331us) server_negotiation.cc:299] Negotiation successful
0809 19:13:56.725914 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 19:13:56.726555 4362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:56.719153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:36539 (local address 127.7.39.2:49137)
0809 19:13:56.719771 (+ 618us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:56.719793 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 19:13:56.719922 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:13:56.720473 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:13:56.720478 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:13:56.720505 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:13:56.720891 (+ 386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:56.720902 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.722277 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.722282 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:56.724224 (+ 1942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:56.724237 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.725450 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.725456 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:56.725653 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:56.725681 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 19:13:56.725756 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 19:13:56.725878 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":308,"threads_started":1}
I20260809 19:13:56.727478 3813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ee3eee4d94247bdb88aa3f4346ef784" candidate_uuid: "18ede06b1f8646689ef74ba675f8c756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f84a452ebf48b087453e31751c34a8" is_pre_election: true
I20260809 19:13:56.727973 3813 raft_consensus.cc:2454] T 0ee3eee4d94247bdb88aa3f4346ef784 P 50f84a452ebf48b087453e31751c34a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18ede06b1f8646689ef74ba675f8c756 in term 0.
I20260809 19:13:56.728293 4345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:56.719992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:34263 (local address 127.7.39.3:44019)
0809 19:13:56.720140 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:56.720144 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:56.722194 (+ 2050us) server_negotiation.cc:407] Connection header received
0809 19:13:56.722413 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:56.722418 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:56.722490 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:56.722590 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:13:56.723216 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.724222 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.726595 (+ 2373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.727503 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.727624 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:56.727711 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:56.727971 (+ 260us) server_negotiation.cc:299] Negotiation successful
0809 19:13:56.728092 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 19:13:56.728324 4364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:56.719842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:44019 (local address 127.7.39.2:34263)
0809 19:13:56.722086 (+ 2244us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:56.722103 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:13:56.722217 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:13:56.722610 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:13:56.722615 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:13:56.722642 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:13:56.723060 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:56.723070 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.724363 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.724368 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:56.726393 (+ 2025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:56.726408 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.727674 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.727679 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:56.727839 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:56.727861 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 19:13:56.727935 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 19:13:56.728056 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2131,"thread_start_us":1982,"threads_started":1}
I20260809 19:13:56.728884 3914 leader_election.cc:302] T 0ee3eee4d94247bdb88aa3f4346ef784 P 18ede06b1f8646689ef74ba675f8c756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18ede06b1f8646689ef74ba675f8c756, 50f84a452ebf48b087453e31751c34a8; no voters:
I20260809 19:13:56.729107 4247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ee3eee4d94247bdb88aa3f4346ef784" candidate_uuid: "18ede06b1f8646689ef74ba675f8c756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fc3adce06fa4073a7fca7be0066dd1b" is_pre_election: true
I20260809 19:13:56.729287 4357 raft_consensus.cc:2781] T 0ee3eee4d94247bdb88aa3f4346ef784 P 18ede06b1f8646689ef74ba675f8c756 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:13:56.729416 4357 raft_consensus.cc:482] T 0ee3eee4d94247bdb88aa3f4346ef784 P 18ede06b1f8646689ef74ba675f8c756 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:13:56.729501 4357 raft_consensus.cc:3037] T 0ee3eee4d94247bdb88aa3f4346ef784 P 18ede06b1f8646689ef74ba675f8c756 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:13:56.729595 4247 raft_consensus.cc:2454] T 0ee3eee4d94247bdb88aa3f4346ef784 P 0fc3adce06fa4073a7fca7be0066dd1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18ede06b1f8646689ef74ba675f8c756 in term 0.
I20260809 19:13:56.732410 4357 raft_consensus.cc:504] T 0ee3eee4d94247bdb88aa3f4346ef784 P 18ede06b1f8646689ef74ba675f8c756 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50f84a452ebf48b087453e31751c34a8" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 36539 } } peers { permanent_uuid: "0fc3adce06fa4073a7fca7be0066dd1b" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 44019 } } peers { permanent_uuid: "18ede06b1f8646689ef74ba675f8c756" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 45717 } }
I20260809 19:13:56.732894 4357 leader_election.cc:288] T 0ee3eee4d94247bdb88aa3f4346ef784 P 18ede06b1f8646689ef74ba675f8c756 [CANDIDATE]: Term 1 election: Requested vote from peers 50f84a452ebf48b087453e31751c34a8 (127.7.39.1:36539), 0fc3adce06fa4073a7fca7be0066dd1b (127.7.39.3:44019)
I20260809 19:13:56.733292 3813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ee3eee4d94247bdb88aa3f4346ef784" candidate_uuid: "18ede06b1f8646689ef74ba675f8c756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f84a452ebf48b087453e31751c34a8"
I20260809 19:13:56.733351 4247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ee3eee4d94247bdb88aa3f4346ef784" candidate_uuid: "18ede06b1f8646689ef74ba675f8c756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fc3adce06fa4073a7fca7be0066dd1b"
I20260809 19:13:56.733456 3813 raft_consensus.cc:3037] T 0ee3eee4d94247bdb88aa3f4346ef784 P 50f84a452ebf48b087453e31751c34a8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:13:56.733505 4247 raft_consensus.cc:3037] T 0ee3eee4d94247bdb88aa3f4346ef784 P 0fc3adce06fa4073a7fca7be0066dd1b [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:13:56.735569 3813 raft_consensus.cc:2454] T 0ee3eee4d94247bdb88aa3f4346ef784 P 50f84a452ebf48b087453e31751c34a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18ede06b1f8646689ef74ba675f8c756 in term 1.
I20260809 19:13:56.735613 4247 raft_consensus.cc:2454] T 0ee3eee4d94247bdb88aa3f4346ef784 P 0fc3adce06fa4073a7fca7be0066dd1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18ede06b1f8646689ef74ba675f8c756 in term 1.
I20260809 19:13:56.735913 3914 leader_election.cc:302] T 0ee3eee4d94247bdb88aa3f4346ef784 P 18ede06b1f8646689ef74ba675f8c756 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18ede06b1f8646689ef74ba675f8c756, 50f84a452ebf48b087453e31751c34a8; no voters:
I20260809 19:13:56.736161 4357 raft_consensus.cc:2781] T 0ee3eee4d94247bdb88aa3f4346ef784 P 18ede06b1f8646689ef74ba675f8c756 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:13:56.736574 4357 raft_consensus.cc:686] T 0ee3eee4d94247bdb88aa3f4346ef784 P 18ede06b1f8646689ef74ba675f8c756 [term 1 LEADER]: Becoming Leader. State: Replica: 18ede06b1f8646689ef74ba675f8c756, State: Running, Role: LEADER
I20260809 19:13:56.737002 4357 consensus_queue.cc:237] T 0ee3eee4d94247bdb88aa3f4346ef784 P 18ede06b1f8646689ef74ba675f8c756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50f84a452ebf48b087453e31751c34a8" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 36539 } } peers { permanent_uuid: "0fc3adce06fa4073a7fca7be0066dd1b" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 44019 } } peers { permanent_uuid: "18ede06b1f8646689ef74ba675f8c756" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 45717 } }
I20260809 19:13:56.741375 3569 catalog_manager.cc:5495] T 0ee3eee4d94247bdb88aa3f4346ef784 P 18ede06b1f8646689ef74ba675f8c756 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18ede06b1f8646689ef74ba675f8c756 (127.7.39.2). New cstate: current_term: 1 leader_uuid: "18ede06b1f8646689ef74ba675f8c756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50f84a452ebf48b087453e31751c34a8" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 36539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fc3adce06fa4073a7fca7be0066dd1b" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18ede06b1f8646689ef74ba675f8c756" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 45717 } health_report { overall_health: HEALTHY } } }
I20260809 19:13:56.774542 4347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:56.770023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55750 (local address 127.7.39.2:45717)
0809 19:13:56.770181 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:56.770185 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:56.770201 (+ 16us) server_negotiation.cc:407] Connection header received
0809 19:13:56.770268 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:56.770272 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:56.770378 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:56.770486 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:13:56.770786 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.771521 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.772871 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.773262 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.773350 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:56.773706 (+ 356us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:13:56.774143 (+ 437us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:13:56.774247 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:56.774283 (+ 36us) server_negotiation.cc:299] Negotiation successful
0809 19:13:56.774374 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 19:13:56.781876 4247 raft_consensus.cc:1261] T 0ee3eee4d94247bdb88aa3f4346ef784 P 0fc3adce06fa4073a7fca7be0066dd1b [term 1 FOLLOWER]: Refusing update from remote peer 18ede06b1f8646689ef74ba675f8c756: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:13:56.781893 3813 raft_consensus.cc:1261] T 0ee3eee4d94247bdb88aa3f4346ef784 P 50f84a452ebf48b087453e31751c34a8 [term 1 FOLLOWER]: Refusing update from remote peer 18ede06b1f8646689ef74ba675f8c756: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:13:56.782739 4365 consensus_queue.cc:1035] T 0ee3eee4d94247bdb88aa3f4346ef784 P 18ede06b1f8646689ef74ba675f8c756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fc3adce06fa4073a7fca7be0066dd1b" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:13:56.783059 4357 consensus_queue.cc:1035] T 0ee3eee4d94247bdb88aa3f4346ef784 P 18ede06b1f8646689ef74ba675f8c756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f84a452ebf48b087453e31751c34a8" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 36539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:13:56.793269 4373 mvcc.cc:205] Tried to move back new op lower bound from 7316696419449577472 to 7316696419278483456. Current Snapshot: MvccSnapshot[applied={T|T < 7316696419449577472}]
I20260809 19:13:56.804133 3569 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36110:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:13:56.804396 3569 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36110:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:13:56.807796 3569 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8c19a330cf944229b0e6f06e57c0ca41: Sending DeleteTablet for 3 replicas of tablet 0ee3eee4d94247bdb88aa3f4346ef784
I20260809 19:13:56.808804 3778 tablet_service.cc:1514] Processing DeleteTablet for tablet 0ee3eee4d94247bdb88aa3f4346ef784 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:13:56 UTC) from {username='slave'} at 127.0.0.1:36832
I20260809 19:13:56.808982 4001 tablet_service.cc:1514] Processing DeleteTablet for tablet 0ee3eee4d94247bdb88aa3f4346ef784 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:13:56 UTC) from {username='slave'} at 127.0.0.1:55744
I20260809 19:13:56.809173 4212 tablet_service.cc:1514] Processing DeleteTablet for tablet 0ee3eee4d94247bdb88aa3f4346ef784 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:13:56 UTC) from {username='slave'} at 127.0.0.1:54518
I20260809 19:13:56.814679 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 3678
I20260809 19:13:56.821399 4385 tablet_replica.cc:330] T 0ee3eee4d94247bdb88aa3f4346ef784 P 50f84a452ebf48b087453e31751c34a8: stopping tablet replica
I20260809 19:13:56.821908 4388 tablet_replica.cc:330] T 0ee3eee4d94247bdb88aa3f4346ef784 P 0fc3adce06fa4073a7fca7be0066dd1b: stopping tablet replica
I20260809 19:13:56.822461 4388 raft_consensus.cc:2229] T 0ee3eee4d94247bdb88aa3f4346ef784 P 0fc3adce06fa4073a7fca7be0066dd1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:13:56.822947 4385 raft_consensus.cc:2229] T 0ee3eee4d94247bdb88aa3f4346ef784 P 50f84a452ebf48b087453e31751c34a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:13:56.823495 4388 raft_consensus.cc:2258] T 0ee3eee4d94247bdb88aa3f4346ef784 P 0fc3adce06fa4073a7fca7be0066dd1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:13:56.823989 4385 raft_consensus.cc:2258] T 0ee3eee4d94247bdb88aa3f4346ef784 P 50f84a452ebf48b087453e31751c34a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:13:56.827059 4341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:56.815504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36834 (local address 127.7.39.1:36539)
0809 19:13:56.815687 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:56.815693 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:56.818901 (+ 3208us) server_negotiation.cc:407] Connection header received
0809 19:13:56.819082 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:56.819088 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:56.819193 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:56.819284 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:13:56.819923 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.821186 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.822985 (+ 1799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.823585 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.823682 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:56.825500 (+ 1818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:13:56.825510 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:13:56.825525 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:13:56.826195 (+ 670us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:13:56.826249 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:13:56.826274 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:13:56.826379 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:56.826625 (+ 246us) server_negotiation.cc:299] Negotiation successful
0809 19:13:56.826735 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 19:13:56.827555 4388 ts_tablet_manager.cc:1905] T 0ee3eee4d94247bdb88aa3f4346ef784 P 0fc3adce06fa4073a7fca7be0066dd1b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:13:56.828266 3879 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:13:56.829449 4386 tablet_replica.cc:330] T 0ee3eee4d94247bdb88aa3f4346ef784 P 18ede06b1f8646689ef74ba675f8c756: stopping tablet replica
I20260809 19:13:56.829842 4386 raft_consensus.cc:2229] T 0ee3eee4d94247bdb88aa3f4346ef784 P 18ede06b1f8646689ef74ba675f8c756 [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:13:56.830832 4386 raft_consensus.cc:2258] T 0ee3eee4d94247bdb88aa3f4346ef784 P 18ede06b1f8646689ef74ba675f8c756 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:13:56.832979 4386 ts_tablet_manager.cc:1905] T 0ee3eee4d94247bdb88aa3f4346ef784 P 18ede06b1f8646689ef74ba675f8c756: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:13:56.836139 4388 ts_tablet_manager.cc:1918] T 0ee3eee4d94247bdb88aa3f4346ef784 P 0fc3adce06fa4073a7fca7be0066dd1b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:13:56.836326 4388 log.cc:1196] T 0ee3eee4d94247bdb88aa3f4346ef784 P 0fc3adce06fa4073a7fca7be0066dd1b: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-2/wal/wals/0ee3eee4d94247bdb88aa3f4346ef784
I20260809 19:13:56.836867 4388 ts_tablet_manager.cc:1939] T 0ee3eee4d94247bdb88aa3f4346ef784 P 0fc3adce06fa4073a7fca7be0066dd1b: Deleting consensus metadata
I20260809 19:13:56.838721 3541 catalog_manager.cc:4841] TS 0fc3adce06fa4073a7fca7be0066dd1b (127.7.39.3:44019): tablet 0ee3eee4d94247bdb88aa3f4346ef784 (table test-table [id=5f2dba09ff874c528398b41398ba1779]) successfully deleted
I20260809 19:13:56.839818 4386 ts_tablet_manager.cc:1918] T 0ee3eee4d94247bdb88aa3f4346ef784 P 18ede06b1f8646689ef74ba675f8c756: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:13:56.839951 4386 log.cc:1196] T 0ee3eee4d94247bdb88aa3f4346ef784 P 18ede06b1f8646689ef74ba675f8c756: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786302538618573-7324-0/minicluster-data/ts-1/wal/wals/0ee3eee4d94247bdb88aa3f4346ef784
I20260809 19:13:56.840368 4386 ts_tablet_manager.cc:1939] T 0ee3eee4d94247bdb88aa3f4346ef784 P 18ede06b1f8646689ef74ba675f8c756: Deleting consensus metadata
I20260809 19:13:56.841663 3541 catalog_manager.cc:4841] TS 18ede06b1f8646689ef74ba675f8c756 (127.7.39.2:45717): tablet 0ee3eee4d94247bdb88aa3f4346ef784 (table test-table [id=5f2dba09ff874c528398b41398ba1779]) successfully deleted
I20260809 19:13:56.829341 4385 ts_tablet_manager.cc:1905] T 0ee3eee4d94247bdb88aa3f4346ef784 P 50f84a452ebf48b087453e31751c34a8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:13:56.941929 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 3678
I20260809 19:13:56.972415 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 3892
W20260809 19:13:56.972461 3541 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.39.1:36539 (error 108)
I20260809 19:13:56.974958 4344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:56.974436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:36539 (local address 127.0.0.1:36850)
0809 19:13:56.974626 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:56.974770 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:36539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260809 19:13:56.975273 3541 catalog_manager.cc:4584] TS 50f84a452ebf48b087453e31751c34a8 (127.7.39.1:36539): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0ee3eee4d94247bdb88aa3f4346ef784: Network error: Client connection negotiation failed: client connection to 127.7.39.1:36539: connect: Connection refused (error 111)
I20260809 19:13:56.980818 4347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:56.973275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55758 (local address 127.7.39.2:45717)
0809 19:13:56.973458 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:56.973464 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:56.973489 (+ 25us) server_negotiation.cc:407] Connection header received
0809 19:13:56.973732 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:56.973738 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:56.973861 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:56.973970 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:13:56.974616 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.975778 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.977716 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:56.978166 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:56.978273 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:56.979424 (+ 1151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:13:56.979434 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:13:56.979452 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:13:56.980076 (+ 624us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:13:56.980123 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:13:56.980144 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:13:56.980231 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:56.980379 (+ 148us) server_negotiation.cc:299] Negotiation successful
0809 19:13:56.980458 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 19:13:56.981441 4100 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:13:57.035528 4344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:57.034986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:36539 (local address 127.0.0.1:36860)
0809 19:13:57.035223 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:57.035334 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:36539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260809 19:13:57.036698 4344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:57.036274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:36539 (local address 127.0.0.1:36876)
0809 19:13:57.036441 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:57.036530 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:36539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 19:13:57.095536 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 3892
I20260809 19:13:57.097389 4344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:57.096944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:36539 (local address 127.0.0.1:36886)
0809 19:13:57.097132 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:57.097221 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:36539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260809 19:13:57.098492 4344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:57.098135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:36539 (local address 127.0.0.1:36890)
0809 19:13:57.098262 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:57.098380 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:36539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260809 19:13:57.117437 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 4112
I20260809 19:13:57.123479 4345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:57.118139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54526 (local address 127.7.39.3:44019)
0809 19:13:57.118286 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:57.118319 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:57.118339 (+ 20us) server_negotiation.cc:407] Connection header received
0809 19:13:57.118504 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:57.118508 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:57.118601 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:57.118686 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:13:57.119016 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:57.119747 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:57.120983 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:57.121370 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:57.121463 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:57.122377 (+ 914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:13:57.122387 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:13:57.122402 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:13:57.122936 (+ 534us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:13:57.122981 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:13:57.123001 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:13:57.123103 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:57.123170 (+ 67us) server_negotiation.cc:299] Negotiation successful
0809 19:13:57.123256 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 19:13:57.124092 4315 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:13:57.179600 4344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:57.179120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:36539 (local address 127.0.0.1:36894)
0809 19:13:57.179331 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:57.179430 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:36539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260809 19:13:57.180833 4344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:57.180309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:36539 (local address 127.0.0.1:36902)
0809 19:13:57.180572 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:57.180681 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:36539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126}
I20260809 19:13:57.209659 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 4112
I20260809 19:13:57.233094 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 3513
I20260809 19:13:57.234122 3625 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:13:57.339532 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 3513
2026-08-09T19:13:57Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (2647 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:13:57 dist-test-slave-4tdj krb5kdc[4407](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:13:57 dist-test-slave-4tdj krb5kdc[4407](info): set up 2 sockets
Aug 09 19:13:57 dist-test-slave-4tdj krb5kdc[4407](info): commencing operation
krb5kdc: starting...
W20260809 19:13:58.577877 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.187s user 0.004s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:13:58 dist-test-slave-4tdj krb5kdc[4407](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302838, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:13:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:13:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.39.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
I20260809 19:13:58.823627 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:45845
--webserver_interface=127.7.39.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:44639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:45845
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:13:59.146267 4428 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:13:59.146553 4428 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:13:59.146682 4428 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:13:59.153568 4428 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:13:59.153662 4428 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:13:59.153734 4428 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:13:59.153808 4428 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:13:59.153867 4428 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:13:59.163228 4428 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:44639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:45845
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:45845
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:13:59.164417 4428 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:13:59.165688 4428 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:13:59.177183 4436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:59.177470 4438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:59.177994 4435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:13:59.178853 4428 server_base.cc:1034] running on GCE node
I20260809 19:13:59.179728 4428 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:13:59.181382 4428 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:13:59.182590 4428 hybrid_clock.cc:648] HybridClock initialized: now 1786302839182531 us; error 49 us; skew 500 ppm
I20260809 19:13:59.182927 4428 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:13:59 dist-test-slave-4tdj krb5kdc[4407](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302839, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:13:59.186738 4428 init.cc:377] Logged in from keytab as kudu/127.7.39.62@KRBTEST.COM (short username kudu)
I20260809 19:13:59.188639 4428 webserver.cc:460] Webserver started at http://127.7.39.62:34751/ using document root <none> and password file <none>
I20260809 19:13:59.189263 4428 fs_manager.cc:359] Metadata directory not provided
I20260809 19:13:59.189363 4428 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:13:59.189613 4428 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:13:59.192442 4428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "c0bd8e6b5bae41a7a2e97c4ca374c9e7"
format_stamp: "Formatted at 2026-08-09 19:13:59 on dist-test-slave-4tdj"
server_key: "f47496414a058de4b19ca653d6d093b0"
server_key_iv: "53ccf698bacb2c67daa57e2a9eec6cad"
server_key_version: "encryptionkey@0"
I20260809 19:13:59.193131 4428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "c0bd8e6b5bae41a7a2e97c4ca374c9e7"
format_stamp: "Formatted at 2026-08-09 19:13:59 on dist-test-slave-4tdj"
server_key: "f47496414a058de4b19ca653d6d093b0"
server_key_iv: "53ccf698bacb2c67daa57e2a9eec6cad"
server_key_version: "encryptionkey@0"
I20260809 19:13:59.197983 4428 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 19:13:59.201210 4452 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:59.202440 4428 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260809 19:13:59.202574 4428 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "c0bd8e6b5bae41a7a2e97c4ca374c9e7"
format_stamp: "Formatted at 2026-08-09 19:13:59 on dist-test-slave-4tdj"
server_key: "f47496414a058de4b19ca653d6d093b0"
server_key_iv: "53ccf698bacb2c67daa57e2a9eec6cad"
server_key_version: "encryptionkey@0"
I20260809 19:13:59.202728 4428 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:13:59.232383 4428 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:13:59.235973 4428 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:13:59.236207 4428 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:13:59.253418 4428 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:45845
I20260809 19:13:59.253451 4543 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:45845 every 8 connection(s)
I20260809 19:13:59.254740 4428 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:13:59.257135 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 4428
I20260809 19:13:59.257296 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:13:59.257742 7324 external_mini_cluster.cc:1428] Setting key de5ebc6b602fa7ce9bb68c79fcfab99a
I20260809 19:13:59.258582 4544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 19:13:59 dist-test-slave-4tdj krb5kdc[4407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302838, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:13:59.272029 4544 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0bd8e6b5bae41a7a2e97c4ca374c9e7: Bootstrap starting.
I20260809 19:13:59.275945 4544 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c0bd8e6b5bae41a7a2e97c4ca374c9e7: Neither blocks nor log segments found. Creating new log.
I20260809 19:13:59.277141 4544 log.cc:824] T 00000000000000000000000000000000 P c0bd8e6b5bae41a7a2e97c4ca374c9e7: Log is configured to *not* fsync() on all Append() calls
I20260809 19:13:59.280356 4544 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0bd8e6b5bae41a7a2e97c4ca374c9e7: No bootstrap required, opened a new log
I20260809 19:13:59.280588 4549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:59.259497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57676 (local address 127.7.39.62:45845)
0809 19:13:59.260350 (+ 853us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:59.260365 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:59.260414 (+ 49us) server_negotiation.cc:407] Connection header received
0809 19:13:59.262134 (+ 1720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:59.262162 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:59.262676 (+ 514us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:59.263128 (+ 452us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:13:59.264320 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:59.266376 (+ 2056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:59.267593 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:59.268585 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:59.268770 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:59.272619 (+ 3849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:13:59.272630 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:13:59.272646 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:13:59.272694 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:13:59.276482 (+ 3788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:59.277106 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:59.277115 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:59.277123 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:59.277327 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:59.277736 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:59.277742 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:59.277746 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:59.278314 (+ 568us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:13:59.278592 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:59.278941 (+ 349us) server_negotiation.cc:299] Negotiation successful
0809 19:13:59.279340 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":616,"thread_start_us":334,"threads_started":1}
I20260809 19:13:59.287972 4544 raft_consensus.cc:348] T 00000000000000000000000000000000 P c0bd8e6b5bae41a7a2e97c4ca374c9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0bd8e6b5bae41a7a2e97c4ca374c9e7" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 45845 } }
I20260809 19:13:59.288293 4544 raft_consensus.cc:374] T 00000000000000000000000000000000 P c0bd8e6b5bae41a7a2e97c4ca374c9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:13:59.288364 4544 raft_consensus.cc:729] T 00000000000000000000000000000000 P c0bd8e6b5bae41a7a2e97c4ca374c9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0bd8e6b5bae41a7a2e97c4ca374c9e7, State: Initialized, Role: FOLLOWER
I20260809 19:13:59.288846 4544 consensus_queue.cc:260] T 00000000000000000000000000000000 P c0bd8e6b5bae41a7a2e97c4ca374c9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0bd8e6b5bae41a7a2e97c4ca374c9e7" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 45845 } }
I20260809 19:13:59.289043 4544 raft_consensus.cc:388] T 00000000000000000000000000000000 P c0bd8e6b5bae41a7a2e97c4ca374c9e7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:13:59.289143 4544 raft_consensus.cc:482] T 00000000000000000000000000000000 P c0bd8e6b5bae41a7a2e97c4ca374c9e7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:13:59.289266 4544 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c0bd8e6b5bae41a7a2e97c4ca374c9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:13:59.291275 4544 raft_consensus.cc:504] T 00000000000000000000000000000000 P c0bd8e6b5bae41a7a2e97c4ca374c9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0bd8e6b5bae41a7a2e97c4ca374c9e7" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 45845 } }
I20260809 19:13:59.291699 4544 leader_election.cc:302] T 00000000000000000000000000000000 P c0bd8e6b5bae41a7a2e97c4ca374c9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c0bd8e6b5bae41a7a2e97c4ca374c9e7; no voters:
I20260809 19:13:59.292220 4544 leader_election.cc:288] T 00000000000000000000000000000000 P c0bd8e6b5bae41a7a2e97c4ca374c9e7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:13:59.292354 4554 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c0bd8e6b5bae41a7a2e97c4ca374c9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:13:59.292985 4554 raft_consensus.cc:686] T 00000000000000000000000000000000 P c0bd8e6b5bae41a7a2e97c4ca374c9e7 [term 1 LEADER]: Becoming Leader. State: Replica: c0bd8e6b5bae41a7a2e97c4ca374c9e7, State: Running, Role: LEADER
I20260809 19:13:59.293485 4554 consensus_queue.cc:237] T 00000000000000000000000000000000 P c0bd8e6b5bae41a7a2e97c4ca374c9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0bd8e6b5bae41a7a2e97c4ca374c9e7" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 45845 } }
I20260809 19:13:59.294112 4544 sys_catalog.cc:564] T 00000000000000000000000000000000 P c0bd8e6b5bae41a7a2e97c4ca374c9e7 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:13:59.296416 4558 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0bd8e6b5bae41a7a2e97c4ca374c9e7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c0bd8e6b5bae41a7a2e97c4ca374c9e7. Latest consensus state: current_term: 1 leader_uuid: "c0bd8e6b5bae41a7a2e97c4ca374c9e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0bd8e6b5bae41a7a2e97c4ca374c9e7" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 45845 } } }
I20260809 19:13:59.296818 4558 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0bd8e6b5bae41a7a2e97c4ca374c9e7 [sys.catalog]: This master's current role is: LEADER
I20260809 19:13:59.298067 4570 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:13:59.297957 4555 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0bd8e6b5bae41a7a2e97c4ca374c9e7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c0bd8e6b5bae41a7a2e97c4ca374c9e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0bd8e6b5bae41a7a2e97c4ca374c9e7" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 45845 } } }
I20260809 19:13:59.298265 4555 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0bd8e6b5bae41a7a2e97c4ca374c9e7 [sys.catalog]: This master's current role is: LEADER
I20260809 19:13:59.303164 4570 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:13:59.314043 4570 catalog_manager.cc:1347] Generated new cluster ID: ff3e7c4ff9ca445d9ec7f1dc599c9a47
I20260809 19:13:59.314144 4570 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:13:59.339417 4570 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:13:59.340631 4570 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:13:59.352694 4570 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c0bd8e6b5bae41a7a2e97c4ca374c9e7: Generated new TSK 0
I20260809 19:13:59.353423 4570 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.39.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
I20260809 19:13:59.414804 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.1:0
--local_ip_for_outbound_sockets=127.7.39.1
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:45845
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:44639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:13:59.736595 4591 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:13:59.736860 4591 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:13:59.736984 4591 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:13:59.744287 4591 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:13:59.744392 4591 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:13:59.744542 4591 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.1
I20260809 19:13:59.754030 4591 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:44639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:45845
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.1
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:13:59.755200 4591 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:13:59.756414 4591 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:13:59.768498 4603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:59.768448 4598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:13:59.768527 4599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:13:59.769253 4591 server_base.cc:1034] running on GCE node
I20260809 19:13:59.769804 4591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:13:59.770702 4591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:13:59.771901 4591 hybrid_clock.cc:648] HybridClock initialized: now 1786302839771858 us; error 32 us; skew 500 ppm
I20260809 19:13:59.772203 4591 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:13:59 dist-test-slave-4tdj krb5kdc[4407](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302839, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:13:59.775121 4591 init.cc:377] Logged in from keytab as kudu/127.7.39.1@KRBTEST.COM (short username kudu)
I20260809 19:13:59.776446 4591 webserver.cc:460] Webserver started at http://127.7.39.1:45173/ using document root <none> and password file <none>
I20260809 19:13:59.777114 4591 fs_manager.cc:359] Metadata directory not provided
I20260809 19:13:59.777227 4591 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:13:59.777500 4591 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:13:59.780414 4591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-0/data/instance:
uuid: "3f4ef2edc98c4433b3076de880c1235e"
format_stamp: "Formatted at 2026-08-09 19:13:59 on dist-test-slave-4tdj"
server_key: "1660c15a3b5b019030ddbd6566f61c06"
server_key_iv: "9370fa7c7be8007555ba329df93904d6"
server_key_version: "encryptionkey@0"
I20260809 19:13:59.781145 4591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance:
uuid: "3f4ef2edc98c4433b3076de880c1235e"
format_stamp: "Formatted at 2026-08-09 19:13:59 on dist-test-slave-4tdj"
server_key: "1660c15a3b5b019030ddbd6566f61c06"
server_key_iv: "9370fa7c7be8007555ba329df93904d6"
server_key_version: "encryptionkey@0"
I20260809 19:13:59.785825 4591 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.001s
I20260809 19:13:59.789045 4612 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:59.790220 4591 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 19:13:59.790419 4591 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-0/wal
uuid: "3f4ef2edc98c4433b3076de880c1235e"
format_stamp: "Formatted at 2026-08-09 19:13:59 on dist-test-slave-4tdj"
server_key: "1660c15a3b5b019030ddbd6566f61c06"
server_key_iv: "9370fa7c7be8007555ba329df93904d6"
server_key_version: "encryptionkey@0"
I20260809 19:13:59.790607 4591 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:13:59.813882 4591 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:13:59.817720 4591 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:13:59.817966 4591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:13:59.818895 4591 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:13:59.820115 4591 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:13:59.820190 4591 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:59.820305 4591 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:13:59.820359 4591 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:13:59.849529 4591 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.1:41211
I20260809 19:13:59.849586 4798 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.1:41211 every 8 connection(s)
I20260809 19:13:59.850806 4591 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
I20260809 19:13:59.858208 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 4591
I20260809 19:13:59.858402 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance
I20260809 19:13:59.858829 7324 external_mini_cluster.cc:1428] Setting key 3c4aeb7011712bba1af7974f4cdc362c
Aug 09 19:13:59 dist-test-slave-4tdj krb5kdc[4407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302839, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:13:59.869971 4803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:59.853315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:48981 (local address 127.7.39.62:45845)
0809 19:13:59.853696 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0809 19:13:59.853701 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:13:59.854718 (+ 1017us) server_negotiation.cc:407] Connection header received
0809 19:13:59.856513 (+ 1795us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:13:59.856519 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:13:59.856610 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:13:59.856705 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:13:59.858149 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:59.858977 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:59.860656 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:13:59.861066 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:13:59.861171 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:59.864710 (+ 3539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:13:59.864715 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:13:59.864718 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:13:59.864750 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:13:59.867120 (+ 2370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:59.867906 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:59.867909 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:59.867912 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:59.868019 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:13:59.868444 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:13:59.868447 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:13:59.868449 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:13:59.868705 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:13:59.868813 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 19:13:59.869568 (+ 755us) server_negotiation.cc:299] Negotiation successful
0809 19:13:59.869723 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":185,"threads_started":1}
I20260809 19:13:59.871248 4804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:13:59.853844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:45845 (local address 127.7.39.1:48981)
0809 19:13:59.854566 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0809 19:13:59.854611 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 19:13:59.856261 (+ 1650us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:13:59.856943 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:13:59.856951 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:13:59.857439 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:13:59.857988 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:59.858004 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:59.859130 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:59.859134 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:59.860525 (+ 1391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:13:59.860537 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:13:59.861272 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:13:59.861278 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:13:59.861493 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:13:59.862096 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:13:59.862118 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:13:59.864508 (+ 2390us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:13:59.867248 (+ 2740us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:13:59.867257 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:13:59.867274 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:13:59.867810 (+ 536us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:13:59.868123 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:13:59.868127 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:13:59.868130 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:13:59.868353 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:13:59.868830 (+ 477us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:13:59.868837 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:13:59.869220 (+ 383us) client_negotiation.cc:769] Sending connection context
0809 19:13:59.869499 (+ 279us) client_negotiation.cc:240] Negotiation successful
0809 19:13:59.869979 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":271,"threads_started":1}
I20260809 19:13:59.872617 4801 heartbeater.cc:347] Connected to a master server at 127.7.39.62:45845
I20260809 19:13:59.872885 4801 heartbeater.cc:464] Registering TS with master...
I20260809 19:13:59.873544 4801 heartbeater.cc:511] Master 127.7.39.62:45845 requested a full tablet report, sending...
I20260809 19:13:59.875775 4479 ts_manager.cc:194] Registered new tserver with Master: 3f4ef2edc98c4433b3076de880c1235e (127.7.39.1:41211)
I20260809 19:13:59.877718 4479 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.1@KRBTEST.COM'} at 127.7.39.1:48981
WARNING: no policy specified for kudu/127.7.39.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
I20260809 19:13:59.919323 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.2:0
--local_ip_for_outbound_sockets=127.7.39.2
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:45845
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:44639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:14:00.239831 4808 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:00.240123 4808 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:00.240245 4808 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:00.247200 4808 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:00.247308 4808 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:00.247453 4808 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.2
I20260809 19:14:00.257139 4808 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:44639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:45845
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.2
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:00.258263 4808 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:00.259631 4808 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:00.272162 4814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:00.272137 4817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:00.272193 4815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:00.273343 4808 server_base.cc:1034] running on GCE node
I20260809 19:14:00.273869 4808 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:00.274765 4808 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:00.275959 4808 hybrid_clock.cc:648] HybridClock initialized: now 1786302840275906 us; error 45 us; skew 500 ppm
I20260809 19:14:00.276250 4808 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:14:00 dist-test-slave-4tdj krb5kdc[4407](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302840, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:14:00.283325 4808 init.cc:377] Logged in from keytab as kudu/127.7.39.2@KRBTEST.COM (short username kudu)
I20260809 19:14:00.284708 4808 webserver.cc:460] Webserver started at http://127.7.39.2:43523/ using document root <none> and password file <none>
I20260809 19:14:00.285375 4808 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:00.285491 4808 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:00.285773 4808 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:00.288612 4808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-1/data/instance:
uuid: "7682eef702d94925b194e71d912e3059"
format_stamp: "Formatted at 2026-08-09 19:14:00 on dist-test-slave-4tdj"
server_key: "ae8422d3f29ded2558759ad7f8834aab"
server_key_iv: "bb1cc2267d29e055a8109b32a7312975"
server_key_version: "encryptionkey@0"
I20260809 19:14:00.289342 4808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance:
uuid: "7682eef702d94925b194e71d912e3059"
format_stamp: "Formatted at 2026-08-09 19:14:00 on dist-test-slave-4tdj"
server_key: "ae8422d3f29ded2558759ad7f8834aab"
server_key_iv: "bb1cc2267d29e055a8109b32a7312975"
server_key_version: "encryptionkey@0"
I20260809 19:14:00.294168 4808 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.005s
I20260809 19:14:00.297421 4828 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:00.298694 4808 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:14:00.298841 4808 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-1/wal
uuid: "7682eef702d94925b194e71d912e3059"
format_stamp: "Formatted at 2026-08-09 19:14:00 on dist-test-slave-4tdj"
server_key: "ae8422d3f29ded2558759ad7f8834aab"
server_key_iv: "bb1cc2267d29e055a8109b32a7312975"
server_key_version: "encryptionkey@0"
I20260809 19:14:00.299012 4808 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:00.331317 4808 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:00.335110 4808 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:00.335366 4808 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:00.336288 4808 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:14:00.337558 4808 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:14:00.337635 4808 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:00.337759 4808 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:14:00.337813 4808 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:00.367513 4808 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.2:35257
I20260809 19:14:00.367606 5034 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.2:35257 every 8 connection(s)
I20260809 19:14:00.368710 4808 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
I20260809 19:14:00.372429 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 4808
I20260809 19:14:00.372634 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance
I20260809 19:14:00.373229 7324 external_mini_cluster.cc:1428] Setting key 84ae08f9d8b7c70f725fb0fdd2a96081
Aug 09 19:14:00 dist-test-slave-4tdj krb5kdc[4407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302840, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:14:00.389073 5038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:00.371124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:54879 (local address 127.7.39.62:45845)
0809 19:14:00.371561 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:00.371566 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:00.372949 (+ 1383us) server_negotiation.cc:407] Connection header received
0809 19:14:00.374556 (+ 1607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:00.374560 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:00.374630 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:00.374731 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:00.376338 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:00.377435 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:00.379022 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:00.379639 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:00.379777 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:00.382909 (+ 3132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:00.382917 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:00.382923 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:00.382967 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:00.386080 (+ 3113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:00.386780 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:00.386787 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:00.386790 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:00.386956 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:00.387407 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:00.387410 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:00.387412 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:00.387694 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:00.387813 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:00.388593 (+ 780us) server_negotiation.cc:299] Negotiation successful
0809 19:14:00.388783 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":220,"threads_started":1}
I20260809 19:14:00.390242 5041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:00.371674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:45845 (local address 127.7.39.2:54879)
0809 19:14:00.372441 (+ 767us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:00.372487 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:00.374249 (+ 1762us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:00.374975 (+ 726us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:00.374997 (+ 22us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:00.375627 (+ 630us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:14:00.376168 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:00.376184 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:00.377597 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:00.377600 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:00.378875 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:00.378888 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:00.379837 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:00.379841 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:00.380020 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:00.380648 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:14:00.380674 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:14:00.382686 (+ 2012us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:14:00.386207 (+ 3521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:00.386213 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:00.386223 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:00.386654 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:00.387061 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:00.387064 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:00.387066 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:00.387296 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:00.387811 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:14:00.387818 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:14:00.388209 (+ 391us) client_negotiation.cc:769] Sending connection context
0809 19:14:00.388497 (+ 288us) client_negotiation.cc:240] Negotiation successful
0809 19:14:00.388946 (+ 449us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":344,"threads_started":1}
I20260809 19:14:00.391664 5035 heartbeater.cc:347] Connected to a master server at 127.7.39.62:45845
I20260809 19:14:00.391973 5035 heartbeater.cc:464] Registering TS with master...
I20260809 19:14:00.392691 5035 heartbeater.cc:511] Master 127.7.39.62:45845 requested a full tablet report, sending...
I20260809 19:14:00.394234 4479 ts_manager.cc:194] Registered new tserver with Master: 7682eef702d94925b194e71d912e3059 (127.7.39.2:35257)
I20260809 19:14:00.395202 4479 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.2@KRBTEST.COM'} at 127.7.39.2:54879
WARNING: no policy specified for kudu/127.7.39.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
I20260809 19:14:00.433611 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.3:0
--local_ip_for_outbound_sockets=127.7.39.3
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:45845
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:44639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:14:00.752020 5047 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:00.752283 5047 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:00.752416 5047 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:00.759388 5047 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:00.759495 5047 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:00.759653 5047 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.3
I20260809 19:14:00.768843 5047 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:44639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:45845
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.3
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:00.770025 5047 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:00.771314 5047 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:00.783531 5056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:00.783602 5053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:00.783623 5052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:00.784257 5047 server_base.cc:1034] running on GCE node
I20260809 19:14:00.784788 5047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:00.785634 5047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:00.786823 5047 hybrid_clock.cc:648] HybridClock initialized: now 1786302840786777 us; error 33 us; skew 500 ppm
I20260809 19:14:00.787112 5047 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:14:00 dist-test-slave-4tdj krb5kdc[4407](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302840, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:14:00.789968 5047 init.cc:377] Logged in from keytab as kudu/127.7.39.3@KRBTEST.COM (short username kudu)
I20260809 19:14:00.791270 5047 webserver.cc:460] Webserver started at http://127.7.39.3:35809/ using document root <none> and password file <none>
I20260809 19:14:00.791888 5047 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:00.792006 5047 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:00.792292 5047 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:00.795223 5047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-2/data/instance:
uuid: "cd5b50117dd14ddca390936eea567018"
format_stamp: "Formatted at 2026-08-09 19:14:00 on dist-test-slave-4tdj"
server_key: "bb217e67fa0e3266838bb908e40f7c72"
server_key_iv: "b36e471f53652849e9b551611f550db7"
server_key_version: "encryptionkey@0"
I20260809 19:14:00.795948 5047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance:
uuid: "cd5b50117dd14ddca390936eea567018"
format_stamp: "Formatted at 2026-08-09 19:14:00 on dist-test-slave-4tdj"
server_key: "bb217e67fa0e3266838bb908e40f7c72"
server_key_iv: "b36e471f53652849e9b551611f550db7"
server_key_version: "encryptionkey@0"
I20260809 19:14:00.800653 5047 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 19:14:00.803987 5070 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:00.805243 5047 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 19:14:00.805379 5047 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-2/wal
uuid: "cd5b50117dd14ddca390936eea567018"
format_stamp: "Formatted at 2026-08-09 19:14:00 on dist-test-slave-4tdj"
server_key: "bb217e67fa0e3266838bb908e40f7c72"
server_key_iv: "b36e471f53652849e9b551611f550db7"
server_key_version: "encryptionkey@0"
I20260809 19:14:00.805557 5047 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:00.821936 5047 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:00.825810 5047 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:00.826076 5047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:00.827004 5047 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:14:00.828269 5047 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:14:00.828349 5047 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:00.828465 5047 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:14:00.828518 5047 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:00.858553 5047 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.3:37435
I20260809 19:14:00.858618 5269 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.3:37435 every 8 connection(s)
I20260809 19:14:00.859694 5047 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
I20260809 19:14:00.867249 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 5047
I20260809 19:14:00.867405 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance
I20260809 19:14:00.867820 7324 external_mini_cluster.cc:1428] Setting key 910b544dd024184ca9a19322ce255658
Aug 09 19:14:00 dist-test-slave-4tdj krb5kdc[4407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302840, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:14:00.877867 5038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:00.862082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:34517 (local address 127.7.39.62:45845)
0809 19:14:00.862258 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:00.862262 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:00.863346 (+ 1084us) server_negotiation.cc:407] Connection header received
0809 19:14:00.865085 (+ 1739us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:00.865091 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:00.865174 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:00.865272 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:00.866709 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:00.867514 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:00.869318 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:00.869825 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:00.869921 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:00.873131 (+ 3210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:00.873136 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:00.873139 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:00.873173 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:00.875609 (+ 2436us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:00.876193 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:00.876196 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:00.876198 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:00.876305 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:00.876612 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:00.876615 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:00.876617 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:00.876866 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:00.876969 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:00.877495 (+ 526us) server_negotiation.cc:299] Negotiation successful
0809 19:14:00.877656 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 19:14:00.878762 5272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:00.862518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:45845 (local address 127.7.39.3:34517)
0809 19:14:00.863204 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:00.863239 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:00.864831 (+ 1592us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:00.865499 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:00.865506 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:00.865982 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:14:00.866552 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:00.866569 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:00.867677 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:00.867681 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:00.869189 (+ 1508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:00.869201 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:00.870036 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:00.870044 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:00.870368 (+ 324us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:00.870957 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:14:00.870978 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:14:00.872954 (+ 1976us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:14:00.875704 (+ 2750us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:00.875710 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:00.875719 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:00.876106 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:00.876375 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:00.876377 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:00.876379 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:00.876536 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:00.876948 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:14:00.876953 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:14:00.877224 (+ 271us) client_negotiation.cc:769] Sending connection context
0809 19:14:00.877420 (+ 196us) client_negotiation.cc:240] Negotiation successful
0809 19:14:00.877729 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":264,"threads_started":1}
I20260809 19:14:00.880035 5270 heartbeater.cc:347] Connected to a master server at 127.7.39.62:45845
I20260809 19:14:00.880314 5270 heartbeater.cc:464] Registering TS with master...
I20260809 19:14:00.880472 4801 heartbeater.cc:503] Master 127.7.39.62:45845 was elected leader, sending a full tablet report...
I20260809 19:14:00.881095 5270 heartbeater.cc:511] Master 127.7.39.62:45845 requested a full tablet report, sending...
I20260809 19:14:00.882654 4475 ts_manager.cc:194] Registered new tserver with Master: cd5b50117dd14ddca390936eea567018 (127.7.39.3:37435)
I20260809 19:14:00.883428 4475 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.3@KRBTEST.COM'} at 127.7.39.3:34517
I20260809 19:14:00.894527 7324 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 19:14:00.910852 5038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:00.898458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57682 (local address 127.7.39.62:45845)
0809 19:14:00.898622 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:00.898627 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:00.899026 (+ 399us) server_negotiation.cc:407] Connection header received
0809 19:14:00.899188 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:00.899193 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:00.899260 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:00.899336 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:00.900705 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:00.901421 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:00.902882 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:00.903323 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:00.903435 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:00.906106 (+ 2671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:00.906111 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:00.906114 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:00.906143 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:00.908508 (+ 2365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:00.909165 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:00.909168 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:00.909170 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:00.909289 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:00.909665 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:00.909668 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:00.909670 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:00.909936 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:00.910132 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:00.910458 (+ 326us) server_negotiation.cc:299] Negotiation successful
0809 19:14:00.910621 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 19:14:00.914281 4475 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57682:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:14:00.920902 4475 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:14:00.966763 5292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:00.932895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41534 (local address 127.7.39.3:37435)
0809 19:14:00.958336 (+ 25441us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:00.958344 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:00.958382 (+ 38us) server_negotiation.cc:407] Connection header received
0809 19:14:00.958485 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:00.958494 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:00.958770 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:00.958965 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:14:00.960317 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:00.961708 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:00.964572 (+ 2864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:00.965649 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:00.965762 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:00.965980 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:00.966251 (+ 271us) server_negotiation.cc:299] Negotiation successful
0809 19:14:00.966434 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25248,"thread_start_us":25099,"threads_started":1}
I20260809 19:14:00.966864 5296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:00.933581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46484 (local address 127.7.39.1:41211)
0809 19:14:00.955613 (+ 22032us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:00.955624 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:00.958701 (+ 3077us) server_negotiation.cc:407] Connection header received
0809 19:14:00.958948 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:00.958953 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:00.959108 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:00.959283 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:14:00.960369 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:00.961958 (+ 1589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:00.964062 (+ 2104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:00.965288 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:00.965420 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:00.965669 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:00.966369 (+ 700us) server_negotiation.cc:299] Negotiation successful
0809 19:14:00.966542 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21817,"thread_start_us":22036,"threads_started":1}
I20260809 19:14:00.966871 5289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:00.932366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:37435 (local address 127.0.0.1:41534)
0809 19:14:00.957917 (+ 25551us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:00.957941 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:00.958065 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:00.959271 (+ 1206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:00.959278 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:00.959307 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:14:00.960110 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:00.960123 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:00.961836 (+ 1713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:00.961841 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:00.964378 (+ 2537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:00.964394 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:00.965846 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:00.965852 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:00.966031 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:00.966072 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 19:14:00.966186 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 19:14:00.966434 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25429,"mutex_wait_us":101,"spinlock_wait_cycles":5504,"thread_start_us":25923,"threads_started":1}
I20260809 19:14:00.967206 5295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:00.932174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:35257 (local address 127.0.0.1:34430)
0809 19:14:00.956425 (+ 24251us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:00.956488 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:00.956688 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:00.959468 (+ 2780us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:00.959472 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:00.959500 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:14:00.960133 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:00.960147 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:00.962117 (+ 1970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:00.962122 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:00.964411 (+ 2289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:00.964421 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:00.966373 (+ 1952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:00.966380 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:00.966554 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:00.966588 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 19:14:00.966671 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 19:14:00.966785 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23970,"mutex_wait_us":42,"thread_start_us":25472,"threads_started":1}
I20260809 19:14:00.967906 5291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:00.932439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34430 (local address 127.7.39.2:35257)
0809 19:14:00.958884 (+ 26445us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:00.958892 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:00.958917 (+ 25us) server_negotiation.cc:407] Connection header received
0809 19:14:00.959016 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:00.959024 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:00.959253 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:00.959641 (+ 388us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:14:00.960346 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:00.961958 (+ 1612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:00.964550 (+ 2592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:00.965912 (+ 1362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:00.966041 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:00.966210 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:00.967491 (+ 1281us) server_negotiation.cc:299] Negotiation successful
0809 19:14:00.967647 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26295,"thread_start_us":26155,"threads_started":1}
I20260809 19:14:00.967636 5290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:00.932920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:41211 (local address 127.0.0.1:46484)
0809 19:14:00.958572 (+ 25652us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:00.958595 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:00.958797 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:00.959277 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:00.959281 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:00.959335 (+ 54us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:14:00.960199 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:00.960209 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:00.962128 (+ 1919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:00.962131 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:00.963905 (+ 1774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:00.963922 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:00.965801 (+ 1879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:00.965808 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:00.966011 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:00.966068 (+ 57us) client_negotiation.cc:769] Sending connection context
0809 19:14:00.966187 (+ 119us) client_negotiation.cc:240] Negotiation successful
0809 19:14:00.967156 (+ 969us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25531,"mutex_wait_us":864,"spinlock_wait_cycles":5504,"thread_start_us":23959,"threads_started":1}
I20260809 19:14:00.970863 5158 tablet_service.cc:1467] Processing CreateTablet for tablet f3543dda90594f8780b94a2233cee2b1 (DEFAULT_TABLE table=test-table [id=0a1729ee66dd4de9b5ece65631296501]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:14:00.971644 4902 tablet_service.cc:1467] Processing CreateTablet for tablet f3543dda90594f8780b94a2233cee2b1 (DEFAULT_TABLE table=test-table [id=0a1729ee66dd4de9b5ece65631296501]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:14:00.972422 5158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3543dda90594f8780b94a2233cee2b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:00.972223 4686 tablet_service.cc:1467] Processing CreateTablet for tablet f3543dda90594f8780b94a2233cee2b1 (DEFAULT_TABLE table=test-table [id=0a1729ee66dd4de9b5ece65631296501]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:14:00.972994 4902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3543dda90594f8780b94a2233cee2b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:00.973382 4686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3543dda90594f8780b94a2233cee2b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:00.984714 5297 tablet_bootstrap.cc:492] T f3543dda90594f8780b94a2233cee2b1 P cd5b50117dd14ddca390936eea567018: Bootstrap starting.
I20260809 19:14:00.985611 5299 tablet_bootstrap.cc:492] T f3543dda90594f8780b94a2233cee2b1 P 3f4ef2edc98c4433b3076de880c1235e: Bootstrap starting.
I20260809 19:14:00.987825 5300 tablet_bootstrap.cc:492] T f3543dda90594f8780b94a2233cee2b1 P 7682eef702d94925b194e71d912e3059: Bootstrap starting.
I20260809 19:14:00.988826 5299 tablet_bootstrap.cc:654] T f3543dda90594f8780b94a2233cee2b1 P 3f4ef2edc98c4433b3076de880c1235e: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:00.988840 5297 tablet_bootstrap.cc:654] T f3543dda90594f8780b94a2233cee2b1 P cd5b50117dd14ddca390936eea567018: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:00.989810 5297 log.cc:824] T f3543dda90594f8780b94a2233cee2b1 P cd5b50117dd14ddca390936eea567018: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:00.990043 5299 log.cc:824] T f3543dda90594f8780b94a2233cee2b1 P 3f4ef2edc98c4433b3076de880c1235e: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:00.991268 5300 tablet_bootstrap.cc:654] T f3543dda90594f8780b94a2233cee2b1 P 7682eef702d94925b194e71d912e3059: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:00.992157 5300 log.cc:824] T f3543dda90594f8780b94a2233cee2b1 P 7682eef702d94925b194e71d912e3059: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:00.992396 5297 tablet_bootstrap.cc:492] T f3543dda90594f8780b94a2233cee2b1 P cd5b50117dd14ddca390936eea567018: No bootstrap required, opened a new log
I20260809 19:14:00.992642 5297 ts_tablet_manager.cc:1397] T f3543dda90594f8780b94a2233cee2b1 P cd5b50117dd14ddca390936eea567018: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260809 19:14:00.994674 5299 tablet_bootstrap.cc:492] T f3543dda90594f8780b94a2233cee2b1 P 3f4ef2edc98c4433b3076de880c1235e: No bootstrap required, opened a new log
I20260809 19:14:00.994939 5299 ts_tablet_manager.cc:1397] T f3543dda90594f8780b94a2233cee2b1 P 3f4ef2edc98c4433b3076de880c1235e: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260809 19:14:00.996094 5300 tablet_bootstrap.cc:492] T f3543dda90594f8780b94a2233cee2b1 P 7682eef702d94925b194e71d912e3059: No bootstrap required, opened a new log
I20260809 19:14:00.996409 5300 ts_tablet_manager.cc:1397] T f3543dda90594f8780b94a2233cee2b1 P 7682eef702d94925b194e71d912e3059: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260809 19:14:00.999995 5297 raft_consensus.cc:348] T f3543dda90594f8780b94a2233cee2b1 P cd5b50117dd14ddca390936eea567018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7682eef702d94925b194e71d912e3059" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35257 } } peers { permanent_uuid: "cd5b50117dd14ddca390936eea567018" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 37435 } } peers { permanent_uuid: "3f4ef2edc98c4433b3076de880c1235e" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 41211 } }
I20260809 19:14:01.000317 5297 raft_consensus.cc:374] T f3543dda90594f8780b94a2233cee2b1 P cd5b50117dd14ddca390936eea567018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:14:01.000411 5297 raft_consensus.cc:729] T f3543dda90594f8780b94a2233cee2b1 P cd5b50117dd14ddca390936eea567018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd5b50117dd14ddca390936eea567018, State: Initialized, Role: FOLLOWER
I20260809 19:14:01.000932 5297 consensus_queue.cc:260] T f3543dda90594f8780b94a2233cee2b1 P cd5b50117dd14ddca390936eea567018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7682eef702d94925b194e71d912e3059" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35257 } } peers { permanent_uuid: "cd5b50117dd14ddca390936eea567018" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 37435 } } peers { permanent_uuid: "3f4ef2edc98c4433b3076de880c1235e" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 41211 } }
I20260809 19:14:01.001868 5270 heartbeater.cc:503] Master 127.7.39.62:45845 was elected leader, sending a full tablet report...
I20260809 19:14:01.003681 5297 ts_tablet_manager.cc:1428] T f3543dda90594f8780b94a2233cee2b1 P cd5b50117dd14ddca390936eea567018: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260809 19:14:01.004886 5299 raft_consensus.cc:348] T f3543dda90594f8780b94a2233cee2b1 P 3f4ef2edc98c4433b3076de880c1235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7682eef702d94925b194e71d912e3059" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35257 } } peers { permanent_uuid: "cd5b50117dd14ddca390936eea567018" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 37435 } } peers { permanent_uuid: "3f4ef2edc98c4433b3076de880c1235e" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 41211 } }
I20260809 19:14:01.005295 5299 raft_consensus.cc:374] T f3543dda90594f8780b94a2233cee2b1 P 3f4ef2edc98c4433b3076de880c1235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:14:01.005403 5299 raft_consensus.cc:729] T f3543dda90594f8780b94a2233cee2b1 P 3f4ef2edc98c4433b3076de880c1235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f4ef2edc98c4433b3076de880c1235e, State: Initialized, Role: FOLLOWER
I20260809 19:14:01.005961 5299 consensus_queue.cc:260] T f3543dda90594f8780b94a2233cee2b1 P 3f4ef2edc98c4433b3076de880c1235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7682eef702d94925b194e71d912e3059" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35257 } } peers { permanent_uuid: "cd5b50117dd14ddca390936eea567018" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 37435 } } peers { permanent_uuid: "3f4ef2edc98c4433b3076de880c1235e" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 41211 } }
I20260809 19:14:01.006285 5300 raft_consensus.cc:348] T f3543dda90594f8780b94a2233cee2b1 P 7682eef702d94925b194e71d912e3059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7682eef702d94925b194e71d912e3059" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35257 } } peers { permanent_uuid: "cd5b50117dd14ddca390936eea567018" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 37435 } } peers { permanent_uuid: "3f4ef2edc98c4433b3076de880c1235e" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 41211 } }
I20260809 19:14:01.006742 5300 raft_consensus.cc:374] T f3543dda90594f8780b94a2233cee2b1 P 7682eef702d94925b194e71d912e3059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:14:01.006899 5300 raft_consensus.cc:729] T f3543dda90594f8780b94a2233cee2b1 P 7682eef702d94925b194e71d912e3059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7682eef702d94925b194e71d912e3059, State: Initialized, Role: FOLLOWER
I20260809 19:14:01.007377 5300 consensus_queue.cc:260] T f3543dda90594f8780b94a2233cee2b1 P 7682eef702d94925b194e71d912e3059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7682eef702d94925b194e71d912e3059" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35257 } } peers { permanent_uuid: "cd5b50117dd14ddca390936eea567018" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 37435 } } peers { permanent_uuid: "3f4ef2edc98c4433b3076de880c1235e" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 41211 } }
I20260809 19:14:01.007750 5299 ts_tablet_manager.cc:1428] T f3543dda90594f8780b94a2233cee2b1 P 3f4ef2edc98c4433b3076de880c1235e: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260809 19:14:01.009164 5035 heartbeater.cc:503] Master 127.7.39.62:45845 was elected leader, sending a full tablet report...
I20260809 19:14:01.010599 5300 ts_tablet_manager.cc:1428] T f3543dda90594f8780b94a2233cee2b1 P 7682eef702d94925b194e71d912e3059: Time spent starting tablet: real 0.014s user 0.008s sys 0.005s
I20260809 19:14:01.014565 5310 raft_consensus.cc:482] T f3543dda90594f8780b94a2233cee2b1 P cd5b50117dd14ddca390936eea567018 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:14:01.014761 5310 raft_consensus.cc:504] T f3543dda90594f8780b94a2233cee2b1 P cd5b50117dd14ddca390936eea567018 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7682eef702d94925b194e71d912e3059" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35257 } } peers { permanent_uuid: "cd5b50117dd14ddca390936eea567018" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 37435 } } peers { permanent_uuid: "3f4ef2edc98c4433b3076de880c1235e" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 41211 } }
I20260809 19:14:01.016181 5310 leader_election.cc:288] T f3543dda90594f8780b94a2233cee2b1 P cd5b50117dd14ddca390936eea567018 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7682eef702d94925b194e71d912e3059 (127.7.39.2:35257), 3f4ef2edc98c4433b3076de880c1235e (127.7.39.1:41211)
I20260809 19:14:01.021816 5272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:01.016519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:35257 (local address 127.7.39.3:59577)
0809 19:14:01.016713 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:01.016734 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:01.016842 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:01.017325 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:01.017331 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:01.017356 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:14:01.017561 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:01.017570 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:01.018533 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:01.018538 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:01.020079 (+ 1541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:01.020094 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:01.021114 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:01.021119 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:01.021305 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:01.021339 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 19:14:01.021424 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 19:14:01.021558 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260809 19:14:01.022377 5291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:01.016568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:59577 (local address 127.7.39.2:35257)
0809 19:14:01.016747 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:01.016752 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:01.016775 (+ 23us) server_negotiation.cc:407] Connection header received
0809 19:14:01.017011 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:01.017017 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:01.017088 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:01.017166 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:14:01.017678 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:01.018413 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:01.020227 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:01.020964 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:01.021087 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:01.021172 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:01.022003 (+ 831us) server_negotiation.cc:299] Negotiation successful
0809 19:14:01.022127 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 19:14:01.023463 5296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:01.017001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:43347 (local address 127.7.39.1:41211)
0809 19:14:01.017195 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:01.017200 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:01.017373 (+ 173us) server_negotiation.cc:407] Connection header received
0809 19:14:01.017531 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:01.017534 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:01.017587 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:01.017667 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:14:01.018138 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:01.018852 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:01.021167 (+ 2315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:01.022388 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:01.022493 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:01.022600 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:01.023113 (+ 513us) server_negotiation.cc:299] Negotiation successful
0809 19:14:01.023246 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 19:14:01.023506 5313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:01.016610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:41211 (local address 127.7.39.3:43347)
0809 19:14:01.017294 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:01.017310 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:01.017427 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:01.017700 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:01.017705 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:01.017729 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:14:01.017989 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:01.017997 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:01.018989 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:01.018993 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:01.020977 (+ 1984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:01.020993 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:01.022770 (+ 1777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:01.022776 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:01.022944 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:01.022977 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 19:14:01.023072 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 19:14:01.023193 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":381,"threads_started":1}
I20260809 19:14:01.024144 4944 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3543dda90594f8780b94a2233cee2b1" candidate_uuid: "cd5b50117dd14ddca390936eea567018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7682eef702d94925b194e71d912e3059" is_pre_election: true
I20260809 19:14:01.024664 4944 raft_consensus.cc:2454] T f3543dda90594f8780b94a2233cee2b1 P 7682eef702d94925b194e71d912e3059 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd5b50117dd14ddca390936eea567018 in term 0.
I20260809 19:14:01.024698 4727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3543dda90594f8780b94a2233cee2b1" candidate_uuid: "cd5b50117dd14ddca390936eea567018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f4ef2edc98c4433b3076de880c1235e" is_pre_election: true
I20260809 19:14:01.025195 4727 raft_consensus.cc:2454] T f3543dda90594f8780b94a2233cee2b1 P 3f4ef2edc98c4433b3076de880c1235e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd5b50117dd14ddca390936eea567018 in term 0.
I20260809 19:14:01.025888 5074 leader_election.cc:302] T f3543dda90594f8780b94a2233cee2b1 P cd5b50117dd14ddca390936eea567018 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f4ef2edc98c4433b3076de880c1235e, cd5b50117dd14ddca390936eea567018; no voters:
I20260809 19:14:01.026314 5310 raft_consensus.cc:2781] T f3543dda90594f8780b94a2233cee2b1 P cd5b50117dd14ddca390936eea567018 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:14:01.026499 5310 raft_consensus.cc:482] T f3543dda90594f8780b94a2233cee2b1 P cd5b50117dd14ddca390936eea567018 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:14:01.026605 5310 raft_consensus.cc:3037] T f3543dda90594f8780b94a2233cee2b1 P cd5b50117dd14ddca390936eea567018 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:01.029382 5310 raft_consensus.cc:504] T f3543dda90594f8780b94a2233cee2b1 P cd5b50117dd14ddca390936eea567018 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7682eef702d94925b194e71d912e3059" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35257 } } peers { permanent_uuid: "cd5b50117dd14ddca390936eea567018" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 37435 } } peers { permanent_uuid: "3f4ef2edc98c4433b3076de880c1235e" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 41211 } }
I20260809 19:14:01.029891 5310 leader_election.cc:288] T f3543dda90594f8780b94a2233cee2b1 P cd5b50117dd14ddca390936eea567018 [CANDIDATE]: Term 1 election: Requested vote from peers 7682eef702d94925b194e71d912e3059 (127.7.39.2:35257), 3f4ef2edc98c4433b3076de880c1235e (127.7.39.1:41211)
I20260809 19:14:01.030277 4944 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3543dda90594f8780b94a2233cee2b1" candidate_uuid: "cd5b50117dd14ddca390936eea567018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7682eef702d94925b194e71d912e3059"
I20260809 19:14:01.030321 4727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3543dda90594f8780b94a2233cee2b1" candidate_uuid: "cd5b50117dd14ddca390936eea567018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f4ef2edc98c4433b3076de880c1235e"
I20260809 19:14:01.030489 4727 raft_consensus.cc:3037] T f3543dda90594f8780b94a2233cee2b1 P 3f4ef2edc98c4433b3076de880c1235e [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:01.030499 4944 raft_consensus.cc:3037] T f3543dda90594f8780b94a2233cee2b1 P 7682eef702d94925b194e71d912e3059 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:01.033502 4944 raft_consensus.cc:2454] T f3543dda90594f8780b94a2233cee2b1 P 7682eef702d94925b194e71d912e3059 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd5b50117dd14ddca390936eea567018 in term 1.
I20260809 19:14:01.033492 4727 raft_consensus.cc:2454] T f3543dda90594f8780b94a2233cee2b1 P 3f4ef2edc98c4433b3076de880c1235e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd5b50117dd14ddca390936eea567018 in term 1.
I20260809 19:14:01.033864 5075 leader_election.cc:302] T f3543dda90594f8780b94a2233cee2b1 P cd5b50117dd14ddca390936eea567018 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7682eef702d94925b194e71d912e3059, cd5b50117dd14ddca390936eea567018; no voters:
I20260809 19:14:01.034183 5310 raft_consensus.cc:2781] T f3543dda90594f8780b94a2233cee2b1 P cd5b50117dd14ddca390936eea567018 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:14:01.034579 5310 raft_consensus.cc:686] T f3543dda90594f8780b94a2233cee2b1 P cd5b50117dd14ddca390936eea567018 [term 1 LEADER]: Becoming Leader. State: Replica: cd5b50117dd14ddca390936eea567018, State: Running, Role: LEADER
I20260809 19:14:01.035007 5310 consensus_queue.cc:237] T f3543dda90594f8780b94a2233cee2b1 P cd5b50117dd14ddca390936eea567018 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7682eef702d94925b194e71d912e3059" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35257 } } peers { permanent_uuid: "cd5b50117dd14ddca390936eea567018" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 37435 } } peers { permanent_uuid: "3f4ef2edc98c4433b3076de880c1235e" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 41211 } }
I20260809 19:14:01.039382 4475 catalog_manager.cc:5495] T f3543dda90594f8780b94a2233cee2b1 P cd5b50117dd14ddca390936eea567018 reported cstate change: term changed from 0 to 1, leader changed from <none> to cd5b50117dd14ddca390936eea567018 (127.7.39.3). New cstate: current_term: 1 leader_uuid: "cd5b50117dd14ddca390936eea567018" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7682eef702d94925b194e71d912e3059" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd5b50117dd14ddca390936eea567018" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 37435 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f4ef2edc98c4433b3076de880c1235e" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 41211 } health_report { overall_health: UNKNOWN } } }
I20260809 19:14:01.064011 5292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:01.059234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41544 (local address 127.7.39.3:37435)
0809 19:14:01.059398 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:01.059402 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:01.059509 (+ 107us) server_negotiation.cc:407] Connection header received
0809 19:14:01.059670 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:01.059674 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:01.059744 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:01.059860 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:14:01.060175 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:01.060865 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:01.062124 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:01.062537 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:01.062633 (+ 96us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:01.063089 (+ 456us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:14:01.063534 (+ 445us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:14:01.063678 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:01.063786 (+ 108us) server_negotiation.cc:299] Negotiation successful
0809 19:14:01.063823 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 19:14:01.071574 4944 raft_consensus.cc:1261] T f3543dda90594f8780b94a2233cee2b1 P 7682eef702d94925b194e71d912e3059 [term 1 FOLLOWER]: Refusing update from remote peer cd5b50117dd14ddca390936eea567018: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:14:01.071573 4727 raft_consensus.cc:1261] T f3543dda90594f8780b94a2233cee2b1 P 3f4ef2edc98c4433b3076de880c1235e [term 1 FOLLOWER]: Refusing update from remote peer cd5b50117dd14ddca390936eea567018: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:14:01.072422 5316 consensus_queue.cc:1035] T f3543dda90594f8780b94a2233cee2b1 P cd5b50117dd14ddca390936eea567018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7682eef702d94925b194e71d912e3059" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 35257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:14:01.072777 5310 consensus_queue.cc:1035] T f3543dda90594f8780b94a2233cee2b1 P cd5b50117dd14ddca390936eea567018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f4ef2edc98c4433b3076de880c1235e" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 41211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:14:01.082077 5320 mvcc.cc:205] Tried to move back new op lower bound from 7316696437020008448 to 7316696436882903040. Current Snapshot: MvccSnapshot[applied={T|T < 7316696437020008448}]
I20260809 19:14:01.094955 4479 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57682:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:14:01.095249 4479 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57682:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:14:01.098696 4479 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c0bd8e6b5bae41a7a2e97c4ca374c9e7: Sending DeleteTablet for 3 replicas of tablet f3543dda90594f8780b94a2233cee2b1
I20260809 19:14:01.099684 5158 tablet_service.cc:1514] Processing DeleteTablet for tablet f3543dda90594f8780b94a2233cee2b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:14:01 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:41534
I20260809 19:14:01.099684 4902 tablet_service.cc:1514] Processing DeleteTablet for tablet f3543dda90594f8780b94a2233cee2b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:14:01 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:34430
I20260809 19:14:01.099748 4686 tablet_service.cc:1514] Processing DeleteTablet for tablet f3543dda90594f8780b94a2233cee2b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:14:01 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:46484
I20260809 19:14:01.100504 5334 tablet_replica.cc:330] T f3543dda90594f8780b94a2233cee2b1 P 7682eef702d94925b194e71d912e3059: stopping tablet replica
I20260809 19:14:01.100903 5334 raft_consensus.cc:2229] T f3543dda90594f8780b94a2233cee2b1 P 7682eef702d94925b194e71d912e3059 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:14:01.101354 5334 raft_consensus.cc:2258] T f3543dda90594f8780b94a2233cee2b1 P 7682eef702d94925b194e71d912e3059 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:14:01.103546 5334 ts_tablet_manager.cc:1905] T f3543dda90594f8780b94a2233cee2b1 P 7682eef702d94925b194e71d912e3059: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:14:01.104470 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 4591
I20260809 19:14:01.108047 5335 tablet_replica.cc:330] T f3543dda90594f8780b94a2233cee2b1 P cd5b50117dd14ddca390936eea567018: stopping tablet replica
I20260809 19:14:01.108556 5335 raft_consensus.cc:2229] T f3543dda90594f8780b94a2233cee2b1 P cd5b50117dd14ddca390936eea567018 [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:14:01.109406 5335 raft_consensus.cc:2258] T f3543dda90594f8780b94a2233cee2b1 P cd5b50117dd14ddca390936eea567018 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:14:01.110332 5338 tablet_replica.cc:330] T f3543dda90594f8780b94a2233cee2b1 P 3f4ef2edc98c4433b3076de880c1235e: stopping tablet replica
I20260809 19:14:01.110608 5334 ts_tablet_manager.cc:1918] T f3543dda90594f8780b94a2233cee2b1 P 7682eef702d94925b194e71d912e3059: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:14:01.110766 5334 log.cc:1196] T f3543dda90594f8780b94a2233cee2b1 P 7682eef702d94925b194e71d912e3059: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-1/wal/wals/f3543dda90594f8780b94a2233cee2b1
I20260809 19:14:01.110884 5338 raft_consensus.cc:2229] T f3543dda90594f8780b94a2233cee2b1 P 3f4ef2edc98c4433b3076de880c1235e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:14:01.111299 5334 ts_tablet_manager.cc:1939] T f3543dda90594f8780b94a2233cee2b1 P 7682eef702d94925b194e71d912e3059: Deleting consensus metadata
I20260809 19:14:01.111469 5338 raft_consensus.cc:2258] T f3543dda90594f8780b94a2233cee2b1 P 3f4ef2edc98c4433b3076de880c1235e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:14:01.112133 5335 ts_tablet_manager.cc:1905] T f3543dda90594f8780b94a2233cee2b1 P cd5b50117dd14ddca390936eea567018: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:14:01.113386 5338 ts_tablet_manager.cc:1905] T f3543dda90594f8780b94a2233cee2b1 P 3f4ef2edc98c4433b3076de880c1235e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:14:01.113469 4455 catalog_manager.cc:4841] TS 7682eef702d94925b194e71d912e3059 (127.7.39.2:35257): tablet f3543dda90594f8780b94a2233cee2b1 (table test-table [id=0a1729ee66dd4de9b5ece65631296501]) successfully deleted
I20260809 19:14:01.117380 5335 ts_tablet_manager.cc:1918] T f3543dda90594f8780b94a2233cee2b1 P cd5b50117dd14ddca390936eea567018: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:14:01.117532 5335 log.cc:1196] T f3543dda90594f8780b94a2233cee2b1 P cd5b50117dd14ddca390936eea567018: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-2/wal/wals/f3543dda90594f8780b94a2233cee2b1
I20260809 19:14:01.118070 5335 ts_tablet_manager.cc:1939] T f3543dda90594f8780b94a2233cee2b1 P cd5b50117dd14ddca390936eea567018: Deleting consensus metadata
I20260809 19:14:01.119712 4453 catalog_manager.cc:4841] TS cd5b50117dd14ddca390936eea567018 (127.7.39.3:37435): tablet f3543dda90594f8780b94a2233cee2b1 (table test-table [id=0a1729ee66dd4de9b5ece65631296501]) successfully deleted
I20260809 19:14:01.120148 5338 ts_tablet_manager.cc:1918] T f3543dda90594f8780b94a2233cee2b1 P 3f4ef2edc98c4433b3076de880c1235e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:14:01.120406 5338 log.cc:1196] T f3543dda90594f8780b94a2233cee2b1 P 3f4ef2edc98c4433b3076de880c1235e: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786302538618573-7324-0/minicluster-data/ts-0/wal/wals/f3543dda90594f8780b94a2233cee2b1
I20260809 19:14:01.120959 5338 ts_tablet_manager.cc:1939] T f3543dda90594f8780b94a2233cee2b1 P 3f4ef2edc98c4433b3076de880c1235e: Deleting consensus metadata
I20260809 19:14:01.122589 4454 catalog_manager.cc:4841] TS 3f4ef2edc98c4433b3076de880c1235e (127.7.39.1:41211): tablet f3543dda90594f8780b94a2233cee2b1 (table test-table [id=0a1729ee66dd4de9b5ece65631296501]) successfully deleted
Aug 09 19:14:01 dist-test-slave-4tdj krb5kdc[4407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302838, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.1@KRBTEST.COM
I20260809 19:14:01.131995 5296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:01.105518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46492 (local address 127.7.39.1:41211)
0809 19:14:01.105679 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:01.105685 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:01.117685 (+ 12000us) server_negotiation.cc:407] Connection header received
0809 19:14:01.118039 (+ 354us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:01.118045 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:01.118146 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:01.118221 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:01.120118 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:01.120993 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:01.122237 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:01.122851 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:01.122958 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:01.126804 (+ 3846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:01.126815 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:01.126827 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:01.126863 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:01.129411 (+ 2548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:01.130012 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:01.130021 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:01.130025 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:01.130151 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:01.130554 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:01.130558 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:01.130560 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:01.130892 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:01.131169 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:01.131487 (+ 318us) server_negotiation.cc:299] Negotiation successful
0809 19:14:01.131702 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 19:14:01.132622 4794 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:14:01.219439 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 4591
I20260809 19:14:01.245292 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 4808
Aug 09 19:14:01 dist-test-slave-4tdj krb5kdc[4407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302838, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.2@KRBTEST.COM
I20260809 19:14:01.262084 5291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:01.246050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34444 (local address 127.7.39.2:35257)
0809 19:14:01.246228 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:01.246235 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:01.246328 (+ 93us) server_negotiation.cc:407] Connection header received
0809 19:14:01.246512 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:01.246516 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:01.246585 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:01.246670 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:01.247932 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:01.248646 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:01.249870 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:01.250251 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:01.250396 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:01.255292 (+ 4896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:01.255313 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:01.255334 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:01.255382 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:01.259071 (+ 3689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:01.259901 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:01.259911 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:01.259915 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:01.260059 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:01.260457 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:01.260463 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:01.260467 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:01.260947 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:01.261220 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:01.261516 (+ 296us) server_negotiation.cc:299] Negotiation successful
0809 19:14:01.261739 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 19:14:01.262794 5023 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:14:01.351315 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 4808
I20260809 19:14:01.373497 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 5047
Aug 09 19:14:01 dist-test-slave-4tdj krb5kdc[4407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302838, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.3@KRBTEST.COM
I20260809 19:14:01.390652 5292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:01.374368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41560 (local address 127.7.39.3:37435)
0809 19:14:01.374584 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:01.374589 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:01.374610 (+ 21us) server_negotiation.cc:407] Connection header received
0809 19:14:01.374746 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:01.374752 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:01.374825 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:01.374926 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:01.376372 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:01.377192 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:01.378608 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:01.379133 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:01.379263 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:01.384709 (+ 5446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:01.384726 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:01.384742 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:01.384780 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:01.387714 (+ 2934us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:01.388526 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:01.388536 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:01.388538 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:01.388705 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:01.389092 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:01.389095 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:01.389097 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:01.389436 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:01.389728 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:01.390065 (+ 337us) server_negotiation.cc:299] Negotiation successful
0809 19:14:01.390230 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 19:14:01.391355 5257 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:14:01.510272 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 5047
I20260809 19:14:01.531077 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 4428
I20260809 19:14:01.532137 4536 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:14:01.642248 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 4428
2026-08-09T19:14:01Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4301 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-09T19:14:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:14:01Z Disabled control of system clock
I20260809 19:14:01.726785 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:41727
--webserver_interface=127.7.39.62
--webserver_port=0
--builtin_ntp_servers=127.7.39.20:34689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:41727
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 19:14:02.046324 5361 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:02.046602 5361 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:02.046701 5361 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:02.053601 5361 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:14:02.053706 5361 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:02.053751 5361 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:02.053807 5361 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:14:02.053848 5361 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:14:02.062728 5361 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:34689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:41727
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:41727
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:02.063946 5361 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:02.065769 5361 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:02.076809 5371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:02.076846 5375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:02.076884 5373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:02.078208 5361 server_base.cc:1034] running on GCE node
I20260809 19:14:02.078953 5361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:02.080291 5361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:02.081496 5361 hybrid_clock.cc:648] HybridClock initialized: now 1786302842081447 us; error 39 us; skew 500 ppm
I20260809 19:14:02.081823 5361 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:14:02.086884 5361 webserver.cc:460] Webserver started at http://127.7.39.62:46445/ using document root <none> and password file <none>
I20260809 19:14:02.087533 5361 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:02.087635 5361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:02.087945 5361 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:02.090801 5361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "3549af953adb450eb8bf384258591c57"
format_stamp: "Formatted at 2026-08-09 19:14:02 on dist-test-slave-4tdj"
server_key: "9e2ea00351c964057544f5b957866365"
server_key_iv: "01c2e477ca1c8a2e8b40e10904477ae3"
server_key_version: "encryptionkey@0"
I20260809 19:14:02.091572 5361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "3549af953adb450eb8bf384258591c57"
format_stamp: "Formatted at 2026-08-09 19:14:02 on dist-test-slave-4tdj"
server_key: "9e2ea00351c964057544f5b957866365"
server_key_iv: "01c2e477ca1c8a2e8b40e10904477ae3"
server_key_version: "encryptionkey@0"
I20260809 19:14:02.096367 5361 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 19:14:02.099694 5382 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:02.100943 5361 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 19:14:02.101099 5361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "3549af953adb450eb8bf384258591c57"
format_stamp: "Formatted at 2026-08-09 19:14:02 on dist-test-slave-4tdj"
server_key: "9e2ea00351c964057544f5b957866365"
server_key_iv: "01c2e477ca1c8a2e8b40e10904477ae3"
server_key_version: "encryptionkey@0"
I20260809 19:14:02.101292 5361 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:02.127336 5361 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:02.128142 5361 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:02.128448 5361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:02.145689 5361 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:41727
I20260809 19:14:02.145705 5464 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:41727 every 8 connection(s)
I20260809 19:14:02.147070 5361 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:14:02.150806 5465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:02.156739 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 5361
I20260809 19:14:02.156929 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:14:02.157486 7324 external_mini_cluster.cc:1428] Setting key b4048a297be34e2f5f6edf937dac494f
I20260809 19:14:02.161540 5465 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3549af953adb450eb8bf384258591c57: Bootstrap starting.
I20260809 19:14:02.164863 5465 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3549af953adb450eb8bf384258591c57: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:02.166113 5465 log.cc:824] T 00000000000000000000000000000000 P 3549af953adb450eb8bf384258591c57: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:02.169312 5465 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3549af953adb450eb8bf384258591c57: No bootstrap required, opened a new log
I20260809 19:14:02.171341 5469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:02.159415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46332 (local address 127.7.39.62:41727)
0809 19:14:02.160346 (+ 931us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:02.160356 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:02.160396 (+ 40us) server_negotiation.cc:407] Connection header received
0809 19:14:02.162098 (+ 1702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:02.162119 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:02.162588 (+ 469us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:02.162889 (+ 301us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:02.163501 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:02.164754 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:02.166650 (+ 1896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:02.167625 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:02.167760 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:02.168859 (+ 1099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:02.168866 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:02.168878 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:02.169522 (+ 644us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:02.169637 (+ 115us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:02.169666 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:02.169795 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:02.170122 (+ 327us) server_negotiation.cc:299] Negotiation successful
0809 19:14:02.170415 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":526,"thread_start_us":323,"threads_started":1}
I20260809 19:14:02.177093 5465 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3549af953adb450eb8bf384258591c57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3549af953adb450eb8bf384258591c57" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 41727 } }
I20260809 19:14:02.177418 5465 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3549af953adb450eb8bf384258591c57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:14:02.177508 5465 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3549af953adb450eb8bf384258591c57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3549af953adb450eb8bf384258591c57, State: Initialized, Role: FOLLOWER
I20260809 19:14:02.178009 5465 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3549af953adb450eb8bf384258591c57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3549af953adb450eb8bf384258591c57" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 41727 } }
I20260809 19:14:02.178231 5465 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3549af953adb450eb8bf384258591c57 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:14:02.178375 5465 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3549af953adb450eb8bf384258591c57 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:14:02.178553 5465 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3549af953adb450eb8bf384258591c57 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:02.180740 5465 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3549af953adb450eb8bf384258591c57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3549af953adb450eb8bf384258591c57" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 41727 } }
I20260809 19:14:02.181226 5465 leader_election.cc:302] T 00000000000000000000000000000000 P 3549af953adb450eb8bf384258591c57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3549af953adb450eb8bf384258591c57; no voters:
I20260809 19:14:02.181777 5465 leader_election.cc:288] T 00000000000000000000000000000000 P 3549af953adb450eb8bf384258591c57 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:14:02.181906 5472 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3549af953adb450eb8bf384258591c57 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:14:02.183669 5465 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3549af953adb450eb8bf384258591c57 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:14:02.186537 5472 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3549af953adb450eb8bf384258591c57 [term 1 LEADER]: Becoming Leader. State: Replica: 3549af953adb450eb8bf384258591c57, State: Running, Role: LEADER
I20260809 19:14:02.187131 5472 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3549af953adb450eb8bf384258591c57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3549af953adb450eb8bf384258591c57" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 41727 } }
I20260809 19:14:02.190431 5473 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3549af953adb450eb8bf384258591c57 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3549af953adb450eb8bf384258591c57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3549af953adb450eb8bf384258591c57" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 41727 } } }
I20260809 19:14:02.190768 5473 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3549af953adb450eb8bf384258591c57 [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:02.189977 5478 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3549af953adb450eb8bf384258591c57 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3549af953adb450eb8bf384258591c57. Latest consensus state: current_term: 1 leader_uuid: "3549af953adb450eb8bf384258591c57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3549af953adb450eb8bf384258591c57" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 41727 } } }
I20260809 19:14:02.191093 5478 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3549af953adb450eb8bf384258591c57 [sys.catalog]: This master's current role is: LEADER
W20260809 19:14:02.196331 5503 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3549af953adb450eb8bf384258591c57: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 19:14:02.196480 5503 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 19:14:02.198783 5509 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:14:02.200932 5509 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:14:02.216666 5509 catalog_manager.cc:1347] Generated new cluster ID: cf7234c7f9e545ddb8286e93f1ce5284
I20260809 19:14:02.216792 5509 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:14:02.254259 5509 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:14:02.256129 5509 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:14:02.265144 5509 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3549af953adb450eb8bf384258591c57: Generated new TSK 0
I20260809 19:14:02.266172 5509 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:14:02.274956 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.1:0
--local_ip_for_outbound_sockets=127.7.39.1
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:41727
--builtin_ntp_servers=127.7.39.20:34689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 19:14:02.597980 5512 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:02.598244 5512 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:02.598397 5512 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:02.605540 5512 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:02.605643 5512 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:02.605778 5512 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.1
I20260809 19:14:02.615361 5512 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:34689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:41727
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.1
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:02.616706 5512 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:02.618443 5512 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:02.630540 5520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:02.630640 5521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:02.630517 5523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:02.631489 5512 server_base.cc:1034] running on GCE node
I20260809 19:14:02.632035 5512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:02.632889 5512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:02.634084 5512 hybrid_clock.cc:648] HybridClock initialized: now 1786302842634041 us; error 37 us; skew 500 ppm
I20260809 19:14:02.634402 5512 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:14:02.636454 5512 webserver.cc:460] Webserver started at http://127.7.39.1:37201/ using document root <none> and password file <none>
I20260809 19:14:02.637108 5512 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:02.637208 5512 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:02.637509 5512 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:02.640225 5512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-0/data/instance:
uuid: "e2bb5ed535f942549e978e071910dec9"
format_stamp: "Formatted at 2026-08-09 19:14:02 on dist-test-slave-4tdj"
server_key: "aac6a0034089acd0baef9a4cbc384cf0"
server_key_iv: "851391ce04e3b6b78dea042234fff162"
server_key_version: "encryptionkey@0"
I20260809 19:14:02.640960 5512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance:
uuid: "e2bb5ed535f942549e978e071910dec9"
format_stamp: "Formatted at 2026-08-09 19:14:02 on dist-test-slave-4tdj"
server_key: "aac6a0034089acd0baef9a4cbc384cf0"
server_key_iv: "851391ce04e3b6b78dea042234fff162"
server_key_version: "encryptionkey@0"
I20260809 19:14:02.645632 5512 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260809 19:14:02.648861 5530 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:02.650039 5512 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 19:14:02.650194 5512 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-0/wal
uuid: "e2bb5ed535f942549e978e071910dec9"
format_stamp: "Formatted at 2026-08-09 19:14:02 on dist-test-slave-4tdj"
server_key: "aac6a0034089acd0baef9a4cbc384cf0"
server_key_iv: "851391ce04e3b6b78dea042234fff162"
server_key_version: "encryptionkey@0"
I20260809 19:14:02.650440 5512 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:02.672827 5512 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:02.673524 5512 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:02.673770 5512 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:02.674671 5512 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:14:02.676025 5512 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:14:02.676123 5512 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:02.676221 5512 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:14:02.676301 5512 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:02.707016 5512 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.1:43299
I20260809 19:14:02.707082 5707 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.1:43299 every 8 connection(s)
I20260809 19:14:02.708271 5512 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
I20260809 19:14:02.711620 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 5512
I20260809 19:14:02.711813 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance
I20260809 19:14:02.712368 7324 external_mini_cluster.cc:1428] Setting key 80ec8a296aa386fa90c5b066961266da
I20260809 19:14:02.715442 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.2:0
--local_ip_for_outbound_sockets=127.7.39.2
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:41727
--builtin_ntp_servers=127.7.39.20:34689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 19:14:02.721743 5712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:02.710729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:42639 (local address 127.7.39.62:41727)
0809 19:14:02.711167 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:02.711173 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:02.712779 (+ 1606us) server_negotiation.cc:407] Connection header received
0809 19:14:02.714926 (+ 2147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:02.714930 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:02.714994 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:02.715083 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:02.716432 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:02.717136 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:02.719166 (+ 2030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:02.719576 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:02.719679 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:02.721059 (+ 1380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:02.721064 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:02.721067 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:02.721084 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:02.721123 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:02.721135 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:02.721201 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:02.721418 (+ 217us) server_negotiation.cc:299] Negotiation successful
0809 19:14:02.721495 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":217,"threads_started":1}
I20260809 19:14:02.723066 5714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:02.711234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:41727 (local address 127.7.39.1:42639)
0809 19:14:02.712596 (+ 1362us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:02.712648 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:02.714640 (+ 1992us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:02.715354 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:02.715364 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:02.715492 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:14:02.716266 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:02.716292 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:02.717286 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:02.717291 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:02.719036 (+ 1745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:02.719051 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:02.719792 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:02.719798 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:02.720059 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:02.720739 (+ 680us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:14:02.720742 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:14:02.720791 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:14:02.720889 (+ 98us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:14:02.721221 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:14:02.721232 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:14:02.721239 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 19:14:02.721405 (+ 166us) client_negotiation.cc:240] Negotiation successful
0809 19:14:02.721777 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":704,"thread_start_us":414,"threads_started":1}
I20260809 19:14:02.724578 5708 heartbeater.cc:347] Connected to a master server at 127.7.39.62:41727
I20260809 19:14:02.724865 5708 heartbeater.cc:464] Registering TS with master...
I20260809 19:14:02.725590 5708 heartbeater.cc:511] Master 127.7.39.62:41727 requested a full tablet report, sending...
I20260809 19:14:02.727563 5406 ts_manager.cc:194] Registered new tserver with Master: e2bb5ed535f942549e978e071910dec9 (127.7.39.1:43299)
I20260809 19:14:02.729009 5406 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.39.1:42639
W20260809 19:14:03.040038 5715 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:03.040305 5715 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:03.040431 5715 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:03.047435 5715 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:03.047528 5715 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:03.047675 5715 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.2
I20260809 19:14:03.056499 5715 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:34689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:41727
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.2
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:03.057687 5715 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:03.059482 5715 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:03.071758 5723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:03.071797 5724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:03.071821 5731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:03.072906 5715 server_base.cc:1034] running on GCE node
I20260809 19:14:03.073453 5715 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:03.074326 5715 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:03.075568 5715 hybrid_clock.cc:648] HybridClock initialized: now 1786302843075503 us; error 42 us; skew 500 ppm
I20260809 19:14:03.075860 5715 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:14:03.077904 5715 webserver.cc:460] Webserver started at http://127.7.39.2:41831/ using document root <none> and password file <none>
I20260809 19:14:03.078595 5715 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:03.078697 5715 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:03.078994 5715 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:03.081633 5715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-1/data/instance:
uuid: "0384bc24d3e54f78948b632c11ff804d"
format_stamp: "Formatted at 2026-08-09 19:14:03 on dist-test-slave-4tdj"
server_key: "a8e92f04c89dd1f251b4ac9ce64c1cf0"
server_key_iv: "73a520bd7a3befa3738c99b9de5ce296"
server_key_version: "encryptionkey@0"
I20260809 19:14:03.082499 5715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance:
uuid: "0384bc24d3e54f78948b632c11ff804d"
format_stamp: "Formatted at 2026-08-09 19:14:03 on dist-test-slave-4tdj"
server_key: "a8e92f04c89dd1f251b4ac9ce64c1cf0"
server_key_iv: "73a520bd7a3befa3738c99b9de5ce296"
server_key_version: "encryptionkey@0"
I20260809 19:14:03.087261 5715 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 19:14:03.090451 5742 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:03.091689 5715 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 19:14:03.091836 5715 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-1/wal
uuid: "0384bc24d3e54f78948b632c11ff804d"
format_stamp: "Formatted at 2026-08-09 19:14:03 on dist-test-slave-4tdj"
server_key: "a8e92f04c89dd1f251b4ac9ce64c1cf0"
server_key_iv: "73a520bd7a3befa3738c99b9de5ce296"
server_key_version: "encryptionkey@0"
I20260809 19:14:03.092021 5715 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:03.105875 5715 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:03.106630 5715 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:03.106861 5715 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:03.107831 5715 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:14:03.109171 5715 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:14:03.109264 5715 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:03.109364 5715 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:14:03.109431 5715 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:03.138411 5715 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.2:45961
I20260809 19:14:03.138447 5933 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.2:45961 every 8 connection(s)
I20260809 19:14:03.139626 5715 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
I20260809 19:14:03.143747 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 5715
I20260809 19:14:03.143908 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance
I20260809 19:14:03.144330 7324 external_mini_cluster.cc:1428] Setting key 82c3052ee2b7fbd87b9e86b6cc6636da
I20260809 19:14:03.147178 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.3:0
--local_ip_for_outbound_sockets=127.7.39.3
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:41727
--builtin_ntp_servers=127.7.39.20:34689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 19:14:03.153702 5712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:03.142086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:46631 (local address 127.7.39.62:41727)
0809 19:14:03.142270 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:03.142275 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:03.143706 (+ 1431us) server_negotiation.cc:407] Connection header received
0809 19:14:03.145754 (+ 2048us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:03.145760 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:03.145837 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:03.145977 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:03.147511 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.148572 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.150783 (+ 2211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.151329 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.151455 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:03.152891 (+ 1436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:03.152897 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:03.152902 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:03.152923 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:03.152962 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:03.152977 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:03.153058 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:03.153302 (+ 244us) server_negotiation.cc:299] Negotiation successful
0809 19:14:03.153397 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 19:14:03.154901 5937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:03.142656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:41727 (local address 127.7.39.2:46631)
0809 19:14:03.143554 (+ 898us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:03.143596 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:03.145446 (+ 1850us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:03.146421 (+ 975us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:03.146433 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:03.146552 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:14:03.147337 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:03.147362 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.148729 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.148735 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:03.150636 (+ 1901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:03.150651 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.151558 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.151565 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:03.151837 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:03.152547 (+ 710us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:14:03.152551 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:14:03.152601 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:14:03.152689 (+ 88us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:14:03.153069 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:14:03.153079 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:14:03.153087 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 19:14:03.153261 (+ 174us) client_negotiation.cc:240] Negotiation successful
0809 19:14:03.153644 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":272,"threads_started":1}
I20260809 19:14:03.156328 5935 heartbeater.cc:347] Connected to a master server at 127.7.39.62:41727
I20260809 19:14:03.156647 5935 heartbeater.cc:464] Registering TS with master...
I20260809 19:14:03.157495 5935 heartbeater.cc:511] Master 127.7.39.62:41727 requested a full tablet report, sending...
I20260809 19:14:03.159054 5406 ts_manager.cc:194] Registered new tserver with Master: 0384bc24d3e54f78948b632c11ff804d (127.7.39.2:45961)
I20260809 19:14:03.160163 5406 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.39.2:46631
W20260809 19:14:03.470361 5938 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:03.470613 5938 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:03.470698 5938 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:03.477690 5938 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:03.477774 5938 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:03.477880 5938 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.3
I20260809 19:14:03.486800 5938 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:34689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:41727
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.3
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:03.487994 5938 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:03.489744 5938 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:03.502012 5948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:03.502144 5943 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:03.502103 5945 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:03.503041 5938 server_base.cc:1034] running on GCE node
I20260809 19:14:03.503577 5938 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:03.504413 5938 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:03.505618 5938 hybrid_clock.cc:648] HybridClock initialized: now 1786302843505559 us; error 51 us; skew 500 ppm
I20260809 19:14:03.505924 5938 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:14:03.508005 5938 webserver.cc:460] Webserver started at http://127.7.39.3:43057/ using document root <none> and password file <none>
I20260809 19:14:03.508646 5938 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:03.508737 5938 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:03.509044 5938 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:03.511745 5938 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-2/data/instance:
uuid: "0d9f249e08574dfd87fb6bbe3225ca2e"
format_stamp: "Formatted at 2026-08-09 19:14:03 on dist-test-slave-4tdj"
server_key: "86ff37568e12c6dccbcdb6b0983777d2"
server_key_iv: "0df2a96db50e064b8a45bdc6809bdca9"
server_key_version: "encryptionkey@0"
I20260809 19:14:03.512477 5938 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance:
uuid: "0d9f249e08574dfd87fb6bbe3225ca2e"
format_stamp: "Formatted at 2026-08-09 19:14:03 on dist-test-slave-4tdj"
server_key: "86ff37568e12c6dccbcdb6b0983777d2"
server_key_iv: "0df2a96db50e064b8a45bdc6809bdca9"
server_key_version: "encryptionkey@0"
I20260809 19:14:03.517182 5938 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 19:14:03.520447 5957 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:03.521684 5938 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 19:14:03.521833 5938 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-2/wal
uuid: "0d9f249e08574dfd87fb6bbe3225ca2e"
format_stamp: "Formatted at 2026-08-09 19:14:03 on dist-test-slave-4tdj"
server_key: "86ff37568e12c6dccbcdb6b0983777d2"
server_key_iv: "0df2a96db50e064b8a45bdc6809bdca9"
server_key_version: "encryptionkey@0"
I20260809 19:14:03.522020 5938 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:03.549762 5938 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:03.550663 5938 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:03.550915 5938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:03.551864 5938 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:14:03.553357 5938 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:14:03.553453 5938 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:03.553561 5938 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:14:03.553628 5938 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:03.582585 5938 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.3:42339
I20260809 19:14:03.582667 6131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.3:42339 every 8 connection(s)
I20260809 19:14:03.583892 5938 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
I20260809 19:14:03.587677 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 5938
I20260809 19:14:03.587846 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance
I20260809 19:14:03.588323 7324 external_mini_cluster.cc:1428] Setting key acd51d7ca438ecf6e1e79c9ab21d5df8
I20260809 19:14:03.596202 5712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:03.586361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:57181 (local address 127.7.39.62:41727)
0809 19:14:03.586533 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:03.586538 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:03.587980 (+ 1442us) server_negotiation.cc:407] Connection header received
0809 19:14:03.590067 (+ 2087us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:03.590073 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:03.590159 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:03.590248 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:03.591426 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.592175 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.593629 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.594040 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.594147 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:03.595409 (+ 1262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:03.595414 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:03.595417 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:03.595434 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:03.595463 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:03.595474 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:03.595564 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:03.595798 (+ 234us) server_negotiation.cc:299] Negotiation successful
0809 19:14:03.595891 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 19:14:03.597056 6138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:03.586901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:41727 (local address 127.7.39.3:57181)
0809 19:14:03.587823 (+ 922us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:03.587881 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:03.589758 (+ 1877us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:03.590509 (+ 751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:03.590520 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:03.590629 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:14:03.591267 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:03.591291 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.592320 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.592324 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:03.593493 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:03.593504 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.594243 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.594250 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:03.594492 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:03.595116 (+ 624us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:14:03.595119 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:14:03.595159 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:14:03.595226 (+ 67us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:14:03.595558 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:14:03.595569 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:14:03.595576 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 19:14:03.595723 (+ 147us) client_negotiation.cc:240] Negotiation successful
0809 19:14:03.596077 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":316,"threads_started":1}
I20260809 19:14:03.598183 6133 heartbeater.cc:347] Connected to a master server at 127.7.39.62:41727
I20260809 19:14:03.598461 6133 heartbeater.cc:464] Registering TS with master...
I20260809 19:14:03.599131 6133 heartbeater.cc:511] Master 127.7.39.62:41727 requested a full tablet report, sending...
I20260809 19:14:03.600391 5406 ts_manager.cc:194] Registered new tserver with Master: 0d9f249e08574dfd87fb6bbe3225ca2e (127.7.39.3:42339)
I20260809 19:14:03.601135 5406 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.39.3:57181
I20260809 19:14:03.603243 7324 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 19:14:03.613184 5712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:03.607115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46338 (local address 127.7.39.62:41727)
0809 19:14:03.607271 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:03.607278 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:03.607703 (+ 425us) server_negotiation.cc:407] Connection header received
0809 19:14:03.607814 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:03.607817 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:03.607871 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:03.607940 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:03.608313 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.608947 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.610449 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.611067 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.611182 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:03.612627 (+ 1445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:03.612633 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:03.612638 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:03.612667 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:03.612703 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:03.612717 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:03.612825 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:03.612937 (+ 112us) server_negotiation.cc:299] Negotiation successful
0809 19:14:03.612984 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 19:14:03.616533 5406 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46338:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:14:03.623071 5406 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:14:03.653262 6157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:03.633732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:43299 (local address 127.0.0.1:58522)
0809 19:14:03.644433 (+ 10701us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:03.644473 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:03.644641 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:03.646357 (+ 1716us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:03.646364 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:03.646398 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:14:03.646739 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:03.646753 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.648463 (+ 1710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.648468 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:03.650926 (+ 2458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:03.650943 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.652327 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.652334 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:03.652527 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:03.652576 (+ 49us) client_negotiation.cc:769] Sending connection context
0809 19:14:03.652699 (+ 123us) client_negotiation.cc:240] Negotiation successful
0809 19:14:03.652880 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10440,"mutex_wait_us":45,"thread_start_us":11775,"threads_started":1}
I20260809 19:14:03.653287 6159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:03.633949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58522 (local address 127.7.39.1:43299)
0809 19:14:03.645465 (+ 11516us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:03.645474 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:03.645502 (+ 28us) server_negotiation.cc:407] Connection header received
0809 19:14:03.645598 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:03.645605 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:03.645861 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:03.646045 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:14:03.646958 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.648273 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.651164 (+ 2891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.652114 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.652211 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:03.652446 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:03.652775 (+ 329us) server_negotiation.cc:299] Negotiation successful
0809 19:14:03.652948 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11350,"thread_start_us":11224,"threads_started":1}
I20260809 19:14:03.654002 6156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:03.633983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:45961 (local address 127.0.0.1:36304)
0809 19:14:03.645787 (+ 11804us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:03.645802 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:03.646003 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:03.646917 (+ 914us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:03.646921 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:03.646945 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:14:03.647408 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:03.647418 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.648962 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.648968 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:03.651081 (+ 2113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:03.651094 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.653188 (+ 2094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.653195 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:03.653373 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:03.653405 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 19:14:03.653534 (+ 129us) client_negotiation.cc:240] Negotiation successful
0809 19:14:03.653667 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11669,"mutex_wait_us":2,"thread_start_us":10046,"threads_started":1}
I20260809 19:14:03.654850 6160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:03.634456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36304 (local address 127.7.39.2:45961)
0809 19:14:03.645023 (+ 10567us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:03.645029 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:03.645896 (+ 867us) server_negotiation.cc:407] Connection header received
0809 19:14:03.646197 (+ 301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:03.646205 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:03.646446 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:03.646624 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:14:03.647555 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.648821 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.651314 (+ 2493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.652690 (+ 1376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.652808 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:03.653052 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:03.654245 (+ 1193us) server_negotiation.cc:299] Negotiation successful
0809 19:14:03.654443 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10417,"thread_start_us":10302,"threads_started":1}
I20260809 19:14:03.655196 6162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:03.646898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:42339 (local address 127.0.0.1:36194)
0809 19:14:03.647493 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:03.647511 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:03.647623 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:03.648150 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:03.648161 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:03.648185 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:14:03.648561 (+ 376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:03.648576 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.649910 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.649914 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:03.652030 (+ 2116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:03.652045 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.653971 (+ 1926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.653979 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:03.654571 (+ 592us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:03.654674 (+ 103us) client_negotiation.cc:769] Sending connection context
0809 19:14:03.654751 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 19:14:03.654871 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"mutex_wait_us":42,"thread_start_us":274,"threads_started":1}
I20260809 19:14:03.655995 6161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:03.646195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36194 (local address 127.7.39.3:42339)
0809 19:14:03.646908 (+ 713us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:03.646916 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:03.647603 (+ 687us) server_negotiation.cc:407] Connection header received
0809 19:14:03.647776 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:03.647784 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:03.647977 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:03.648160 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:14:03.648753 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.649775 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.652239 (+ 2464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.653773 (+ 1534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.653892 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:03.654363 (+ 471us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:03.654831 (+ 468us) server_negotiation.cc:299] Negotiation successful
0809 19:14:03.655645 (+ 814us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":404,"threads_started":1}
I20260809 19:14:03.657398 5596 tablet_service.cc:1467] Processing CreateTablet for tablet 0387805aa65d47058bf399bd039f48f0 (DEFAULT_TABLE table=test-table [id=994c9d5af25f438f8c033dded25633ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:14:03.658340 5818 tablet_service.cc:1467] Processing CreateTablet for tablet 0387805aa65d47058bf399bd039f48f0 (DEFAULT_TABLE table=test-table [id=994c9d5af25f438f8c033dded25633ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:14:03.658918 5596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0387805aa65d47058bf399bd039f48f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:03.659441 5818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0387805aa65d47058bf399bd039f48f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:03.660118 6032 tablet_service.cc:1467] Processing CreateTablet for tablet 0387805aa65d47058bf399bd039f48f0 (DEFAULT_TABLE table=test-table [id=994c9d5af25f438f8c033dded25633ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:14:03.661478 6032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0387805aa65d47058bf399bd039f48f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:03.669510 6163 tablet_bootstrap.cc:492] T 0387805aa65d47058bf399bd039f48f0 P 0384bc24d3e54f78948b632c11ff804d: Bootstrap starting.
I20260809 19:14:03.672616 6163 tablet_bootstrap.cc:654] T 0387805aa65d47058bf399bd039f48f0 P 0384bc24d3e54f78948b632c11ff804d: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:03.673962 6163 log.cc:824] T 0387805aa65d47058bf399bd039f48f0 P 0384bc24d3e54f78948b632c11ff804d: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:03.673998 6165 tablet_bootstrap.cc:492] T 0387805aa65d47058bf399bd039f48f0 P e2bb5ed535f942549e978e071910dec9: Bootstrap starting.
I20260809 19:14:03.676703 6167 tablet_bootstrap.cc:492] T 0387805aa65d47058bf399bd039f48f0 P 0d9f249e08574dfd87fb6bbe3225ca2e: Bootstrap starting.
I20260809 19:14:03.677594 6165 tablet_bootstrap.cc:654] T 0387805aa65d47058bf399bd039f48f0 P e2bb5ed535f942549e978e071910dec9: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:03.677759 6163 tablet_bootstrap.cc:492] T 0387805aa65d47058bf399bd039f48f0 P 0384bc24d3e54f78948b632c11ff804d: No bootstrap required, opened a new log
I20260809 19:14:03.678021 6163 ts_tablet_manager.cc:1397] T 0387805aa65d47058bf399bd039f48f0 P 0384bc24d3e54f78948b632c11ff804d: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260809 19:14:03.678839 6165 log.cc:824] T 0387805aa65d47058bf399bd039f48f0 P e2bb5ed535f942549e978e071910dec9: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:03.679489 6167 tablet_bootstrap.cc:654] T 0387805aa65d47058bf399bd039f48f0 P 0d9f249e08574dfd87fb6bbe3225ca2e: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:03.680506 6167 log.cc:824] T 0387805aa65d47058bf399bd039f48f0 P 0d9f249e08574dfd87fb6bbe3225ca2e: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:03.681770 6165 tablet_bootstrap.cc:492] T 0387805aa65d47058bf399bd039f48f0 P e2bb5ed535f942549e978e071910dec9: No bootstrap required, opened a new log
I20260809 19:14:03.682027 6165 ts_tablet_manager.cc:1397] T 0387805aa65d47058bf399bd039f48f0 P e2bb5ed535f942549e978e071910dec9: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260809 19:14:03.682801 6167 tablet_bootstrap.cc:492] T 0387805aa65d47058bf399bd039f48f0 P 0d9f249e08574dfd87fb6bbe3225ca2e: No bootstrap required, opened a new log
I20260809 19:14:03.683058 6167 ts_tablet_manager.cc:1397] T 0387805aa65d47058bf399bd039f48f0 P 0d9f249e08574dfd87fb6bbe3225ca2e: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260809 19:14:03.687732 6163 raft_consensus.cc:348] T 0387805aa65d47058bf399bd039f48f0 P 0384bc24d3e54f78948b632c11ff804d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2bb5ed535f942549e978e071910dec9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 43299 } } peers { permanent_uuid: "0384bc24d3e54f78948b632c11ff804d" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 45961 } } peers { permanent_uuid: "0d9f249e08574dfd87fb6bbe3225ca2e" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 42339 } }
I20260809 19:14:03.688141 6163 raft_consensus.cc:374] T 0387805aa65d47058bf399bd039f48f0 P 0384bc24d3e54f78948b632c11ff804d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:14:03.688234 6163 raft_consensus.cc:729] T 0387805aa65d47058bf399bd039f48f0 P 0384bc24d3e54f78948b632c11ff804d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0384bc24d3e54f78948b632c11ff804d, State: Initialized, Role: FOLLOWER
I20260809 19:14:03.688818 6163 consensus_queue.cc:260] T 0387805aa65d47058bf399bd039f48f0 P 0384bc24d3e54f78948b632c11ff804d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2bb5ed535f942549e978e071910dec9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 43299 } } peers { permanent_uuid: "0384bc24d3e54f78948b632c11ff804d" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 45961 } } peers { permanent_uuid: "0d9f249e08574dfd87fb6bbe3225ca2e" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 42339 } }
I20260809 19:14:03.689889 5935 heartbeater.cc:503] Master 127.7.39.62:41727 was elected leader, sending a full tablet report...
I20260809 19:14:03.690496 6163 ts_tablet_manager.cc:1428] T 0387805aa65d47058bf399bd039f48f0 P 0384bc24d3e54f78948b632c11ff804d: Time spent starting tablet: real 0.012s user 0.008s sys 0.005s
I20260809 19:14:03.690757 6167 raft_consensus.cc:348] T 0387805aa65d47058bf399bd039f48f0 P 0d9f249e08574dfd87fb6bbe3225ca2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2bb5ed535f942549e978e071910dec9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 43299 } } peers { permanent_uuid: "0384bc24d3e54f78948b632c11ff804d" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 45961 } } peers { permanent_uuid: "0d9f249e08574dfd87fb6bbe3225ca2e" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 42339 } }
I20260809 19:14:03.691143 6167 raft_consensus.cc:374] T 0387805aa65d47058bf399bd039f48f0 P 0d9f249e08574dfd87fb6bbe3225ca2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:14:03.691244 6167 raft_consensus.cc:729] T 0387805aa65d47058bf399bd039f48f0 P 0d9f249e08574dfd87fb6bbe3225ca2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d9f249e08574dfd87fb6bbe3225ca2e, State: Initialized, Role: FOLLOWER
I20260809 19:14:03.691804 6167 consensus_queue.cc:260] T 0387805aa65d47058bf399bd039f48f0 P 0d9f249e08574dfd87fb6bbe3225ca2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2bb5ed535f942549e978e071910dec9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 43299 } } peers { permanent_uuid: "0384bc24d3e54f78948b632c11ff804d" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 45961 } } peers { permanent_uuid: "0d9f249e08574dfd87fb6bbe3225ca2e" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 42339 } }
I20260809 19:14:03.691825 6165 raft_consensus.cc:348] T 0387805aa65d47058bf399bd039f48f0 P e2bb5ed535f942549e978e071910dec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2bb5ed535f942549e978e071910dec9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 43299 } } peers { permanent_uuid: "0384bc24d3e54f78948b632c11ff804d" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 45961 } } peers { permanent_uuid: "0d9f249e08574dfd87fb6bbe3225ca2e" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 42339 } }
I20260809 19:14:03.692118 6165 raft_consensus.cc:374] T 0387805aa65d47058bf399bd039f48f0 P e2bb5ed535f942549e978e071910dec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:14:03.692188 6165 raft_consensus.cc:729] T 0387805aa65d47058bf399bd039f48f0 P e2bb5ed535f942549e978e071910dec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2bb5ed535f942549e978e071910dec9, State: Initialized, Role: FOLLOWER
I20260809 19:14:03.692835 6133 heartbeater.cc:503] Master 127.7.39.62:41727 was elected leader, sending a full tablet report...
I20260809 19:14:03.692719 6165 consensus_queue.cc:260] T 0387805aa65d47058bf399bd039f48f0 P e2bb5ed535f942549e978e071910dec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2bb5ed535f942549e978e071910dec9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 43299 } } peers { permanent_uuid: "0384bc24d3e54f78948b632c11ff804d" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 45961 } } peers { permanent_uuid: "0d9f249e08574dfd87fb6bbe3225ca2e" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 42339 } }
I20260809 19:14:03.693585 6167 ts_tablet_manager.cc:1428] T 0387805aa65d47058bf399bd039f48f0 P 0d9f249e08574dfd87fb6bbe3225ca2e: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20260809 19:14:03.694589 5708 heartbeater.cc:503] Master 127.7.39.62:41727 was elected leader, sending a full tablet report...
I20260809 19:14:03.695407 6165 ts_tablet_manager.cc:1428] T 0387805aa65d47058bf399bd039f48f0 P e2bb5ed535f942549e978e071910dec9: Time spent starting tablet: real 0.013s user 0.010s sys 0.005s
W20260809 19:14:03.710342 5711 tablet.cc:2369] T 0387805aa65d47058bf399bd039f48f0 P e2bb5ed535f942549e978e071910dec9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:14:03.734150 6170 raft_consensus.cc:482] T 0387805aa65d47058bf399bd039f48f0 P 0384bc24d3e54f78948b632c11ff804d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:14:03.734458 6170 raft_consensus.cc:504] T 0387805aa65d47058bf399bd039f48f0 P 0384bc24d3e54f78948b632c11ff804d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2bb5ed535f942549e978e071910dec9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 43299 } } peers { permanent_uuid: "0384bc24d3e54f78948b632c11ff804d" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 45961 } } peers { permanent_uuid: "0d9f249e08574dfd87fb6bbe3225ca2e" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 42339 } }
I20260809 19:14:03.735992 6170 leader_election.cc:288] T 0387805aa65d47058bf399bd039f48f0 P 0384bc24d3e54f78948b632c11ff804d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2bb5ed535f942549e978e071910dec9 (127.7.39.1:43299), 0d9f249e08574dfd87fb6bbe3225ca2e (127.7.39.3:42339)
I20260809 19:14:03.742360 6173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:03.736191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:43299 (local address 127.7.39.2:43299)
0809 19:14:03.736759 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:03.736778 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:03.736914 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:03.737295 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:03.737300 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:03.737330 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:14:03.737685 (+ 355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:03.737698 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.738857 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.738862 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:03.740429 (+ 1567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:03.740441 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.741654 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.741661 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:03.741830 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:03.741864 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 19:14:03.741949 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 19:14:03.742085 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":271,"threads_started":1}
I20260809 19:14:03.742385 6159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:03.736275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:43299 (local address 127.7.39.1:43299)
0809 19:14:03.736435 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:03.736439 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:03.737006 (+ 567us) server_negotiation.cc:407] Connection header received
0809 19:14:03.737094 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:03.737100 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:03.737166 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:03.737254 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:14:03.737833 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.738730 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.740610 (+ 1880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.741463 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.741558 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:03.741620 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:03.741988 (+ 368us) server_negotiation.cc:299] Negotiation successful
0809 19:14:03.742120 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 19:14:03.742718 6175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:03.736858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:42339 (local address 127.7.39.2:53571)
0809 19:14:03.737437 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:03.737451 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:03.737547 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:03.737842 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:03.737846 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:03.737870 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:14:03.738226 (+ 356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:03.738238 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.739402 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.739406 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:03.740816 (+ 1410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:03.740830 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.742045 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.742051 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:03.742225 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:03.742259 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 19:14:03.742379 (+ 120us) client_negotiation.cc:240] Negotiation successful
0809 19:14:03.742493 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":308,"threads_started":1}
I20260809 19:14:03.742754 6161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:03.736927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:53571 (local address 127.7.39.3:42339)
0809 19:14:03.737094 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:03.737100 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:03.737531 (+ 431us) server_negotiation.cc:407] Connection header received
0809 19:14:03.737660 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:03.737666 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:03.737735 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:03.737819 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:14:03.738407 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.739256 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.740991 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.741861 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.741982 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:03.742108 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:03.742402 (+ 294us) server_negotiation.cc:299] Negotiation successful
0809 19:14:03.742533 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 19:14:03.743527 6062 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0387805aa65d47058bf399bd039f48f0" candidate_uuid: "0384bc24d3e54f78948b632c11ff804d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d9f249e08574dfd87fb6bbe3225ca2e" is_pre_election: true
I20260809 19:14:03.743558 5624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0387805aa65d47058bf399bd039f48f0" candidate_uuid: "0384bc24d3e54f78948b632c11ff804d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2bb5ed535f942549e978e071910dec9" is_pre_election: true
I20260809 19:14:03.743964 5624 raft_consensus.cc:2454] T 0387805aa65d47058bf399bd039f48f0 P e2bb5ed535f942549e978e071910dec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0384bc24d3e54f78948b632c11ff804d in term 0.
I20260809 19:14:03.743965 6062 raft_consensus.cc:2454] T 0387805aa65d47058bf399bd039f48f0 P 0d9f249e08574dfd87fb6bbe3225ca2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0384bc24d3e54f78948b632c11ff804d in term 0.
I20260809 19:14:03.744524 5746 leader_election.cc:302] T 0387805aa65d47058bf399bd039f48f0 P 0384bc24d3e54f78948b632c11ff804d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0384bc24d3e54f78948b632c11ff804d, 0d9f249e08574dfd87fb6bbe3225ca2e; no voters:
I20260809 19:14:03.744856 6170 raft_consensus.cc:2781] T 0387805aa65d47058bf399bd039f48f0 P 0384bc24d3e54f78948b632c11ff804d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:14:03.744974 6170 raft_consensus.cc:482] T 0387805aa65d47058bf399bd039f48f0 P 0384bc24d3e54f78948b632c11ff804d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:14:03.745066 6170 raft_consensus.cc:3037] T 0387805aa65d47058bf399bd039f48f0 P 0384bc24d3e54f78948b632c11ff804d [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:03.747246 6170 raft_consensus.cc:504] T 0387805aa65d47058bf399bd039f48f0 P 0384bc24d3e54f78948b632c11ff804d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2bb5ed535f942549e978e071910dec9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 43299 } } peers { permanent_uuid: "0384bc24d3e54f78948b632c11ff804d" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 45961 } } peers { permanent_uuid: "0d9f249e08574dfd87fb6bbe3225ca2e" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 42339 } }
I20260809 19:14:03.747757 6170 leader_election.cc:288] T 0387805aa65d47058bf399bd039f48f0 P 0384bc24d3e54f78948b632c11ff804d [CANDIDATE]: Term 1 election: Requested vote from peers e2bb5ed535f942549e978e071910dec9 (127.7.39.1:43299), 0d9f249e08574dfd87fb6bbe3225ca2e (127.7.39.3:42339)
I20260809 19:14:03.748157 5624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0387805aa65d47058bf399bd039f48f0" candidate_uuid: "0384bc24d3e54f78948b632c11ff804d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2bb5ed535f942549e978e071910dec9"
I20260809 19:14:03.748229 6062 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0387805aa65d47058bf399bd039f48f0" candidate_uuid: "0384bc24d3e54f78948b632c11ff804d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d9f249e08574dfd87fb6bbe3225ca2e"
I20260809 19:14:03.748313 5624 raft_consensus.cc:3037] T 0387805aa65d47058bf399bd039f48f0 P e2bb5ed535f942549e978e071910dec9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:03.748401 6062 raft_consensus.cc:3037] T 0387805aa65d47058bf399bd039f48f0 P 0d9f249e08574dfd87fb6bbe3225ca2e [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:03.750437 5624 raft_consensus.cc:2454] T 0387805aa65d47058bf399bd039f48f0 P e2bb5ed535f942549e978e071910dec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0384bc24d3e54f78948b632c11ff804d in term 1.
I20260809 19:14:03.750516 6062 raft_consensus.cc:2454] T 0387805aa65d47058bf399bd039f48f0 P 0d9f249e08574dfd87fb6bbe3225ca2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0384bc24d3e54f78948b632c11ff804d in term 1.
I20260809 19:14:03.750793 5746 leader_election.cc:302] T 0387805aa65d47058bf399bd039f48f0 P 0384bc24d3e54f78948b632c11ff804d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0384bc24d3e54f78948b632c11ff804d, e2bb5ed535f942549e978e071910dec9; no voters:
I20260809 19:14:03.751048 6170 raft_consensus.cc:2781] T 0387805aa65d47058bf399bd039f48f0 P 0384bc24d3e54f78948b632c11ff804d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:14:03.751438 6170 raft_consensus.cc:686] T 0387805aa65d47058bf399bd039f48f0 P 0384bc24d3e54f78948b632c11ff804d [term 1 LEADER]: Becoming Leader. State: Replica: 0384bc24d3e54f78948b632c11ff804d, State: Running, Role: LEADER
I20260809 19:14:03.751910 6170 consensus_queue.cc:237] T 0387805aa65d47058bf399bd039f48f0 P 0384bc24d3e54f78948b632c11ff804d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2bb5ed535f942549e978e071910dec9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 43299 } } peers { permanent_uuid: "0384bc24d3e54f78948b632c11ff804d" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 45961 } } peers { permanent_uuid: "0d9f249e08574dfd87fb6bbe3225ca2e" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 42339 } }
I20260809 19:14:03.756433 5405 catalog_manager.cc:5495] T 0387805aa65d47058bf399bd039f48f0 P 0384bc24d3e54f78948b632c11ff804d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0384bc24d3e54f78948b632c11ff804d (127.7.39.2). New cstate: current_term: 1 leader_uuid: "0384bc24d3e54f78948b632c11ff804d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2bb5ed535f942549e978e071910dec9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 43299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0384bc24d3e54f78948b632c11ff804d" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 45961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d9f249e08574dfd87fb6bbe3225ca2e" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 42339 } health_report { overall_health: UNKNOWN } } }
I20260809 19:14:03.796700 6160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:03.791935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36320 (local address 127.7.39.2:45961)
0809 19:14:03.792099 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:03.792103 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:03.792124 (+ 21us) server_negotiation.cc:407] Connection header received
0809 19:14:03.792289 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:03.792293 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:03.792370 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:03.792484 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:14:03.792774 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.793434 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.794764 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.795190 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.795275 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:03.795732 (+ 457us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:14:03.796165 (+ 433us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:14:03.796311 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:03.796400 (+ 89us) server_negotiation.cc:299] Negotiation successful
0809 19:14:03.796433 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 19:14:03.804382 6062 raft_consensus.cc:1261] T 0387805aa65d47058bf399bd039f48f0 P 0d9f249e08574dfd87fb6bbe3225ca2e [term 1 FOLLOWER]: Refusing update from remote peer 0384bc24d3e54f78948b632c11ff804d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:14:03.804382 5624 raft_consensus.cc:1261] T 0387805aa65d47058bf399bd039f48f0 P e2bb5ed535f942549e978e071910dec9 [term 1 FOLLOWER]: Refusing update from remote peer 0384bc24d3e54f78948b632c11ff804d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:14:03.805380 6176 consensus_queue.cc:1035] T 0387805aa65d47058bf399bd039f48f0 P 0384bc24d3e54f78948b632c11ff804d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2bb5ed535f942549e978e071910dec9" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 43299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:14:03.805703 6170 consensus_queue.cc:1035] T 0387805aa65d47058bf399bd039f48f0 P 0384bc24d3e54f78948b632c11ff804d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d9f249e08574dfd87fb6bbe3225ca2e" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:14:03.817775 6180 mvcc.cc:205] Tried to move back new op lower bound from 7316696448212439040 to 7316696448011554816. Current Snapshot: MvccSnapshot[applied={T|T < 7316696448212439040}]
I20260809 19:14:03.829886 5405 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46338:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:14:03.830164 5405 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46338:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:14:03.833604 5405 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3549af953adb450eb8bf384258591c57: Sending DeleteTablet for 3 replicas of tablet 0387805aa65d47058bf399bd039f48f0
I20260809 19:14:03.834663 5596 tablet_service.cc:1514] Processing DeleteTablet for tablet 0387805aa65d47058bf399bd039f48f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:14:03 UTC) from {username='slave'} at 127.0.0.1:58522
I20260809 19:14:03.834695 5818 tablet_service.cc:1514] Processing DeleteTablet for tablet 0387805aa65d47058bf399bd039f48f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:14:03 UTC) from {username='slave'} at 127.0.0.1:36304
I20260809 19:14:03.834806 6032 tablet_service.cc:1514] Processing DeleteTablet for tablet 0387805aa65d47058bf399bd039f48f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:14:03 UTC) from {username='slave'} at 127.0.0.1:36194
I20260809 19:14:03.836436 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 5512
I20260809 19:14:03.847613 6195 tablet_replica.cc:330] T 0387805aa65d47058bf399bd039f48f0 P 0384bc24d3e54f78948b632c11ff804d: stopping tablet replica
I20260809 19:14:03.848032 6195 raft_consensus.cc:2229] T 0387805aa65d47058bf399bd039f48f0 P 0384bc24d3e54f78948b632c11ff804d [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:14:03.848683 6195 raft_consensus.cc:2258] T 0387805aa65d47058bf399bd039f48f0 P 0384bc24d3e54f78948b632c11ff804d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:14:03.850745 6195 ts_tablet_manager.cc:1905] T 0387805aa65d47058bf399bd039f48f0 P 0384bc24d3e54f78948b632c11ff804d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:14:03.857942 6195 ts_tablet_manager.cc:1918] T 0387805aa65d47058bf399bd039f48f0 P 0384bc24d3e54f78948b632c11ff804d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:14:03.858109 6195 log.cc:1196] T 0387805aa65d47058bf399bd039f48f0 P 0384bc24d3e54f78948b632c11ff804d: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-1/wal/wals/0387805aa65d47058bf399bd039f48f0
I20260809 19:14:03.858736 6195 ts_tablet_manager.cc:1939] T 0387805aa65d47058bf399bd039f48f0 P 0384bc24d3e54f78948b632c11ff804d: Deleting consensus metadata
I20260809 19:14:03.860472 5384 catalog_manager.cc:4841] TS 0384bc24d3e54f78948b632c11ff804d (127.7.39.2:45961): tablet 0387805aa65d47058bf399bd039f48f0 (table test-table [id=994c9d5af25f438f8c033dded25633ec]) successfully deleted
I20260809 19:14:03.863725 6196 tablet_replica.cc:330] T 0387805aa65d47058bf399bd039f48f0 P e2bb5ed535f942549e978e071910dec9: stopping tablet replica
I20260809 19:14:03.864171 6196 raft_consensus.cc:2229] T 0387805aa65d47058bf399bd039f48f0 P e2bb5ed535f942549e978e071910dec9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:14:03.864698 6196 raft_consensus.cc:2258] T 0387805aa65d47058bf399bd039f48f0 P e2bb5ed535f942549e978e071910dec9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:14:03.865523 6197 tablet_replica.cc:330] T 0387805aa65d47058bf399bd039f48f0 P 0d9f249e08574dfd87fb6bbe3225ca2e: stopping tablet replica
I20260809 19:14:03.865916 6197 raft_consensus.cc:2229] T 0387805aa65d47058bf399bd039f48f0 P 0d9f249e08574dfd87fb6bbe3225ca2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:14:03.866398 6197 raft_consensus.cc:2258] T 0387805aa65d47058bf399bd039f48f0 P 0d9f249e08574dfd87fb6bbe3225ca2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:14:03.867187 6196 ts_tablet_manager.cc:1905] T 0387805aa65d47058bf399bd039f48f0 P e2bb5ed535f942549e978e071910dec9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:14:03.869254 6197 ts_tablet_manager.cc:1905] T 0387805aa65d47058bf399bd039f48f0 P 0d9f249e08574dfd87fb6bbe3225ca2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:14:03.870698 6159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:03.837764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58534 (local address 127.7.39.1:43299)
0809 19:14:03.837933 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:03.837940 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:03.862224 (+ 24284us) server_negotiation.cc:407] Connection header received
0809 19:14:03.862486 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:03.862493 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:03.862623 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:03.862700 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:03.863401 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.864691 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.866771 (+ 2080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.867442 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.867581 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:03.868946 (+ 1365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:03.868957 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:03.868973 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:03.869732 (+ 759us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:03.869787 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:03.869809 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:03.869892 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:03.870192 (+ 300us) server_negotiation.cc:299] Negotiation successful
0809 19:14:03.870338 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 19:14:03.871968 5701 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:14:03.876315 6197 ts_tablet_manager.cc:1918] T 0387805aa65d47058bf399bd039f48f0 P 0d9f249e08574dfd87fb6bbe3225ca2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:14:03.876490 6197 log.cc:1196] T 0387805aa65d47058bf399bd039f48f0 P 0d9f249e08574dfd87fb6bbe3225ca2e: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786302538618573-7324-0/minicluster-data/ts-2/wal/wals/0387805aa65d47058bf399bd039f48f0
I20260809 19:14:03.877038 6197 ts_tablet_manager.cc:1939] T 0387805aa65d47058bf399bd039f48f0 P 0d9f249e08574dfd87fb6bbe3225ca2e: Deleting consensus metadata
I20260809 19:14:03.878937 5387 catalog_manager.cc:4841] TS 0d9f249e08574dfd87fb6bbe3225ca2e (127.7.39.3:42339): tablet 0387805aa65d47058bf399bd039f48f0 (table test-table [id=994c9d5af25f438f8c033dded25633ec]) successfully deleted
I20260809 19:14:03.959299 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 5512
I20260809 19:14:03.980254 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 5715
W20260809 19:14:03.980392 5387 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.39.1:43299 (error 108)
I20260809 19:14:03.983095 6157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:03.982565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:43299 (local address 127.0.0.1:58550)
0809 19:14:03.982761 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:03.982890 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:43299: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260809 19:14:03.983498 5387 catalog_manager.cc:4584] TS e2bb5ed535f942549e978e071910dec9 (127.7.39.1:43299): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0387805aa65d47058bf399bd039f48f0: Network error: Client connection negotiation failed: client connection to 127.7.39.1:43299: connect: Connection refused (error 111)
I20260809 19:14:03.987859 6160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:03.981119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36322 (local address 127.7.39.2:45961)
0809 19:14:03.981312 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:03.981319 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:03.981348 (+ 29us) server_negotiation.cc:407] Connection header received
0809 19:14:03.981577 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:03.981583 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:03.981686 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:03.981810 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:03.982388 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.983300 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.984777 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:03.985223 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:03.985354 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:03.986508 (+ 1154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:03.986517 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:03.986531 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:03.987141 (+ 610us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:03.987186 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:03.987208 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:03.987333 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:03.987451 (+ 118us) server_negotiation.cc:299] Negotiation successful
0809 19:14:03.987545 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 19:14:03.988791 5927 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:14:04.037358 6157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:04.036888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:43299 (local address 127.0.0.1:58564)
0809 19:14:04.037097 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:04.037192 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:43299: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260809 19:14:04.038429 6157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:04.038031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:43299 (local address 127.0.0.1:58566)
0809 19:14:04.038190 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:04.038262 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:43299: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260809 19:14:04.097038 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 5715
I20260809 19:14:04.098874 6157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:04.098353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:43299 (local address 127.0.0.1:58568)
0809 19:14:04.098586 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:04.098691 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:43299: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260809 19:14:04.099921 6157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:04.099631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:43299 (local address 127.0.0.1:58580)
0809 19:14:04.099742 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:04.099804 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:43299: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260809 19:14:04.117694 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 5938
I20260809 19:14:04.124224 6161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:04.118399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36198 (local address 127.7.39.3:42339)
0809 19:14:04.118571 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:04.118576 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:04.118597 (+ 21us) server_negotiation.cc:407] Connection header received
0809 19:14:04.118811 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:04.118817 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:04.118905 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:04.119005 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:04.119407 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:04.120131 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:04.121414 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:04.121815 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:04.121922 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:04.122974 (+ 1052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:04.122982 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:04.122997 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:04.123542 (+ 545us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:04.123590 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:04.123609 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:04.123715 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:04.123838 (+ 123us) server_negotiation.cc:299] Negotiation successful
0809 19:14:04.123939 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 19:14:04.124846 6124 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:14:04.180471 6157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:04.180042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:43299 (local address 127.0.0.1:58596)
0809 19:14:04.180239 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:04.180327 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:43299: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260809 19:14:04.181560 6157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:04.181168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:43299 (local address 127.0.0.1:58606)
0809 19:14:04.181365 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:04.181436 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.1:43299: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
I20260809 19:14:04.213805 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 5938
I20260809 19:14:04.236889 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 5361
I20260809 19:14:04.238013 5457 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:14:04.343361 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 5361
2026-08-09T19:14:04Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (2700 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:14:04 dist-test-slave-4tdj krb5kdc[6207](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:14:04 dist-test-slave-4tdj krb5kdc[6207](info): set up 2 sockets
Aug 09 19:14:04 dist-test-slave-4tdj krb5kdc[6207](info): commencing operation
krb5kdc: starting...
W20260809 19:14:05.559535 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.168s user 0.004s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:14:05 dist-test-slave-4tdj krb5kdc[6207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302845, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:14:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:14:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.39.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
I20260809 19:14:05.794935 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:37849
--webserver_interface=127.7.39.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:39863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:37849
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:14:06.113814 6232 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:06.114076 6232 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:06.114212 6232 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:06.121222 6232 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:14:06.121320 6232 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:06.121397 6232 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:06.121475 6232 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:14:06.121533 6232 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:14:06.130862 6232 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:39863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:37849
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:37849
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:06.132062 6232 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:06.133309 6232 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:06.144203 6240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:06.144214 6242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:06.144327 6244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:06.145152 6232 server_base.cc:1034] running on GCE node
I20260809 19:14:06.145865 6232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:06.147207 6232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:06.148409 6232 hybrid_clock.cc:648] HybridClock initialized: now 1786302846148364 us; error 35 us; skew 500 ppm
I20260809 19:14:06.148715 6232 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:14:06 dist-test-slave-4tdj krb5kdc[6207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302846, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:14:06.154103 6232 init.cc:377] Logged in from keytab as kudu/127.7.39.62@KRBTEST.COM (short username kudu)
I20260809 19:14:06.155568 6232 webserver.cc:460] Webserver started at http://127.7.39.62:39957/ using document root <none> and password file <none>
I20260809 19:14:06.156211 6232 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:06.156324 6232 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:06.156606 6232 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:06.159488 6232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "f46fe6efb43e411c8d511be9b7ebf364"
format_stamp: "Formatted at 2026-08-09 19:14:06 on dist-test-slave-4tdj"
server_key: "595a5e0bf3013c2b0b7e1170f8819899"
server_key_iv: "06d1c9f9c96663e0043c3b43f6b3a1bc"
server_key_version: "encryptionkey@0"
I20260809 19:14:06.160208 6232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "f46fe6efb43e411c8d511be9b7ebf364"
format_stamp: "Formatted at 2026-08-09 19:14:06 on dist-test-slave-4tdj"
server_key: "595a5e0bf3013c2b0b7e1170f8819899"
server_key_iv: "06d1c9f9c96663e0043c3b43f6b3a1bc"
server_key_version: "encryptionkey@0"
I20260809 19:14:06.165129 6232 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 19:14:06.168475 6254 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:06.169699 6232 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 19:14:06.169857 6232 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "f46fe6efb43e411c8d511be9b7ebf364"
format_stamp: "Formatted at 2026-08-09 19:14:06 on dist-test-slave-4tdj"
server_key: "595a5e0bf3013c2b0b7e1170f8819899"
server_key_iv: "06d1c9f9c96663e0043c3b43f6b3a1bc"
server_key_version: "encryptionkey@0"
I20260809 19:14:06.170033 6232 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:06.203851 6232 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:06.207573 6232 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:06.207832 6232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:06.224838 6232 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:37849
I20260809 19:14:06.224875 6339 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:37849 every 8 connection(s)
I20260809 19:14:06.226156 6232 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:14:06.229688 6340 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:06.233558 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 6232
I20260809 19:14:06.233714 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:14:06.234112 7324 external_mini_cluster.cc:1428] Setting key 73707421d92b160121543b5ad2abb2b3
I20260809 19:14:06.240252 6340 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f46fe6efb43e411c8d511be9b7ebf364: Bootstrap starting.
I20260809 19:14:06.243721 6340 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f46fe6efb43e411c8d511be9b7ebf364: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:06.244838 6340 log.cc:824] T 00000000000000000000000000000000 P f46fe6efb43e411c8d511be9b7ebf364: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:06.247428 6340 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f46fe6efb43e411c8d511be9b7ebf364: No bootstrap required, opened a new log
Aug 09 19:14:06 dist-test-slave-4tdj krb5kdc[6207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302845, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:14:06.255153 6340 raft_consensus.cc:348] T 00000000000000000000000000000000 P f46fe6efb43e411c8d511be9b7ebf364 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f46fe6efb43e411c8d511be9b7ebf364" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 37849 } }
I20260809 19:14:06.255501 6340 raft_consensus.cc:374] T 00000000000000000000000000000000 P f46fe6efb43e411c8d511be9b7ebf364 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:14:06.255610 6340 raft_consensus.cc:729] T 00000000000000000000000000000000 P f46fe6efb43e411c8d511be9b7ebf364 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f46fe6efb43e411c8d511be9b7ebf364, State: Initialized, Role: FOLLOWER
I20260809 19:14:06.256170 6340 consensus_queue.cc:260] T 00000000000000000000000000000000 P f46fe6efb43e411c8d511be9b7ebf364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f46fe6efb43e411c8d511be9b7ebf364" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 37849 } }
I20260809 19:14:06.256386 6347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:06.235843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51170 (local address 127.7.39.62:37849)
0809 19:14:06.236602 (+ 759us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:06.236613 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:06.236653 (+ 40us) server_negotiation.cc:407] Connection header received
0809 19:14:06.238800 (+ 2147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:06.238821 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:06.239163 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:06.239456 (+ 293us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:06.241238 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:06.242563 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:06.244349 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:06.245023 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:06.245164 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:06.249303 (+ 4139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:06.249310 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:06.249327 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:06.249366 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:06.252351 (+ 2985us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:06.253007 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:06.253013 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:06.253019 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:06.253193 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:06.253563 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:06.253569 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:06.253571 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:06.254074 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:06.254408 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:06.254865 (+ 457us) server_negotiation.cc:299] Negotiation successful
0809 19:14:06.255243 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":554,"thread_start_us":330,"threads_started":1}
I20260809 19:14:06.256404 6340 raft_consensus.cc:388] T 00000000000000000000000000000000 P f46fe6efb43e411c8d511be9b7ebf364 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:14:06.256567 6340 raft_consensus.cc:482] T 00000000000000000000000000000000 P f46fe6efb43e411c8d511be9b7ebf364 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:14:06.256759 6340 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f46fe6efb43e411c8d511be9b7ebf364 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:06.259014 6340 raft_consensus.cc:504] T 00000000000000000000000000000000 P f46fe6efb43e411c8d511be9b7ebf364 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f46fe6efb43e411c8d511be9b7ebf364" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 37849 } }
I20260809 19:14:06.259493 6340 leader_election.cc:302] T 00000000000000000000000000000000 P f46fe6efb43e411c8d511be9b7ebf364 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f46fe6efb43e411c8d511be9b7ebf364; no voters:
I20260809 19:14:06.260003 6340 leader_election.cc:288] T 00000000000000000000000000000000 P f46fe6efb43e411c8d511be9b7ebf364 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:14:06.260110 6350 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f46fe6efb43e411c8d511be9b7ebf364 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:14:06.260727 6350 raft_consensus.cc:686] T 00000000000000000000000000000000 P f46fe6efb43e411c8d511be9b7ebf364 [term 1 LEADER]: Becoming Leader. State: Replica: f46fe6efb43e411c8d511be9b7ebf364, State: Running, Role: LEADER
I20260809 19:14:06.261199 6350 consensus_queue.cc:237] T 00000000000000000000000000000000 P f46fe6efb43e411c8d511be9b7ebf364 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f46fe6efb43e411c8d511be9b7ebf364" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 37849 } }
I20260809 19:14:06.261861 6340 sys_catalog.cc:564] T 00000000000000000000000000000000 P f46fe6efb43e411c8d511be9b7ebf364 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:14:06.263660 6351 sys_catalog.cc:455] T 00000000000000000000000000000000 P f46fe6efb43e411c8d511be9b7ebf364 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f46fe6efb43e411c8d511be9b7ebf364" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f46fe6efb43e411c8d511be9b7ebf364" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 37849 } } }
I20260809 19:14:06.263652 6353 sys_catalog.cc:455] T 00000000000000000000000000000000 P f46fe6efb43e411c8d511be9b7ebf364 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f46fe6efb43e411c8d511be9b7ebf364. Latest consensus state: current_term: 1 leader_uuid: "f46fe6efb43e411c8d511be9b7ebf364" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f46fe6efb43e411c8d511be9b7ebf364" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 37849 } } }
I20260809 19:14:06.264091 6351 sys_catalog.cc:458] T 00000000000000000000000000000000 P f46fe6efb43e411c8d511be9b7ebf364 [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:06.264096 6353 sys_catalog.cc:458] T 00000000000000000000000000000000 P f46fe6efb43e411c8d511be9b7ebf364 [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:06.271214 6358 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:14:06.275892 6358 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:14:06.285219 6358 catalog_manager.cc:1347] Generated new cluster ID: 7dca8271848e45c9ae1a10993452374b
I20260809 19:14:06.285318 6358 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:14:06.307917 6358 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:14:06.309105 6358 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:14:06.317162 6358 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f46fe6efb43e411c8d511be9b7ebf364: Generated new TSK 0
I20260809 19:14:06.317863 6358 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.39.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
Entry for principal kudu/127.7.39.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab.
I20260809 19:14:06.387416 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.1:0
--local_ip_for_outbound_sockets=127.7.39.1
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:37849
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:39863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:14:06.715368 6389 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:06.715622 6389 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:06.715756 6389 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:06.723168 6389 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:06.723264 6389 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:06.723407 6389 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.1
I20260809 19:14:06.732664 6389 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:39863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.1.keytab
--principal=kudu/127.7.39.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:37849
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.1
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:06.733850 6389 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:06.735167 6389 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:06.747290 6398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:06.747366 6401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:06.747468 6399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:06.748317 6389 server_base.cc:1034] running on GCE node
I20260809 19:14:06.748901 6389 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:06.749754 6389 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:06.750982 6389 hybrid_clock.cc:648] HybridClock initialized: now 1786302846750925 us; error 36 us; skew 500 ppm
I20260809 19:14:06.751292 6389 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:14:06 dist-test-slave-4tdj krb5kdc[6207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302846, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:14:06.754238 6389 init.cc:377] Logged in from keytab as kudu/127.7.39.1@KRBTEST.COM (short username kudu)
I20260809 19:14:06.755678 6389 webserver.cc:460] Webserver started at http://127.7.39.1:37407/ using document root <none> and password file <none>
I20260809 19:14:06.756312 6389 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:06.756426 6389 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:06.756721 6389 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:06.759555 6389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-0/data/instance:
uuid: "95203043a92d428199c84ba91846f3d2"
format_stamp: "Formatted at 2026-08-09 19:14:06 on dist-test-slave-4tdj"
server_key: "bb5440cf6ef90b7ff830801e18521788"
server_key_iv: "5f177be47ba15b89a5879e6c5f9cf1d0"
server_key_version: "encryptionkey@0"
I20260809 19:14:06.760294 6389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance:
uuid: "95203043a92d428199c84ba91846f3d2"
format_stamp: "Formatted at 2026-08-09 19:14:06 on dist-test-slave-4tdj"
server_key: "bb5440cf6ef90b7ff830801e18521788"
server_key_iv: "5f177be47ba15b89a5879e6c5f9cf1d0"
server_key_version: "encryptionkey@0"
I20260809 19:14:06.765300 6389 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260809 19:14:06.768501 6409 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:06.769716 6389 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 19:14:06.769858 6389 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-0/wal
uuid: "95203043a92d428199c84ba91846f3d2"
format_stamp: "Formatted at 2026-08-09 19:14:06 on dist-test-slave-4tdj"
server_key: "bb5440cf6ef90b7ff830801e18521788"
server_key_iv: "5f177be47ba15b89a5879e6c5f9cf1d0"
server_key_version: "encryptionkey@0"
I20260809 19:14:06.770027 6389 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:06.779995 6389 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:06.783571 6389 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:06.783825 6389 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:06.784678 6389 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:14:06.785905 6389 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:14:06.785981 6389 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:06.786088 6389 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:14:06.786141 6389 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:06.815739 6389 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.1:46617
I20260809 19:14:06.815779 6578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.1:46617 every 8 connection(s)
I20260809 19:14:06.817000 6389 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
I20260809 19:14:06.825846 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 6389
I20260809 19:14:06.826001 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance
I20260809 19:14:06.826452 7324 external_mini_cluster.cc:1428] Setting key 917e6ae544d32155d21aaa3432783da2
Aug 09 19:14:06 dist-test-slave-4tdj krb5kdc[6207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302846, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.1@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:14:06.835456 6584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:06.819410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:41623 (local address 127.7.39.62:37849)
0809 19:14:06.819821 (+ 411us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:06.819825 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:06.820775 (+ 950us) server_negotiation.cc:407] Connection header received
0809 19:14:06.822544 (+ 1769us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:06.822549 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:06.822625 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:06.822716 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:06.824050 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:06.824746 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:06.826306 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:06.826750 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:06.826873 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:06.830244 (+ 3371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:06.830249 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:06.830252 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:06.830284 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:06.832570 (+ 2286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:06.833224 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:06.833230 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:06.833233 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:06.833350 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:06.833748 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:06.833753 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:06.833756 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:06.834018 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:06.834151 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:06.834870 (+ 719us) server_negotiation.cc:299] Negotiation successful
0809 19:14:06.835111 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":203,"threads_started":1}
I20260809 19:14:06.836285 6588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:06.819948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:37849 (local address 127.7.39.1:41623)
0809 19:14:06.820618 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:06.820662 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:06.822276 (+ 1614us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:06.822892 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:06.822900 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:06.823374 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:14:06.823920 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:06.823937 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:06.824869 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:06.824872 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:06.826143 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:06.826160 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:06.826969 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:06.826977 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:06.827256 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:06.827925 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:14:06.827947 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:14:06.830043 (+ 2096us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:14:06.832698 (+ 2655us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:06.832706 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:06.832721 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:06.833113 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:06.833450 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:06.833455 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:06.833459 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:06.833642 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:06.834149 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:14:06.834157 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:14:06.834503 (+ 346us) client_negotiation.cc:769] Sending connection context
0809 19:14:06.834735 (+ 232us) client_negotiation.cc:240] Negotiation successful
0809 19:14:06.835206 (+ 471us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":262,"threads_started":1}
I20260809 19:14:06.837754 6579 heartbeater.cc:347] Connected to a master server at 127.7.39.62:37849
I20260809 19:14:06.838032 6579 heartbeater.cc:464] Registering TS with master...
I20260809 19:14:06.838711 6579 heartbeater.cc:511] Master 127.7.39.62:37849 requested a full tablet report, sending...
I20260809 19:14:06.840696 6279 ts_manager.cc:194] Registered new tserver with Master: 95203043a92d428199c84ba91846f3d2 (127.7.39.1:46617)
I20260809 19:14:06.842090 6279 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.1@KRBTEST.COM'} at 127.7.39.1:41623
WARNING: no policy specified for kudu/127.7.39.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
Entry for principal kudu/127.7.39.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab.
I20260809 19:14:06.883486 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.2:0
--local_ip_for_outbound_sockets=127.7.39.2
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:37849
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:39863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:14:07.213533 6592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:07.213792 6592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:07.213930 6592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:07.220772 6592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:07.220870 6592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:07.221027 6592 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.2
I20260809 19:14:07.233963 6592 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:39863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.2.keytab
--principal=kudu/127.7.39.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:37849
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.2
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:07.235427 6592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:07.236920 6592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:07.250778 6603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:07.250820 6601 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:07.250857 6599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:07.251608 6592 server_base.cc:1034] running on GCE node
I20260809 19:14:07.252157 6592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:07.253031 6592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:07.254225 6592 hybrid_clock.cc:648] HybridClock initialized: now 1786302847254172 us; error 46 us; skew 500 ppm
I20260809 19:14:07.254556 6592 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:14:07 dist-test-slave-4tdj krb5kdc[6207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302847, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:14:07.257709 6592 init.cc:377] Logged in from keytab as kudu/127.7.39.2@KRBTEST.COM (short username kudu)
I20260809 19:14:07.259110 6592 webserver.cc:460] Webserver started at http://127.7.39.2:46847/ using document root <none> and password file <none>
I20260809 19:14:07.259747 6592 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:07.259858 6592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:07.260144 6592 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:07.262948 6592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-1/data/instance:
uuid: "8ac092e3951444ae84d8590e1457670b"
format_stamp: "Formatted at 2026-08-09 19:14:07 on dist-test-slave-4tdj"
server_key: "4a35840bd78577c3286a7992af8fcd27"
server_key_iv: "670bf82d3c54641bb577a62a2c739d01"
server_key_version: "encryptionkey@0"
I20260809 19:14:07.263701 6592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance:
uuid: "8ac092e3951444ae84d8590e1457670b"
format_stamp: "Formatted at 2026-08-09 19:14:07 on dist-test-slave-4tdj"
server_key: "4a35840bd78577c3286a7992af8fcd27"
server_key_iv: "670bf82d3c54641bb577a62a2c739d01"
server_key_version: "encryptionkey@0"
I20260809 19:14:07.268471 6592 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 19:14:07.271744 6613 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:07.273007 6592 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 19:14:07.273164 6592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-1/wal
uuid: "8ac092e3951444ae84d8590e1457670b"
format_stamp: "Formatted at 2026-08-09 19:14:07 on dist-test-slave-4tdj"
server_key: "4a35840bd78577c3286a7992af8fcd27"
server_key_iv: "670bf82d3c54641bb577a62a2c739d01"
server_key_version: "encryptionkey@0"
I20260809 19:14:07.273334 6592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:07.288589 6592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:07.292101 6592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:07.292349 6592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:07.293229 6592 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:14:07.294462 6592 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:14:07.294538 6592 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:07.294665 6592 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:14:07.294718 6592 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:07.323887 6592 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.2:45727
I20260809 19:14:07.323943 6783 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.2:45727 every 8 connection(s)
I20260809 19:14:07.325049 6592 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
I20260809 19:14:07.327894 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 6592
I20260809 19:14:07.328044 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance
I20260809 19:14:07.328634 7324 external_mini_cluster.cc:1428] Setting key 601fae21fdaf5de9024053b885a5e70d
Aug 09 19:14:07 dist-test-slave-4tdj krb5kdc[6207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302847, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.2@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:14:07.345705 6584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:07.327405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:37439 (local address 127.7.39.62:37849)
0809 19:14:07.327595 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:07.327602 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:07.328867 (+ 1265us) server_negotiation.cc:407] Connection header received
0809 19:14:07.330890 (+ 2023us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:07.330895 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:07.330960 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:07.331041 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:07.332876 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:07.333572 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:07.335573 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:07.335990 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:07.336092 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:07.339928 (+ 3836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:07.339933 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:07.339936 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:07.339967 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:07.342569 (+ 2602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:07.343504 (+ 935us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:07.343508 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:07.343511 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:07.343646 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:07.344053 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:07.344057 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:07.344059 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:07.344326 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:07.344472 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:07.345121 (+ 649us) server_negotiation.cc:299] Negotiation successful
0809 19:14:07.345368 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 19:14:07.346626 6788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:07.327836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:37849 (local address 127.7.39.2:37439)
0809 19:14:07.328697 (+ 861us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:07.328746 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:07.330604 (+ 1858us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:07.331309 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:07.331321 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:07.331974 (+ 653us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:14:07.332718 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:07.332741 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:07.333720 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:07.333725 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:07.335451 (+ 1726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:07.335465 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:07.336202 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:07.336209 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:07.336471 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:07.337167 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:14:07.337195 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:14:07.339711 (+ 2516us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:14:07.342975 (+ 3264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:07.342982 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:07.342992 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:07.343376 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:07.343750 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:07.343754 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:07.343758 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:07.343938 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:07.344448 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:14:07.344456 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:14:07.344761 (+ 305us) client_negotiation.cc:769] Sending connection context
0809 19:14:07.344984 (+ 223us) client_negotiation.cc:240] Negotiation successful
0809 19:14:07.345481 (+ 497us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":567,"thread_start_us":352,"threads_started":1}
I20260809 19:14:07.348089 6784 heartbeater.cc:347] Connected to a master server at 127.7.39.62:37849
I20260809 19:14:07.348359 6784 heartbeater.cc:464] Registering TS with master...
I20260809 19:14:07.349049 6784 heartbeater.cc:511] Master 127.7.39.62:37849 requested a full tablet report, sending...
I20260809 19:14:07.350541 6279 ts_manager.cc:194] Registered new tserver with Master: 8ac092e3951444ae84d8590e1457670b (127.7.39.2:45727)
I20260809 19:14:07.351529 6279 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.2@KRBTEST.COM'} at 127.7.39.2:37439
WARNING: no policy specified for kudu/127.7.39.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
Entry for principal kudu/127.7.39.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab.
I20260809 19:14:07.387399 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.3:0
--local_ip_for_outbound_sockets=127.7.39.3
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:37849
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:39863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:14:07.701020 6794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:07.701273 6794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:07.701399 6794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:07.708237 6794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:07.708336 6794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:07.708477 6794 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.3
I20260809 19:14:07.717656 6794 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:39863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.3.keytab
--principal=kudu/127.7.39.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:37849
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.3
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:07.718828 6794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:07.720039 6794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:07.731940 6800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:07.731986 6801 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:07.731992 6805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:07.732697 6794 server_base.cc:1034] running on GCE node
I20260809 19:14:07.733265 6794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:07.734112 6794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:07.735327 6794 hybrid_clock.cc:648] HybridClock initialized: now 1786302847735261 us; error 58 us; skew 500 ppm
I20260809 19:14:07.735612 6794 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:14:07 dist-test-slave-4tdj krb5kdc[6207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302847, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:14:07.738526 6794 init.cc:377] Logged in from keytab as kudu/127.7.39.3@KRBTEST.COM (short username kudu)
I20260809 19:14:07.739792 6794 webserver.cc:460] Webserver started at http://127.7.39.3:36167/ using document root <none> and password file <none>
I20260809 19:14:07.740404 6794 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:07.740516 6794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:07.740792 6794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:07.743796 6794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-2/data/instance:
uuid: "342ecb6e5bb94884b49e3a474791843a"
format_stamp: "Formatted at 2026-08-09 19:14:07 on dist-test-slave-4tdj"
server_key: "098348fdd9ecb5db71b5d383ce48ea43"
server_key_iv: "86ee810b785644643fdb4f9c757c817a"
server_key_version: "encryptionkey@0"
I20260809 19:14:07.744541 6794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance:
uuid: "342ecb6e5bb94884b49e3a474791843a"
format_stamp: "Formatted at 2026-08-09 19:14:07 on dist-test-slave-4tdj"
server_key: "098348fdd9ecb5db71b5d383ce48ea43"
server_key_iv: "86ee810b785644643fdb4f9c757c817a"
server_key_version: "encryptionkey@0"
I20260809 19:14:07.749295 6794 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 19:14:07.752586 6822 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:07.753902 6794 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 19:14:07.754052 6794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-2/wal
uuid: "342ecb6e5bb94884b49e3a474791843a"
format_stamp: "Formatted at 2026-08-09 19:14:07 on dist-test-slave-4tdj"
server_key: "098348fdd9ecb5db71b5d383ce48ea43"
server_key_iv: "86ee810b785644643fdb4f9c757c817a"
server_key_version: "encryptionkey@0"
I20260809 19:14:07.754218 6794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:07.770519 6794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:07.774353 6794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:07.774600 6794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:07.775429 6794 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:14:07.776648 6794 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:14:07.776723 6794 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:07.776835 6794 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:14:07.776887 6794 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:07.805827 6794 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.3:38255
I20260809 19:14:07.805879 7007 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.3:38255 every 8 connection(s)
I20260809 19:14:07.806998 6794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
I20260809 19:14:07.808043 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 6794
I20260809 19:14:07.808221 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance
I20260809 19:14:07.808799 7324 external_mini_cluster.cc:1428] Setting key 23a962d7f3c69ff15b9ff9a9e462c069
Aug 09 19:14:07 dist-test-slave-4tdj krb5kdc[6207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302847, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.3@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:14:07.825490 6584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:07.809506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:40211 (local address 127.7.39.62:37849)
0809 19:14:07.809693 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:07.809699 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:07.810942 (+ 1243us) server_negotiation.cc:407] Connection header received
0809 19:14:07.812827 (+ 1885us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:07.812832 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:07.812912 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:07.812994 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:07.814413 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:07.815374 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:07.816838 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:07.817425 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:07.817558 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:07.820580 (+ 3022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:07.820585 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:07.820588 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:07.820619 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:07.822996 (+ 2377us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:07.823716 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:07.823722 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:07.823725 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:07.823866 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:07.824204 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:07.824207 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:07.824209 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:07.824458 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:07.824563 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:07.825089 (+ 526us) server_negotiation.cc:299] Negotiation successful
0809 19:14:07.825260 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 19:14:07.826238 7010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:07.809962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:37849 (local address 127.7.39.3:40211)
0809 19:14:07.810787 (+ 825us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:07.810835 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:07.812587 (+ 1752us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:07.813242 (+ 655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:07.813249 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:07.813719 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:14:07.814248 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:07.814265 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:07.815517 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:07.815521 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:07.816696 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:07.816708 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:07.817604 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:07.817608 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:07.817786 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:07.818380 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:14:07.818406 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:14:07.820388 (+ 1982us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:14:07.823123 (+ 2735us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:07.823131 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:07.823144 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:07.823601 (+ 457us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:07.823946 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:07.823949 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:07.823951 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:07.824123 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:07.824542 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:14:07.824547 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:14:07.824804 (+ 257us) client_negotiation.cc:769] Sending connection context
0809 19:14:07.824998 (+ 194us) client_negotiation.cc:240] Negotiation successful
0809 19:14:07.825332 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"thread_start_us":348,"threads_started":1}
I20260809 19:14:07.827363 7008 heartbeater.cc:347] Connected to a master server at 127.7.39.62:37849
I20260809 19:14:07.827622 7008 heartbeater.cc:464] Registering TS with master...
I20260809 19:14:07.828269 7008 heartbeater.cc:511] Master 127.7.39.62:37849 requested a full tablet report, sending...
I20260809 19:14:07.829527 6279 ts_manager.cc:194] Registered new tserver with Master: 342ecb6e5bb94884b49e3a474791843a (127.7.39.3:38255)
I20260809 19:14:07.830258 6279 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.39.3@KRBTEST.COM'} at 127.7.39.3:40211
I20260809 19:14:07.835611 7324 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 19:14:07.844748 6579 heartbeater.cc:503] Master 127.7.39.62:37849 was elected leader, sending a full tablet report...
I20260809 19:14:07.850546 6584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:07.839462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56130 (local address 127.7.39.62:37849)
0809 19:14:07.839632 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:07.839637 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:07.839981 (+ 344us) server_negotiation.cc:407] Connection header received
0809 19:14:07.840131 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:07.840135 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:07.840191 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:07.840270 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:07.841535 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:07.842205 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:07.843523 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:07.843913 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:07.844031 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:07.846205 (+ 2174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:07.846210 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:07.846213 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:07.846241 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:07.848420 (+ 2179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:07.848989 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:07.848992 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:07.848994 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:07.849091 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:07.849366 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:07.849369 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:07.849371 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:07.849656 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:07.849834 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:07.850091 (+ 257us) server_negotiation.cc:299] Negotiation successful
0809 19:14:07.850243 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 19:14:07.853861 6279 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56130:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:14:07.860458 6279 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:14:07.881476 7030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:07.871462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:38255 (local address 127.0.0.1:59828)
0809 19:14:07.872213 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:07.872254 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:07.872425 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:07.873242 (+ 817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:07.873252 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:07.873286 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:14:07.873695 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:07.873710 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:07.876025 (+ 2315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:07.876031 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:07.878881 (+ 2850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:07.878897 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:07.880581 (+ 1684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:07.880587 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:07.880769 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:07.880821 (+ 52us) client_negotiation.cc:769] Sending connection context
0809 19:14:07.880938 (+ 117us) client_negotiation.cc:240] Negotiation successful
0809 19:14:07.881125 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":373,"threads_started":1}
I20260809 19:14:07.881476 7031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:07.871630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59828 (local address 127.7.39.3:38255)
0809 19:14:07.872339 (+ 709us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:07.872348 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:07.872380 (+ 32us) server_negotiation.cc:407] Connection header received
0809 19:14:07.872703 (+ 323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:07.872712 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:07.872895 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:07.873072 (+ 177us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:14:07.874053 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:07.875848 (+ 1795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:07.879062 (+ 3214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:07.880408 (+ 1346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:07.880517 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:07.880760 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:07.880995 (+ 235us) server_negotiation.cc:299] Negotiation successful
0809 19:14:07.881152 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":543,"thread_start_us":402,"threads_started":1}
I20260809 19:14:07.883221 7032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:07.872539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:45727 (local address 127.0.0.1:58728)
0809 19:14:07.873902 (+ 1363us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:07.873918 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:07.874027 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:07.875030 (+ 1003us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:07.875036 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:07.875076 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:14:07.875516 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:07.875527 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:07.877565 (+ 2038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:07.877571 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:07.879788 (+ 2217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:07.879805 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:07.882450 (+ 2645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:07.882457 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:07.882623 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:07.882660 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 19:14:07.882754 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 19:14:07.882886 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1249,"thread_start_us":1101,"threads_started":1}
I20260809 19:14:07.883312 7034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:07.872894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58728 (local address 127.7.39.2:45727)
0809 19:14:07.873556 (+ 662us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:07.873575 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:07.874164 (+ 589us) server_negotiation.cc:407] Connection header received
0809 19:14:07.874282 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:07.874318 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:07.874590 (+ 272us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:07.874795 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:14:07.875719 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:07.877391 (+ 1672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:07.879952 (+ 2561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:07.881962 (+ 2010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:07.882106 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:07.882308 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:07.882824 (+ 516us) server_negotiation.cc:299] Negotiation successful
0809 19:14:07.882989 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":519,"thread_start_us":362,"threads_started":1}
I20260809 19:14:07.886355 7035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:07.873974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:46617 (local address 127.0.0.1:49522)
0809 19:14:07.878644 (+ 4670us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:07.878661 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:07.878861 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:07.879703 (+ 842us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:07.879708 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:07.879734 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:14:07.880108 (+ 374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:07.880121 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:07.881809 (+ 1688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:07.881814 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:07.883873 (+ 2059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:07.883886 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:07.885624 (+ 1738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:07.885630 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:07.885788 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:07.885818 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 19:14:07.885914 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 19:14:07.886028 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4536,"thread_start_us":4332,"threads_started":1}
I20260809 19:14:07.885838 6900 tablet_service.cc:1467] Processing CreateTablet for tablet 9712a89ee22f42f6833eebe254788df9 (DEFAULT_TABLE table=test-table [id=7fd349d415054da086e3a4d192e7a85a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:14:07.886480 7036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:07.874404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49522 (local address 127.7.39.1:46617)
0809 19:14:07.878120 (+ 3716us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:07.878128 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:07.878753 (+ 625us) server_negotiation.cc:407] Connection header received
0809 19:14:07.879053 (+ 300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:07.879060 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:07.879290 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:07.879445 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:14:07.880272 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:07.881686 (+ 1414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:07.884011 (+ 2325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:07.885135 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:07.885274 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:07.885490 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:07.885981 (+ 491us) server_negotiation.cc:299] Negotiation successful
0809 19:14:07.886146 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3552,"thread_start_us":3421,"threads_started":1}
I20260809 19:14:07.887267 6900 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9712a89ee22f42f6833eebe254788df9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:07.887151 6677 tablet_service.cc:1467] Processing CreateTablet for tablet 9712a89ee22f42f6833eebe254788df9 (DEFAULT_TABLE table=test-table [id=7fd349d415054da086e3a4d192e7a85a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:14:07.888234 6677 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9712a89ee22f42f6833eebe254788df9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:07.897141 6486 tablet_service.cc:1467] Processing CreateTablet for tablet 9712a89ee22f42f6833eebe254788df9 (DEFAULT_TABLE table=test-table [id=7fd349d415054da086e3a4d192e7a85a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:14:07.897868 7037 tablet_bootstrap.cc:492] T 9712a89ee22f42f6833eebe254788df9 P 342ecb6e5bb94884b49e3a474791843a: Bootstrap starting.
I20260809 19:14:07.898643 6486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9712a89ee22f42f6833eebe254788df9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:07.900358 7038 tablet_bootstrap.cc:492] T 9712a89ee22f42f6833eebe254788df9 P 8ac092e3951444ae84d8590e1457670b: Bootstrap starting.
I20260809 19:14:07.901742 7037 tablet_bootstrap.cc:654] T 9712a89ee22f42f6833eebe254788df9 P 342ecb6e5bb94884b49e3a474791843a: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:07.903169 7037 log.cc:824] T 9712a89ee22f42f6833eebe254788df9 P 342ecb6e5bb94884b49e3a474791843a: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:07.903918 7038 tablet_bootstrap.cc:654] T 9712a89ee22f42f6833eebe254788df9 P 8ac092e3951444ae84d8590e1457670b: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:07.904955 7038 log.cc:824] T 9712a89ee22f42f6833eebe254788df9 P 8ac092e3951444ae84d8590e1457670b: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:07.906163 7037 tablet_bootstrap.cc:492] T 9712a89ee22f42f6833eebe254788df9 P 342ecb6e5bb94884b49e3a474791843a: No bootstrap required, opened a new log
I20260809 19:14:07.906455 7037 ts_tablet_manager.cc:1397] T 9712a89ee22f42f6833eebe254788df9 P 342ecb6e5bb94884b49e3a474791843a: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20260809 19:14:07.908018 7038 tablet_bootstrap.cc:492] T 9712a89ee22f42f6833eebe254788df9 P 8ac092e3951444ae84d8590e1457670b: No bootstrap required, opened a new log
I20260809 19:14:07.908277 7038 ts_tablet_manager.cc:1397] T 9712a89ee22f42f6833eebe254788df9 P 8ac092e3951444ae84d8590e1457670b: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260809 19:14:07.910336 7049 tablet_bootstrap.cc:492] T 9712a89ee22f42f6833eebe254788df9 P 95203043a92d428199c84ba91846f3d2: Bootstrap starting.
I20260809 19:14:07.912971 7049 tablet_bootstrap.cc:654] T 9712a89ee22f42f6833eebe254788df9 P 95203043a92d428199c84ba91846f3d2: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:07.913858 7049 log.cc:824] T 9712a89ee22f42f6833eebe254788df9 P 95203043a92d428199c84ba91846f3d2: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:07.916427 7049 tablet_bootstrap.cc:492] T 9712a89ee22f42f6833eebe254788df9 P 95203043a92d428199c84ba91846f3d2: No bootstrap required, opened a new log
I20260809 19:14:07.916662 7049 ts_tablet_manager.cc:1397] T 9712a89ee22f42f6833eebe254788df9 P 95203043a92d428199c84ba91846f3d2: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260809 19:14:07.916492 7037 raft_consensus.cc:348] T 9712a89ee22f42f6833eebe254788df9 P 342ecb6e5bb94884b49e3a474791843a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "342ecb6e5bb94884b49e3a474791843a" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 38255 } } peers { permanent_uuid: "8ac092e3951444ae84d8590e1457670b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 45727 } } peers { permanent_uuid: "95203043a92d428199c84ba91846f3d2" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 46617 } }
I20260809 19:14:07.916908 7037 raft_consensus.cc:374] T 9712a89ee22f42f6833eebe254788df9 P 342ecb6e5bb94884b49e3a474791843a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:14:07.917011 7037 raft_consensus.cc:729] T 9712a89ee22f42f6833eebe254788df9 P 342ecb6e5bb94884b49e3a474791843a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 342ecb6e5bb94884b49e3a474791843a, State: Initialized, Role: FOLLOWER
I20260809 19:14:07.917587 7037 consensus_queue.cc:260] T 9712a89ee22f42f6833eebe254788df9 P 342ecb6e5bb94884b49e3a474791843a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "342ecb6e5bb94884b49e3a474791843a" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 38255 } } peers { permanent_uuid: "8ac092e3951444ae84d8590e1457670b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 45727 } } peers { permanent_uuid: "95203043a92d428199c84ba91846f3d2" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 46617 } }
I20260809 19:14:07.918092 7038 raft_consensus.cc:348] T 9712a89ee22f42f6833eebe254788df9 P 8ac092e3951444ae84d8590e1457670b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "342ecb6e5bb94884b49e3a474791843a" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 38255 } } peers { permanent_uuid: "8ac092e3951444ae84d8590e1457670b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 45727 } } peers { permanent_uuid: "95203043a92d428199c84ba91846f3d2" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 46617 } }
I20260809 19:14:07.918586 7038 raft_consensus.cc:374] T 9712a89ee22f42f6833eebe254788df9 P 8ac092e3951444ae84d8590e1457670b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:14:07.918725 7008 heartbeater.cc:503] Master 127.7.39.62:37849 was elected leader, sending a full tablet report...
I20260809 19:14:07.918728 7038 raft_consensus.cc:729] T 9712a89ee22f42f6833eebe254788df9 P 8ac092e3951444ae84d8590e1457670b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ac092e3951444ae84d8590e1457670b, State: Initialized, Role: FOLLOWER
I20260809 19:14:07.919380 7037 ts_tablet_manager.cc:1428] T 9712a89ee22f42f6833eebe254788df9 P 342ecb6e5bb94884b49e3a474791843a: Time spent starting tablet: real 0.013s user 0.011s sys 0.001s
I20260809 19:14:07.919412 7038 consensus_queue.cc:260] T 9712a89ee22f42f6833eebe254788df9 P 8ac092e3951444ae84d8590e1457670b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "342ecb6e5bb94884b49e3a474791843a" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 38255 } } peers { permanent_uuid: "8ac092e3951444ae84d8590e1457670b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 45727 } } peers { permanent_uuid: "95203043a92d428199c84ba91846f3d2" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 46617 } }
I20260809 19:14:07.920687 6784 heartbeater.cc:503] Master 127.7.39.62:37849 was elected leader, sending a full tablet report...
I20260809 19:14:07.921304 7038 ts_tablet_manager.cc:1428] T 9712a89ee22f42f6833eebe254788df9 P 8ac092e3951444ae84d8590e1457670b: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
I20260809 19:14:07.925716 7049 raft_consensus.cc:348] T 9712a89ee22f42f6833eebe254788df9 P 95203043a92d428199c84ba91846f3d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "342ecb6e5bb94884b49e3a474791843a" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 38255 } } peers { permanent_uuid: "8ac092e3951444ae84d8590e1457670b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 45727 } } peers { permanent_uuid: "95203043a92d428199c84ba91846f3d2" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 46617 } }
I20260809 19:14:07.926083 7049 raft_consensus.cc:374] T 9712a89ee22f42f6833eebe254788df9 P 95203043a92d428199c84ba91846f3d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:14:07.926182 7049 raft_consensus.cc:729] T 9712a89ee22f42f6833eebe254788df9 P 95203043a92d428199c84ba91846f3d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95203043a92d428199c84ba91846f3d2, State: Initialized, Role: FOLLOWER
I20260809 19:14:07.926760 7049 consensus_queue.cc:260] T 9712a89ee22f42f6833eebe254788df9 P 95203043a92d428199c84ba91846f3d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "342ecb6e5bb94884b49e3a474791843a" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 38255 } } peers { permanent_uuid: "8ac092e3951444ae84d8590e1457670b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 45727 } } peers { permanent_uuid: "95203043a92d428199c84ba91846f3d2" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 46617 } }
I20260809 19:14:07.928196 7049 ts_tablet_manager.cc:1428] T 9712a89ee22f42f6833eebe254788df9 P 95203043a92d428199c84ba91846f3d2: Time spent starting tablet: real 0.011s user 0.010s sys 0.002s
W20260809 19:14:08.058481 7009 tablet.cc:2369] T 9712a89ee22f42f6833eebe254788df9 P 342ecb6e5bb94884b49e3a474791843a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 19:14:08.069128 6581 tablet.cc:2369] T 9712a89ee22f42f6833eebe254788df9 P 95203043a92d428199c84ba91846f3d2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 19:14:08.076812 6787 tablet.cc:2369] T 9712a89ee22f42f6833eebe254788df9 P 8ac092e3951444ae84d8590e1457670b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:14:08.126583 7054 raft_consensus.cc:482] T 9712a89ee22f42f6833eebe254788df9 P 342ecb6e5bb94884b49e3a474791843a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:14:08.126888 7054 raft_consensus.cc:504] T 9712a89ee22f42f6833eebe254788df9 P 342ecb6e5bb94884b49e3a474791843a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "342ecb6e5bb94884b49e3a474791843a" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 38255 } } peers { permanent_uuid: "8ac092e3951444ae84d8590e1457670b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 45727 } } peers { permanent_uuid: "95203043a92d428199c84ba91846f3d2" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 46617 } }
I20260809 19:14:08.128664 7054 leader_election.cc:288] T 9712a89ee22f42f6833eebe254788df9 P 342ecb6e5bb94884b49e3a474791843a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ac092e3951444ae84d8590e1457670b (127.7.39.2:45727), 95203043a92d428199c84ba91846f3d2 (127.7.39.1:46617)
I20260809 19:14:08.135116 7034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:08.129113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:46645 (local address 127.7.39.2:45727)
0809 19:14:08.129441 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:08.129448 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:08.129471 (+ 23us) server_negotiation.cc:407] Connection header received
0809 19:14:08.129687 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:08.129694 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:08.129776 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:08.129854 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:14:08.130448 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:08.131322 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:08.133351 (+ 2029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:08.134152 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:08.134277 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:08.134417 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:08.134749 (+ 332us) server_negotiation.cc:299] Negotiation successful
0809 19:14:08.134872 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164}
I20260809 19:14:08.135136 7010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:08.128876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:45727 (local address 127.7.39.3:46645)
0809 19:14:08.129351 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:08.129372 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:08.129495 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:08.130030 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:08.130035 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:08.130059 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:14:08.130282 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:08.130320 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:08.131446 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:08.131452 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:08.133209 (+ 1757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:08.133222 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:08.134323 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:08.134330 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:08.134597 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:08.134626 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 19:14:08.134709 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 19:14:08.134837 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"mutex_wait_us":63}
I20260809 19:14:08.136222 6709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9712a89ee22f42f6833eebe254788df9" candidate_uuid: "342ecb6e5bb94884b49e3a474791843a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ac092e3951444ae84d8590e1457670b" is_pre_election: true
I20260809 19:14:08.136732 6709 raft_consensus.cc:2454] T 9712a89ee22f42f6833eebe254788df9 P 8ac092e3951444ae84d8590e1457670b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 342ecb6e5bb94884b49e3a474791843a in term 0.
I20260809 19:14:08.137425 6829 leader_election.cc:302] T 9712a89ee22f42f6833eebe254788df9 P 342ecb6e5bb94884b49e3a474791843a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342ecb6e5bb94884b49e3a474791843a, 8ac092e3951444ae84d8590e1457670b; no voters:
I20260809 19:14:08.137688 7036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:08.129649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:38909 (local address 127.7.39.1:46617)
0809 19:14:08.129844 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:08.129849 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:08.130561 (+ 712us) server_negotiation.cc:407] Connection header received
0809 19:14:08.130718 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:08.130723 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:08.130799 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:08.130893 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:14:08.131598 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:08.132639 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:08.135234 (+ 2595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:08.136470 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:08.136593 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:08.136698 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:08.137318 (+ 620us) server_negotiation.cc:299] Negotiation successful
0809 19:14:08.137457 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 19:14:08.137881 7058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:08.129244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:46617 (local address 127.7.39.3:38909)
0809 19:14:08.130418 (+ 1174us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:08.130447 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:08.130592 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:08.130913 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:08.130917 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:08.130940 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:14:08.131340 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:08.131352 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:08.132781 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:08.132787 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:08.135040 (+ 2253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:08.135055 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:08.136921 (+ 1866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:08.136927 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:08.137112 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:08.137146 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 19:14:08.137276 (+ 130us) client_negotiation.cc:240] Negotiation successful
0809 19:14:08.137402 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1022,"mutex_wait_us":56,"thread_start_us":769,"threads_started":1}
I20260809 19:14:08.138134 7054 raft_consensus.cc:2781] T 9712a89ee22f42f6833eebe254788df9 P 342ecb6e5bb94884b49e3a474791843a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:14:08.138353 7054 raft_consensus.cc:482] T 9712a89ee22f42f6833eebe254788df9 P 342ecb6e5bb94884b49e3a474791843a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:14:08.138475 7054 raft_consensus.cc:3037] T 9712a89ee22f42f6833eebe254788df9 P 342ecb6e5bb94884b49e3a474791843a [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:08.138993 6514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9712a89ee22f42f6833eebe254788df9" candidate_uuid: "342ecb6e5bb94884b49e3a474791843a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95203043a92d428199c84ba91846f3d2" is_pre_election: true
I20260809 19:14:08.139516 6514 raft_consensus.cc:2454] T 9712a89ee22f42f6833eebe254788df9 P 95203043a92d428199c84ba91846f3d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 342ecb6e5bb94884b49e3a474791843a in term 0.
I20260809 19:14:08.140841 7054 raft_consensus.cc:504] T 9712a89ee22f42f6833eebe254788df9 P 342ecb6e5bb94884b49e3a474791843a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "342ecb6e5bb94884b49e3a474791843a" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 38255 } } peers { permanent_uuid: "8ac092e3951444ae84d8590e1457670b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 45727 } } peers { permanent_uuid: "95203043a92d428199c84ba91846f3d2" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 46617 } }
I20260809 19:14:08.141330 7054 leader_election.cc:288] T 9712a89ee22f42f6833eebe254788df9 P 342ecb6e5bb94884b49e3a474791843a [CANDIDATE]: Term 1 election: Requested vote from peers 8ac092e3951444ae84d8590e1457670b (127.7.39.2:45727), 95203043a92d428199c84ba91846f3d2 (127.7.39.1:46617)
I20260809 19:14:08.141757 6709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9712a89ee22f42f6833eebe254788df9" candidate_uuid: "342ecb6e5bb94884b49e3a474791843a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ac092e3951444ae84d8590e1457670b"
I20260809 19:14:08.141842 6514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9712a89ee22f42f6833eebe254788df9" candidate_uuid: "342ecb6e5bb94884b49e3a474791843a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95203043a92d428199c84ba91846f3d2"
I20260809 19:14:08.141963 6709 raft_consensus.cc:3037] T 9712a89ee22f42f6833eebe254788df9 P 8ac092e3951444ae84d8590e1457670b [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:08.142019 6514 raft_consensus.cc:3037] T 9712a89ee22f42f6833eebe254788df9 P 95203043a92d428199c84ba91846f3d2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:08.145080 6709 raft_consensus.cc:2454] T 9712a89ee22f42f6833eebe254788df9 P 8ac092e3951444ae84d8590e1457670b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342ecb6e5bb94884b49e3a474791843a in term 1.
I20260809 19:14:08.145200 6514 raft_consensus.cc:2454] T 9712a89ee22f42f6833eebe254788df9 P 95203043a92d428199c84ba91846f3d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342ecb6e5bb94884b49e3a474791843a in term 1.
I20260809 19:14:08.145526 6829 leader_election.cc:302] T 9712a89ee22f42f6833eebe254788df9 P 342ecb6e5bb94884b49e3a474791843a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342ecb6e5bb94884b49e3a474791843a, 8ac092e3951444ae84d8590e1457670b; no voters:
I20260809 19:14:08.145797 7054 raft_consensus.cc:2781] T 9712a89ee22f42f6833eebe254788df9 P 342ecb6e5bb94884b49e3a474791843a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:14:08.146268 7054 raft_consensus.cc:686] T 9712a89ee22f42f6833eebe254788df9 P 342ecb6e5bb94884b49e3a474791843a [term 1 LEADER]: Becoming Leader. State: Replica: 342ecb6e5bb94884b49e3a474791843a, State: Running, Role: LEADER
I20260809 19:14:08.146745 7054 consensus_queue.cc:237] T 9712a89ee22f42f6833eebe254788df9 P 342ecb6e5bb94884b49e3a474791843a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "342ecb6e5bb94884b49e3a474791843a" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 38255 } } peers { permanent_uuid: "8ac092e3951444ae84d8590e1457670b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 45727 } } peers { permanent_uuid: "95203043a92d428199c84ba91846f3d2" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 46617 } }
I20260809 19:14:08.151278 6279 catalog_manager.cc:5495] T 9712a89ee22f42f6833eebe254788df9 P 342ecb6e5bb94884b49e3a474791843a reported cstate change: term changed from 0 to 1, leader changed from <none> to 342ecb6e5bb94884b49e3a474791843a (127.7.39.3). New cstate: current_term: 1 leader_uuid: "342ecb6e5bb94884b49e3a474791843a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "342ecb6e5bb94884b49e3a474791843a" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 38255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ac092e3951444ae84d8590e1457670b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 45727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95203043a92d428199c84ba91846f3d2" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 46617 } health_report { overall_health: UNKNOWN } } }
I20260809 19:14:08.177330 7031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:08.172541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59832 (local address 127.7.39.3:38255)
0809 19:14:08.172726 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:08.172732 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:08.172750 (+ 18us) server_negotiation.cc:407] Connection header received
0809 19:14:08.172833 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:08.172836 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:08.172924 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:08.173060 (+ 136us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:14:08.173401 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:08.174137 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:08.175521 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:08.175891 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:08.175982 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:08.176365 (+ 383us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:14:08.176873 (+ 508us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:14:08.176969 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:08.177084 (+ 115us) server_negotiation.cc:299] Negotiation successful
0809 19:14:08.177146 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 19:14:08.184937 6514 raft_consensus.cc:1261] T 9712a89ee22f42f6833eebe254788df9 P 95203043a92d428199c84ba91846f3d2 [term 1 FOLLOWER]: Refusing update from remote peer 342ecb6e5bb94884b49e3a474791843a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:14:08.184939 6709 raft_consensus.cc:1261] T 9712a89ee22f42f6833eebe254788df9 P 8ac092e3951444ae84d8590e1457670b [term 1 FOLLOWER]: Refusing update from remote peer 342ecb6e5bb94884b49e3a474791843a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:14:08.185802 7059 consensus_queue.cc:1035] T 9712a89ee22f42f6833eebe254788df9 P 342ecb6e5bb94884b49e3a474791843a [LEADER]: Connected to new peer: Peer: permanent_uuid: "95203043a92d428199c84ba91846f3d2" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 46617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:14:08.186129 7054 consensus_queue.cc:1035] T 9712a89ee22f42f6833eebe254788df9 P 342ecb6e5bb94884b49e3a474791843a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ac092e3951444ae84d8590e1457670b" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 45727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:14:08.198441 7068 mvcc.cc:205] Tried to move back new op lower bound from 7316696466156003328 to 7316696466012631040. Current Snapshot: MvccSnapshot[applied={T|T < 7316696466156003328}]
I20260809 19:14:08.201282 7067 mvcc.cc:205] Tried to move back new op lower bound from 7316696466156003328 to 7316696466012631040. Current Snapshot: MvccSnapshot[applied={T|T < 7316696466156003328}]
I20260809 19:14:08.207230 6279 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56130:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:14:08.207444 6279 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56130:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:14:08.210805 6279 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f46fe6efb43e411c8d511be9b7ebf364: Sending DeleteTablet for 3 replicas of tablet 9712a89ee22f42f6833eebe254788df9
I20260809 19:14:08.211814 6900 tablet_service.cc:1514] Processing DeleteTablet for tablet 9712a89ee22f42f6833eebe254788df9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:14:08 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:59828
I20260809 19:14:08.211978 6677 tablet_service.cc:1514] Processing DeleteTablet for tablet 9712a89ee22f42f6833eebe254788df9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:14:08 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:58728
I20260809 19:14:08.212486 6486 tablet_service.cc:1514] Processing DeleteTablet for tablet 9712a89ee22f42f6833eebe254788df9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:14:08 UTC) from {username='kudu', principal='kudu/127.7.39.62@KRBTEST.COM'} at 127.0.0.1:49522
I20260809 19:14:08.212764 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 6389
I20260809 19:14:08.213310 7085 tablet_replica.cc:330] T 9712a89ee22f42f6833eebe254788df9 P 95203043a92d428199c84ba91846f3d2: stopping tablet replica
I20260809 19:14:08.213768 7085 raft_consensus.cc:2229] T 9712a89ee22f42f6833eebe254788df9 P 95203043a92d428199c84ba91846f3d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:14:08.214399 7085 raft_consensus.cc:2258] T 9712a89ee22f42f6833eebe254788df9 P 95203043a92d428199c84ba91846f3d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:14:08.218431 7085 ts_tablet_manager.cc:1905] T 9712a89ee22f42f6833eebe254788df9 P 95203043a92d428199c84ba91846f3d2: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 09 19:14:08 dist-test-slave-4tdj krb5kdc[6207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302845, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.1@KRBTEST.COM
I20260809 19:14:08.233204 7080 tablet_replica.cc:330] T 9712a89ee22f42f6833eebe254788df9 P 342ecb6e5bb94884b49e3a474791843a: stopping tablet replica
I20260809 19:14:08.233793 7083 tablet_replica.cc:330] T 9712a89ee22f42f6833eebe254788df9 P 8ac092e3951444ae84d8590e1457670b: stopping tablet replica
I20260809 19:14:08.234241 7083 raft_consensus.cc:2229] T 9712a89ee22f42f6833eebe254788df9 P 8ac092e3951444ae84d8590e1457670b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:14:08.234853 7085 ts_tablet_manager.cc:1918] T 9712a89ee22f42f6833eebe254788df9 P 95203043a92d428199c84ba91846f3d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:14:08.235042 7085 log.cc:1196] T 9712a89ee22f42f6833eebe254788df9 P 95203043a92d428199c84ba91846f3d2: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-0/wal/wals/9712a89ee22f42f6833eebe254788df9
I20260809 19:14:08.235639 7085 ts_tablet_manager.cc:1939] T 9712a89ee22f42f6833eebe254788df9 P 95203043a92d428199c84ba91846f3d2: Deleting consensus metadata
I20260809 19:14:08.237514 6260 catalog_manager.cc:4841] TS 95203043a92d428199c84ba91846f3d2 (127.7.39.1:46617): tablet 9712a89ee22f42f6833eebe254788df9 (table test-table [id=7fd349d415054da086e3a4d192e7a85a]) successfully deleted
I20260809 19:14:08.237782 7080 raft_consensus.cc:2229] T 9712a89ee22f42f6833eebe254788df9 P 342ecb6e5bb94884b49e3a474791843a [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:14:08.238524 7080 raft_consensus.cc:2258] T 9712a89ee22f42f6833eebe254788df9 P 342ecb6e5bb94884b49e3a474791843a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:14:08.239099 7083 raft_consensus.cc:2258] T 9712a89ee22f42f6833eebe254788df9 P 8ac092e3951444ae84d8590e1457670b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:14:08.240403 7036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:08.214189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49534 (local address 127.7.39.1:46617)
0809 19:14:08.214389 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:08.214396 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:08.215487 (+ 1091us) server_negotiation.cc:407] Connection header received
0809 19:14:08.215641 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:08.215646 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:08.215714 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:08.215790 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:08.216993 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:08.217866 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:08.219221 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:08.219665 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:08.219775 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:08.224289 (+ 4514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:08.224305 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:08.224322 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:08.224370 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:08.236647 (+ 12277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:08.237909 (+ 1262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:08.237918 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:08.237922 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:08.238088 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:08.238559 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:08.238564 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:08.238568 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:08.239006 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:08.239264 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:08.239805 (+ 541us) server_negotiation.cc:299] Negotiation successful
0809 19:14:08.240038 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 19:14:08.241557 7083 ts_tablet_manager.cc:1905] T 9712a89ee22f42f6833eebe254788df9 P 8ac092e3951444ae84d8590e1457670b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:14:08.241667 6574 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:14:08.248427 7083 ts_tablet_manager.cc:1918] T 9712a89ee22f42f6833eebe254788df9 P 8ac092e3951444ae84d8590e1457670b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:14:08.248662 7083 log.cc:1196] T 9712a89ee22f42f6833eebe254788df9 P 8ac092e3951444ae84d8590e1457670b: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-1/wal/wals/9712a89ee22f42f6833eebe254788df9
I20260809 19:14:08.249255 7083 ts_tablet_manager.cc:1939] T 9712a89ee22f42f6833eebe254788df9 P 8ac092e3951444ae84d8590e1457670b: Deleting consensus metadata
I20260809 19:14:08.251005 6260 catalog_manager.cc:4841] TS 8ac092e3951444ae84d8590e1457670b (127.7.39.2:45727): tablet 9712a89ee22f42f6833eebe254788df9 (table test-table [id=7fd349d415054da086e3a4d192e7a85a]) successfully deleted
I20260809 19:14:08.251904 7080 ts_tablet_manager.cc:1905] T 9712a89ee22f42f6833eebe254788df9 P 342ecb6e5bb94884b49e3a474791843a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:14:08.258116 7080 ts_tablet_manager.cc:1918] T 9712a89ee22f42f6833eebe254788df9 P 342ecb6e5bb94884b49e3a474791843a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:14:08.258338 7080 log.cc:1196] T 9712a89ee22f42f6833eebe254788df9 P 342ecb6e5bb94884b49e3a474791843a: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786302538618573-7324-0/minicluster-data/ts-2/wal/wals/9712a89ee22f42f6833eebe254788df9
I20260809 19:14:08.258843 7080 ts_tablet_manager.cc:1939] T 9712a89ee22f42f6833eebe254788df9 P 342ecb6e5bb94884b49e3a474791843a: Deleting consensus metadata
I20260809 19:14:08.260568 6260 catalog_manager.cc:4841] TS 342ecb6e5bb94884b49e3a474791843a (127.7.39.3:38255): tablet 9712a89ee22f42f6833eebe254788df9 (table test-table [id=7fd349d415054da086e3a4d192e7a85a]) successfully deleted
I20260809 19:14:08.341507 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 6389
I20260809 19:14:08.361878 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 6592
Aug 09 19:14:08 dist-test-slave-4tdj krb5kdc[6207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302845, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.2@KRBTEST.COM
I20260809 19:14:08.377048 7034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:08.362677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58736 (local address 127.7.39.2:45727)
0809 19:14:08.362892 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:08.362897 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:08.362918 (+ 21us) server_negotiation.cc:407] Connection header received
0809 19:14:08.363031 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:08.363036 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:08.363135 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:08.363237 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:08.364494 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:08.365235 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:08.366624 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:08.366999 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:08.367117 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:08.371354 (+ 4237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:08.371365 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:08.371382 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:08.371426 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:08.374166 (+ 2740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:08.374854 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:08.374861 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:08.374864 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:08.374983 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:08.375347 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:08.375351 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:08.375353 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:08.375724 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:08.375989 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:08.376435 (+ 446us) server_negotiation.cc:299] Negotiation successful
0809 19:14:08.376657 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260809 19:14:08.377820 6776 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:14:08.463493 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 6592
I20260809 19:14:08.487069 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 6794
Aug 09 19:14:08 dist-test-slave-4tdj krb5kdc[6207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302845, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.3@KRBTEST.COM
I20260809 19:14:08.502542 7031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:08.488008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59838 (local address 127.7.39.3:38255)
0809 19:14:08.488219 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:08.488225 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:08.488242 (+ 17us) server_negotiation.cc:407] Connection header received
0809 19:14:08.488294 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:08.488301 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:08.488370 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:08.488460 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:08.489716 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:08.490573 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:08.491837 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:08.492323 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:08.492434 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:08.496897 (+ 4463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:08.496911 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:08.496925 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:08.496965 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:08.499796 (+ 2831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:08.500437 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:08.500444 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:08.500447 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:08.500608 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:08.500974 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:08.500981 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:08.500983 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:08.501357 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:08.501676 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:08.501940 (+ 264us) server_negotiation.cc:299] Negotiation successful
0809 19:14:08.502171 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 19:14:08.503320 7001 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:14:08.620426 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 6794
I20260809 19:14:08.643357 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 6232
I20260809 19:14:08.644423 6330 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:14:08.752472 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 6232
2026-08-09T19:14:08Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (4408 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-09T19:14:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:14:08Z Disabled control of system clock
I20260809 19:14:08.835906 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:42347
--webserver_interface=127.7.39.62
--webserver_port=0
--builtin_ntp_servers=127.7.39.20:35373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:42347
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 19:14:09.156342 7097 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:09.156598 7097 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:09.156692 7097 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:09.163504 7097 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:14:09.163595 7097 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:09.163640 7097 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:09.163697 7097 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:14:09.163739 7097 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:14:09.172312 7097 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:35373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:42347
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:42347
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:09.173422 7097 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:09.175164 7097 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:09.185999 7112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:09.185978 7113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:09.186309 7115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:09.186676 7097 server_base.cc:1034] running on GCE node
I20260809 19:14:09.187412 7097 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:09.188678 7097 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:09.189870 7097 hybrid_clock.cc:648] HybridClock initialized: now 1786302849189818 us; error 41 us; skew 500 ppm
I20260809 19:14:09.190168 7097 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:14:09.192243 7097 webserver.cc:460] Webserver started at http://127.7.39.62:37221/ using document root <none> and password file <none>
I20260809 19:14:09.192862 7097 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:09.192960 7097 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:09.193284 7097 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:09.196084 7097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "0e38cd7b22884d5788ca0238879b69f7"
format_stamp: "Formatted at 2026-08-09 19:14:09 on dist-test-slave-4tdj"
server_key: "e10526dfe16de19c6bcbc66153c355a5"
server_key_iv: "9149e8689a2a2f7163009f4e03ed5ba8"
server_key_version: "encryptionkey@0"
I20260809 19:14:09.196834 7097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "0e38cd7b22884d5788ca0238879b69f7"
format_stamp: "Formatted at 2026-08-09 19:14:09 on dist-test-slave-4tdj"
server_key: "e10526dfe16de19c6bcbc66153c355a5"
server_key_iv: "9149e8689a2a2f7163009f4e03ed5ba8"
server_key_version: "encryptionkey@0"
I20260809 19:14:09.202076 7097 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 19:14:09.206113 7122 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:09.207698 7097 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:14:09.207888 7097 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "0e38cd7b22884d5788ca0238879b69f7"
format_stamp: "Formatted at 2026-08-09 19:14:09 on dist-test-slave-4tdj"
server_key: "e10526dfe16de19c6bcbc66153c355a5"
server_key_iv: "9149e8689a2a2f7163009f4e03ed5ba8"
server_key_version: "encryptionkey@0"
I20260809 19:14:09.208101 7097 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:09.223250 7097 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:09.223946 7097 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:09.224180 7097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:09.240267 7097 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:42347
I20260809 19:14:09.240288 7196 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:42347 every 8 connection(s)
I20260809 19:14:09.241513 7097 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:14:09.244997 7204 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:09.245822 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 7097
I20260809 19:14:09.246003 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:14:09.246629 7324 external_mini_cluster.cc:1428] Setting key cb2f0cf5cb47cbb641e1ec4b79e97f8f
I20260809 19:14:09.258204 7204 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e38cd7b22884d5788ca0238879b69f7: Bootstrap starting.
I20260809 19:14:09.259639 7209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:09.248483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36696 (local address 127.7.39.62:42347)
0809 19:14:09.249455 (+ 972us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:09.249465 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:09.249509 (+ 44us) server_negotiation.cc:407] Connection header received
0809 19:14:09.251186 (+ 1677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:09.251206 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:09.251633 (+ 427us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:09.251943 (+ 310us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:09.252491 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:09.253677 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:09.255551 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:09.256241 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:09.256361 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:09.257507 (+ 1146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:09.257515 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:09.257528 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:09.258019 (+ 491us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:09.258103 (+ 84us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:09.258124 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:09.258209 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:09.258454 (+ 245us) server_negotiation.cc:299] Negotiation successful
0809 19:14:09.258734 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":566,"thread_start_us":347,"threads_started":1}
I20260809 19:14:09.261336 7204 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0e38cd7b22884d5788ca0238879b69f7: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:09.262312 7204 log.cc:824] T 00000000000000000000000000000000 P 0e38cd7b22884d5788ca0238879b69f7: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:09.264663 7204 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e38cd7b22884d5788ca0238879b69f7: No bootstrap required, opened a new log
I20260809 19:14:09.271373 7204 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0e38cd7b22884d5788ca0238879b69f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e38cd7b22884d5788ca0238879b69f7" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 42347 } }
I20260809 19:14:09.271679 7204 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0e38cd7b22884d5788ca0238879b69f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:14:09.271782 7204 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0e38cd7b22884d5788ca0238879b69f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e38cd7b22884d5788ca0238879b69f7, State: Initialized, Role: FOLLOWER
I20260809 19:14:09.272324 7204 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0e38cd7b22884d5788ca0238879b69f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e38cd7b22884d5788ca0238879b69f7" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 42347 } }
I20260809 19:14:09.272533 7204 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0e38cd7b22884d5788ca0238879b69f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:14:09.272658 7204 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0e38cd7b22884d5788ca0238879b69f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:14:09.272805 7204 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0e38cd7b22884d5788ca0238879b69f7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:09.274818 7204 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0e38cd7b22884d5788ca0238879b69f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e38cd7b22884d5788ca0238879b69f7" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 42347 } }
I20260809 19:14:09.275264 7204 leader_election.cc:302] T 00000000000000000000000000000000 P 0e38cd7b22884d5788ca0238879b69f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0e38cd7b22884d5788ca0238879b69f7; no voters:
I20260809 19:14:09.275763 7204 leader_election.cc:288] T 00000000000000000000000000000000 P 0e38cd7b22884d5788ca0238879b69f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:14:09.275866 7211 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0e38cd7b22884d5788ca0238879b69f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:14:09.276525 7211 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0e38cd7b22884d5788ca0238879b69f7 [term 1 LEADER]: Becoming Leader. State: Replica: 0e38cd7b22884d5788ca0238879b69f7, State: Running, Role: LEADER
I20260809 19:14:09.277041 7211 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0e38cd7b22884d5788ca0238879b69f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e38cd7b22884d5788ca0238879b69f7" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 42347 } }
I20260809 19:14:09.277559 7204 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0e38cd7b22884d5788ca0238879b69f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:14:09.279489 7214 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e38cd7b22884d5788ca0238879b69f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e38cd7b22884d5788ca0238879b69f7. Latest consensus state: current_term: 1 leader_uuid: "0e38cd7b22884d5788ca0238879b69f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e38cd7b22884d5788ca0238879b69f7" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 42347 } } }
I20260809 19:14:09.279512 7213 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e38cd7b22884d5788ca0238879b69f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0e38cd7b22884d5788ca0238879b69f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e38cd7b22884d5788ca0238879b69f7" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 42347 } } }
I20260809 19:14:09.279924 7213 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e38cd7b22884d5788ca0238879b69f7 [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:09.280611 7214 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e38cd7b22884d5788ca0238879b69f7 [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:09.283599 7220 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:14:09.287688 7220 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:14:09.295722 7220 catalog_manager.cc:1347] Generated new cluster ID: a190bf0a797d490fb55bb2ccceb1e01d
I20260809 19:14:09.295817 7220 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:14:09.309916 7220 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:14:09.311648 7220 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:14:09.323117 7220 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0e38cd7b22884d5788ca0238879b69f7: Generated new TSK 0
I20260809 19:14:09.323873 7220 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:14:09.329139 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.1:0
--local_ip_for_outbound_sockets=127.7.39.1
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:42347
--builtin_ntp_servers=127.7.39.20:35373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 19:14:09.652782 7243 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:09.653033 7243 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:09.653162 7243 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:09.660106 7243 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:09.660193 7243 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:09.660343 7243 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.1
I20260809 19:14:09.668834 7243 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:35373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.39.1
--webserver_port=0
--tserver_master_addrs=127.7.39.62:42347
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.1
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:09.669938 7243 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:09.671631 7243 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:09.683621 7251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:09.683661 7257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:09.683698 7252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:09.684588 7243 server_base.cc:1034] running on GCE node
I20260809 19:14:09.685105 7243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:09.685884 7243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:09.687081 7243 hybrid_clock.cc:648] HybridClock initialized: now 1786302849687037 us; error 32 us; skew 500 ppm
I20260809 19:14:09.687361 7243 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:14:09.689296 7243 webserver.cc:460] Webserver started at http://127.7.39.1:46537/ using document root <none> and password file <none>
I20260809 19:14:09.689890 7243 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:09.689982 7243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:09.690268 7243 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:09.692868 7243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-0/data/instance:
uuid: "2e91c181030b4aef90b034cd1ced5bb6"
format_stamp: "Formatted at 2026-08-09 19:14:09 on dist-test-slave-4tdj"
server_key: "24373bd5d009c260ab18889ed7b8d00a"
server_key_iv: "05f5f4876699c027e463307ec892b7ce"
server_key_version: "encryptionkey@0"
I20260809 19:14:09.693624 7243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance:
uuid: "2e91c181030b4aef90b034cd1ced5bb6"
format_stamp: "Formatted at 2026-08-09 19:14:09 on dist-test-slave-4tdj"
server_key: "24373bd5d009c260ab18889ed7b8d00a"
server_key_iv: "05f5f4876699c027e463307ec892b7ce"
server_key_version: "encryptionkey@0"
I20260809 19:14:09.698338 7243 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.001s
I20260809 19:14:09.701517 7270 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:09.702847 7243 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:14:09.702988 7243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-0/wal
uuid: "2e91c181030b4aef90b034cd1ced5bb6"
format_stamp: "Formatted at 2026-08-09 19:14:09 on dist-test-slave-4tdj"
server_key: "24373bd5d009c260ab18889ed7b8d00a"
server_key_iv: "05f5f4876699c027e463307ec892b7ce"
server_key_version: "encryptionkey@0"
I20260809 19:14:09.703176 7243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:09.731268 7243 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:09.731976 7243 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:09.732215 7243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:09.733081 7243 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:14:09.734467 7243 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:14:09.734558 7243 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:09.734665 7243 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:14:09.734740 7243 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:09.764122 7243 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.1:41265
I20260809 19:14:09.764184 7474 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.1:41265 every 8 connection(s)
I20260809 19:14:09.765321 7243 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-0/data/info.pb
I20260809 19:14:09.775134 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 7243
I20260809 19:14:09.775282 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-0/wal/instance
I20260809 19:14:09.775759 7324 external_mini_cluster.cc:1428] Setting key 0e1d11fffa23e84a8132a2b4fd92fa20
I20260809 19:14:09.776988 7479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:09.767639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.1:54071 (local address 127.7.39.62:42347)
0809 19:14:09.768048 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:09.768053 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:09.769178 (+ 1125us) server_negotiation.cc:407] Connection header received
0809 19:14:09.770945 (+ 1767us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:09.770950 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:09.771031 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:09.771129 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:09.772155 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:09.772881 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:09.774353 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:09.774776 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:09.774887 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:09.776197 (+ 1310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:09.776203 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:09.776206 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:09.776223 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:09.776262 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:09.776274 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:09.776347 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:09.776591 (+ 244us) server_negotiation.cc:299] Negotiation successful
0809 19:14:09.776670 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":213,"threads_started":1}
I20260809 19:14:09.777879 7480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:09.768193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42347 (local address 127.7.39.1:54071)
0809 19:14:09.769021 (+ 828us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:09.769055 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:09.770687 (+ 1632us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:09.771360 (+ 673us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:09.771368 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:09.771449 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:14:09.771988 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:09.772004 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:09.773028 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:09.773032 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:09.774204 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:09.774217 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:09.774986 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:09.774993 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:09.775227 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:09.775906 (+ 679us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:14:09.775909 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:14:09.775943 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:14:09.776010 (+ 67us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:14:09.776359 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:14:09.776371 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:14:09.776379 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 19:14:09.776552 (+ 173us) client_negotiation.cc:240] Negotiation successful
0809 19:14:09.776845 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":259,"threads_started":1}
I20260809 19:14:09.778625 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.2:0
--local_ip_for_outbound_sockets=127.7.39.2
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:42347
--builtin_ntp_servers=127.7.39.20:35373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 19:14:09.779436 7476 heartbeater.cc:347] Connected to a master server at 127.7.39.62:42347
I20260809 19:14:09.779690 7476 heartbeater.cc:464] Registering TS with master...
I20260809 19:14:09.780350 7476 heartbeater.cc:511] Master 127.7.39.62:42347 requested a full tablet report, sending...
I20260809 19:14:09.782721 7146 ts_manager.cc:194] Registered new tserver with Master: 2e91c181030b4aef90b034cd1ced5bb6 (127.7.39.1:41265)
I20260809 19:14:09.784497 7146 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.39.1:54071
W20260809 19:14:10.101975 7481 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:10.102226 7481 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:10.102370 7481 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:10.109409 7481 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:10.109501 7481 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:10.109643 7481 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.2
I20260809 19:14:10.118378 7481 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:35373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.39.2
--webserver_port=0
--tserver_master_addrs=127.7.39.62:42347
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.2
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:10.119597 7481 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:10.121304 7481 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:10.133792 7488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:10.133817 7491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:10.133908 7487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:10.134379 7481 server_base.cc:1034] running on GCE node
I20260809 19:14:10.134984 7481 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:10.135838 7481 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:10.137036 7481 hybrid_clock.cc:648] HybridClock initialized: now 1786302850136984 us; error 42 us; skew 500 ppm
I20260809 19:14:10.137323 7481 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:14:10.139366 7481 webserver.cc:460] Webserver started at http://127.7.39.2:46387/ using document root <none> and password file <none>
I20260809 19:14:10.139995 7481 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:10.140097 7481 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:10.140399 7481 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:10.143119 7481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-1/data/instance:
uuid: "d746bc2a376f42d48129663767736e7d"
format_stamp: "Formatted at 2026-08-09 19:14:10 on dist-test-slave-4tdj"
server_key: "6e0040d3757c9eee40fa722296a4fff5"
server_key_iv: "1081bd3e7acbf45fc64d0386409cda58"
server_key_version: "encryptionkey@0"
I20260809 19:14:10.143863 7481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance:
uuid: "d746bc2a376f42d48129663767736e7d"
format_stamp: "Formatted at 2026-08-09 19:14:10 on dist-test-slave-4tdj"
server_key: "6e0040d3757c9eee40fa722296a4fff5"
server_key_iv: "1081bd3e7acbf45fc64d0386409cda58"
server_key_version: "encryptionkey@0"
I20260809 19:14:10.148566 7481 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 19:14:10.151922 7497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:10.153264 7481 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 19:14:10.153421 7481 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-1/wal
uuid: "d746bc2a376f42d48129663767736e7d"
format_stamp: "Formatted at 2026-08-09 19:14:10 on dist-test-slave-4tdj"
server_key: "6e0040d3757c9eee40fa722296a4fff5"
server_key_iv: "1081bd3e7acbf45fc64d0386409cda58"
server_key_version: "encryptionkey@0"
I20260809 19:14:10.153618 7481 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:10.174015 7481 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:10.174777 7481 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:10.175030 7481 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:10.175916 7481 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:14:10.177302 7481 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:14:10.177398 7481 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:10.177496 7481 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:14:10.177572 7481 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:10.207332 7481 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.2:34551
I20260809 19:14:10.207407 7671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.2:34551 every 8 connection(s)
I20260809 19:14:10.208565 7481 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-1/data/info.pb
I20260809 19:14:10.214883 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 7481
I20260809 19:14:10.215065 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-1/wal/instance
I20260809 19:14:10.215490 7324 external_mini_cluster.cc:1428] Setting key 442a6af95f56b4c46ad05808bc8ed5df
I20260809 19:14:10.218402 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.39.3:0
--local_ip_for_outbound_sockets=127.7.39.3
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:42347
--builtin_ntp_servers=127.7.39.20:35373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 19:14:10.221469 7479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:10.210965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.2:50979 (local address 127.7.39.62:42347)
0809 19:14:10.211144 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:10.211149 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:10.212565 (+ 1416us) server_negotiation.cc:407] Connection header received
0809 19:14:10.214428 (+ 1863us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:10.214434 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:10.214518 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:10.214642 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:10.215860 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.216794 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.218954 (+ 2160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.219343 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.219437 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:10.220828 (+ 1391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:10.220833 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:10.220836 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:10.220851 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:10.220883 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:10.220895 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:10.220961 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:10.221173 (+ 212us) server_negotiation.cc:299] Negotiation successful
0809 19:14:10.221244 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 19:14:10.222716 7675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:10.211529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42347 (local address 127.7.39.2:50979)
0809 19:14:10.212400 (+ 871us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:10.212440 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:10.214094 (+ 1654us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:10.214959 (+ 865us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:10.214970 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:10.215094 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:14:10.215705 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:10.215722 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.216943 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.216948 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:10.218821 (+ 1873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:10.218836 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.219555 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.219563 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:10.219838 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:10.220512 (+ 674us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:14:10.220515 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:14:10.220564 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:14:10.220653 (+ 89us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:14:10.220979 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:14:10.220988 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:14:10.220995 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 19:14:10.221169 (+ 174us) client_negotiation.cc:240] Negotiation successful
0809 19:14:10.221522 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":250,"threads_started":1}
I20260809 19:14:10.223943 7673 heartbeater.cc:347] Connected to a master server at 127.7.39.62:42347
I20260809 19:14:10.224221 7673 heartbeater.cc:464] Registering TS with master...
I20260809 19:14:10.224922 7673 heartbeater.cc:511] Master 127.7.39.62:42347 requested a full tablet report, sending...
I20260809 19:14:10.226202 7146 ts_manager.cc:194] Registered new tserver with Master: d746bc2a376f42d48129663767736e7d (127.7.39.2:34551)
I20260809 19:14:10.226989 7146 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.39.2:50979
W20260809 19:14:10.539934 7676 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:10.540196 7676 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:10.540320 7676 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:10.547179 7676 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:10.547276 7676 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:10.547418 7676 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.39.3
I20260809 19:14:10.555925 7676 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:35373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.39.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.39.3
--webserver_port=0
--tserver_master_addrs=127.7.39.62:42347
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.39.3
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:10.557060 7676 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:10.558789 7676 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:10.570719 7689 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:10.570758 7686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:10.570668 7691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:10.571435 7676 server_base.cc:1034] running on GCE node
I20260809 19:14:10.571996 7676 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:10.572834 7676 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:10.574028 7676 hybrid_clock.cc:648] HybridClock initialized: now 1786302850573973 us; error 50 us; skew 500 ppm
I20260809 19:14:10.574338 7676 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:14:10.576329 7676 webserver.cc:460] Webserver started at http://127.7.39.3:44437/ using document root <none> and password file <none>
I20260809 19:14:10.576929 7676 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:10.577028 7676 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:10.577392 7676 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:10.580119 7676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-2/data/instance:
uuid: "af0d88cded154bde97bbd0bb185f3e3f"
format_stamp: "Formatted at 2026-08-09 19:14:10 on dist-test-slave-4tdj"
server_key: "d95a104a94b6dd07c1658b543d662e73"
server_key_iv: "2b16bc7320c0bd300dc03184f053704d"
server_key_version: "encryptionkey@0"
I20260809 19:14:10.580842 7676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance:
uuid: "af0d88cded154bde97bbd0bb185f3e3f"
format_stamp: "Formatted at 2026-08-09 19:14:10 on dist-test-slave-4tdj"
server_key: "d95a104a94b6dd07c1658b543d662e73"
server_key_iv: "2b16bc7320c0bd300dc03184f053704d"
server_key_version: "encryptionkey@0"
I20260809 19:14:10.585547 7676 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260809 19:14:10.588755 7703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:10.589917 7676 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260809 19:14:10.590075 7676 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-2/wal
uuid: "af0d88cded154bde97bbd0bb185f3e3f"
format_stamp: "Formatted at 2026-08-09 19:14:10 on dist-test-slave-4tdj"
server_key: "d95a104a94b6dd07c1658b543d662e73"
server_key_iv: "2b16bc7320c0bd300dc03184f053704d"
server_key_version: "encryptionkey@0"
I20260809 19:14:10.590260 7676 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:10.617074 7676 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:10.617789 7676 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:10.618022 7676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:10.618932 7676 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:14:10.620292 7676 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:14:10.620386 7676 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:10.620492 7676 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:14:10.620571 7676 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:10.649916 7676 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.3:39501
I20260809 19:14:10.649976 7900 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.3:39501 every 8 connection(s)
I20260809 19:14:10.651139 7676 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-2/data/info.pb
I20260809 19:14:10.656041 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 7676
I20260809 19:14:10.656190 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-2/wal/instance
I20260809 19:14:10.656685 7324 external_mini_cluster.cc:1428] Setting key f3703a60be9cf72deb4fa17e174c0459
I20260809 19:14:10.662770 7479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:10.653458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:44509 (local address 127.7.39.62:42347)
0809 19:14:10.653651 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:10.653655 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:10.654928 (+ 1273us) server_negotiation.cc:407] Connection header received
0809 19:14:10.656766 (+ 1838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:10.656772 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:10.656854 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:10.656943 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:10.658057 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.658836 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.660316 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.660723 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.660836 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:10.661974 (+ 1138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:10.661978 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:10.661981 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:10.661997 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:10.662030 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:10.662042 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:10.662114 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:10.662352 (+ 238us) server_negotiation.cc:299] Negotiation successful
0809 19:14:10.662447 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 19:14:10.663642 7904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:10.653928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:42347 (local address 127.7.39.3:44509)
0809 19:14:10.654780 (+ 852us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:10.654820 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:10.656476 (+ 1656us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:10.657198 (+ 722us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:10.657205 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:10.657287 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:14:10.657884 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:10.657906 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.658996 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.659000 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:10.660184 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:10.660195 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.660928 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.660935 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:10.661142 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:10.661698 (+ 556us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:14:10.661701 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:14:10.661739 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:14:10.661804 (+ 65us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:14:10.662128 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:14:10.662139 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:14:10.662146 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 19:14:10.662314 (+ 168us) client_negotiation.cc:240] Negotiation successful
0809 19:14:10.662661 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":283,"threads_started":1}
I20260809 19:14:10.664721 7902 heartbeater.cc:347] Connected to a master server at 127.7.39.62:42347
I20260809 19:14:10.664976 7902 heartbeater.cc:464] Registering TS with master...
I20260809 19:14:10.665671 7902 heartbeater.cc:511] Master 127.7.39.62:42347 requested a full tablet report, sending...
I20260809 19:14:10.666949 7146 ts_manager.cc:194] Registered new tserver with Master: af0d88cded154bde97bbd0bb185f3e3f (127.7.39.3:39501)
I20260809 19:14:10.667696 7146 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.39.3:44509
I20260809 19:14:10.671384 7324 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 19:14:10.680203 7479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:10.675127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36708 (local address 127.7.39.62:42347)
0809 19:14:10.675296 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:10.675300 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:10.675720 (+ 420us) server_negotiation.cc:407] Connection header received
0809 19:14:10.675837 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:10.675841 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:10.675905 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:10.675980 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:10.676421 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.677063 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.678397 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.678767 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.678856 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:10.679661 (+ 805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:10.679665 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:10.679668 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:10.679683 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:10.679711 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:10.679722 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:10.679784 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:10.679905 (+ 121us) server_negotiation.cc:299] Negotiation successful
0809 19:14:10.679970 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 19:14:10.683562 7146 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36708:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:14:10.690083 7146 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:14:10.713117 7925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:10.701393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:41265 (local address 127.0.0.1:34560)
0809 19:14:10.702556 (+ 1163us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:10.702592 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:10.702756 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:10.703742 (+ 986us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:10.703750 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:10.703780 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:14:10.705678 (+ 1898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:10.705693 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.707710 (+ 2017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.707714 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:10.709810 (+ 2096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:10.709822 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.711335 (+ 1513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.711341 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:10.711618 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:10.712450 (+ 832us) client_negotiation.cc:769] Sending connection context
0809 19:14:10.712558 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 19:14:10.712748 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":989,"mutex_wait_us":141,"thread_start_us":845,"threads_started":1}
I20260809 19:14:10.713173 7923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:10.701462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34560 (local address 127.7.39.1:41265)
0809 19:14:10.702136 (+ 674us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:10.702142 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:10.702706 (+ 564us) server_negotiation.cc:407] Connection header received
0809 19:14:10.703007 (+ 301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:10.703017 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:10.703282 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:10.703471 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:14:10.705921 (+ 2450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.707432 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.709994 (+ 2562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.711122 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.711256 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:10.711500 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:10.712692 (+ 1192us) server_negotiation.cc:299] Negotiation successful
0809 19:14:10.712861 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":533,"thread_start_us":440,"threads_started":1}
I20260809 19:14:10.713650 7927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:10.703062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33448 (local address 127.7.39.3:39501)
0809 19:14:10.703604 (+ 542us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:10.703612 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:10.704101 (+ 489us) server_negotiation.cc:407] Connection header received
0809 19:14:10.704199 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:10.704207 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:10.704433 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:10.704633 (+ 200us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:14:10.706154 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.707489 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.710556 (+ 3067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.711759 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.711895 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:10.712159 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:10.713214 (+ 1055us) server_negotiation.cc:299] Negotiation successful
0809 19:14:10.713373 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":256,"threads_started":1}
I20260809 19:14:10.713716 7931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:10.704305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47838 (local address 127.7.39.2:34551)
0809 19:14:10.705354 (+ 1049us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:10.705360 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:10.706027 (+ 667us) server_negotiation.cc:407] Connection header received
0809 19:14:10.706172 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:10.706179 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:10.706417 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:10.706597 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:14:10.707110 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.708503 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.710948 (+ 2445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.712149 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.712246 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:10.712422 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:10.713213 (+ 791us) server_negotiation.cc:299] Negotiation successful
0809 19:14:10.713375 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":915,"thread_start_us":782,"threads_started":1}
I20260809 19:14:10.714200 7926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:10.702841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.3:39501 (local address 127.0.0.1:33448)
0809 19:14:10.703843 (+ 1002us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:10.703862 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:10.703986 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:10.704901 (+ 915us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:10.704906 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:10.704933 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:14:10.705930 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:10.705946 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.707685 (+ 1739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.707690 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:10.710339 (+ 2649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:10.710355 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.711964 (+ 1609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.711971 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:10.712760 (+ 789us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:10.712841 (+ 81us) client_negotiation.cc:769] Sending connection context
0809 19:14:10.712923 (+ 82us) client_negotiation.cc:240] Negotiation successful
0809 19:14:10.713041 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":885,"mutex_wait_us":743,"thread_start_us":758,"threads_started":1}
I20260809 19:14:10.714329 7929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:10.703931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:34551 (local address 127.0.0.1:47838)
0809 19:14:10.705904 (+ 1973us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:10.705924 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:10.706044 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:10.706611 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:10.706616 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:10.706641 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:14:10.706939 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:10.706949 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.708639 (+ 1690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.708645 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:10.710785 (+ 2140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:10.710800 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.712307 (+ 1507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.712313 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:10.712855 (+ 542us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:10.712889 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 19:14:10.712970 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 19:14:10.713095 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1841,"mutex_wait_us":351,"thread_start_us":1670,"threads_started":1}
I20260809 19:14:10.716934 7365 tablet_service.cc:1467] Processing CreateTablet for tablet 4bfbd60c38444cf48df772bce4100690 (DEFAULT_TABLE table=test-table [id=7a116bca4a0a437fb63dc90d040c1f19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:14:10.718488 7365 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bfbd60c38444cf48df772bce4100690. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:10.719377 7784 tablet_service.cc:1467] Processing CreateTablet for tablet 4bfbd60c38444cf48df772bce4100690 (DEFAULT_TABLE table=test-table [id=7a116bca4a0a437fb63dc90d040c1f19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:14:10.719756 7570 tablet_service.cc:1467] Processing CreateTablet for tablet 4bfbd60c38444cf48df772bce4100690 (DEFAULT_TABLE table=test-table [id=7a116bca4a0a437fb63dc90d040c1f19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:14:10.720438 7784 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bfbd60c38444cf48df772bce4100690. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:10.721019 7570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bfbd60c38444cf48df772bce4100690. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:10.731263 7932 tablet_bootstrap.cc:492] T 4bfbd60c38444cf48df772bce4100690 P af0d88cded154bde97bbd0bb185f3e3f: Bootstrap starting.
I20260809 19:14:10.734333 7932 tablet_bootstrap.cc:654] T 4bfbd60c38444cf48df772bce4100690 P af0d88cded154bde97bbd0bb185f3e3f: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:10.734539 7936 tablet_bootstrap.cc:492] T 4bfbd60c38444cf48df772bce4100690 P d746bc2a376f42d48129663767736e7d: Bootstrap starting.
I20260809 19:14:10.736459 7932 log.cc:824] T 4bfbd60c38444cf48df772bce4100690 P af0d88cded154bde97bbd0bb185f3e3f: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:10.737892 7936 tablet_bootstrap.cc:654] T 4bfbd60c38444cf48df772bce4100690 P d746bc2a376f42d48129663767736e7d: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:10.739086 7936 log.cc:824] T 4bfbd60c38444cf48df772bce4100690 P d746bc2a376f42d48129663767736e7d: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:10.739625 7932 tablet_bootstrap.cc:492] T 4bfbd60c38444cf48df772bce4100690 P af0d88cded154bde97bbd0bb185f3e3f: No bootstrap required, opened a new log
I20260809 19:14:10.739799 7933 tablet_bootstrap.cc:492] T 4bfbd60c38444cf48df772bce4100690 P 2e91c181030b4aef90b034cd1ced5bb6: Bootstrap starting.
I20260809 19:14:10.739890 7932 ts_tablet_manager.cc:1397] T 4bfbd60c38444cf48df772bce4100690 P af0d88cded154bde97bbd0bb185f3e3f: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.007s
I20260809 19:14:10.741410 7936 tablet_bootstrap.cc:492] T 4bfbd60c38444cf48df772bce4100690 P d746bc2a376f42d48129663767736e7d: No bootstrap required, opened a new log
I20260809 19:14:10.741644 7936 ts_tablet_manager.cc:1397] T 4bfbd60c38444cf48df772bce4100690 P d746bc2a376f42d48129663767736e7d: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260809 19:14:10.743083 7933 tablet_bootstrap.cc:654] T 4bfbd60c38444cf48df772bce4100690 P 2e91c181030b4aef90b034cd1ced5bb6: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:10.744184 7933 log.cc:824] T 4bfbd60c38444cf48df772bce4100690 P 2e91c181030b4aef90b034cd1ced5bb6: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:10.747149 7933 tablet_bootstrap.cc:492] T 4bfbd60c38444cf48df772bce4100690 P 2e91c181030b4aef90b034cd1ced5bb6: No bootstrap required, opened a new log
I20260809 19:14:10.747401 7933 ts_tablet_manager.cc:1397] T 4bfbd60c38444cf48df772bce4100690 P 2e91c181030b4aef90b034cd1ced5bb6: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260809 19:14:10.748898 7936 raft_consensus.cc:348] T 4bfbd60c38444cf48df772bce4100690 P d746bc2a376f42d48129663767736e7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e91c181030b4aef90b034cd1ced5bb6" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 41265 } } peers { permanent_uuid: "af0d88cded154bde97bbd0bb185f3e3f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 39501 } } peers { permanent_uuid: "d746bc2a376f42d48129663767736e7d" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 34551 } }
I20260809 19:14:10.749233 7936 raft_consensus.cc:374] T 4bfbd60c38444cf48df772bce4100690 P d746bc2a376f42d48129663767736e7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:14:10.749327 7936 raft_consensus.cc:729] T 4bfbd60c38444cf48df772bce4100690 P d746bc2a376f42d48129663767736e7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d746bc2a376f42d48129663767736e7d, State: Initialized, Role: FOLLOWER
I20260809 19:14:10.749297 7932 raft_consensus.cc:348] T 4bfbd60c38444cf48df772bce4100690 P af0d88cded154bde97bbd0bb185f3e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e91c181030b4aef90b034cd1ced5bb6" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 41265 } } peers { permanent_uuid: "af0d88cded154bde97bbd0bb185f3e3f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 39501 } } peers { permanent_uuid: "d746bc2a376f42d48129663767736e7d" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 34551 } }
I20260809 19:14:10.749769 7932 raft_consensus.cc:374] T 4bfbd60c38444cf48df772bce4100690 P af0d88cded154bde97bbd0bb185f3e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:14:10.749872 7932 raft_consensus.cc:729] T 4bfbd60c38444cf48df772bce4100690 P af0d88cded154bde97bbd0bb185f3e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af0d88cded154bde97bbd0bb185f3e3f, State: Initialized, Role: FOLLOWER
I20260809 19:14:10.749878 7936 consensus_queue.cc:260] T 4bfbd60c38444cf48df772bce4100690 P d746bc2a376f42d48129663767736e7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e91c181030b4aef90b034cd1ced5bb6" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 41265 } } peers { permanent_uuid: "af0d88cded154bde97bbd0bb185f3e3f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 39501 } } peers { permanent_uuid: "d746bc2a376f42d48129663767736e7d" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 34551 } }
I20260809 19:14:10.750474 7932 consensus_queue.cc:260] T 4bfbd60c38444cf48df772bce4100690 P af0d88cded154bde97bbd0bb185f3e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e91c181030b4aef90b034cd1ced5bb6" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 41265 } } peers { permanent_uuid: "af0d88cded154bde97bbd0bb185f3e3f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 39501 } } peers { permanent_uuid: "d746bc2a376f42d48129663767736e7d" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 34551 } }
I20260809 19:14:10.750959 7673 heartbeater.cc:503] Master 127.7.39.62:42347 was elected leader, sending a full tablet report...
I20260809 19:14:10.751595 7936 ts_tablet_manager.cc:1428] T 4bfbd60c38444cf48df772bce4100690 P d746bc2a376f42d48129663767736e7d: Time spent starting tablet: real 0.010s user 0.006s sys 0.004s
I20260809 19:14:10.754923 7902 heartbeater.cc:503] Master 127.7.39.62:42347 was elected leader, sending a full tablet report...
I20260809 19:14:10.755525 7932 ts_tablet_manager.cc:1428] T 4bfbd60c38444cf48df772bce4100690 P af0d88cded154bde97bbd0bb185f3e3f: Time spent starting tablet: real 0.015s user 0.010s sys 0.004s
I20260809 19:14:10.758651 7944 raft_consensus.cc:482] T 4bfbd60c38444cf48df772bce4100690 P af0d88cded154bde97bbd0bb185f3e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:14:10.758647 7933 raft_consensus.cc:348] T 4bfbd60c38444cf48df772bce4100690 P 2e91c181030b4aef90b034cd1ced5bb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e91c181030b4aef90b034cd1ced5bb6" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 41265 } } peers { permanent_uuid: "af0d88cded154bde97bbd0bb185f3e3f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 39501 } } peers { permanent_uuid: "d746bc2a376f42d48129663767736e7d" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 34551 } }
I20260809 19:14:10.758991 7933 raft_consensus.cc:374] T 4bfbd60c38444cf48df772bce4100690 P 2e91c181030b4aef90b034cd1ced5bb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:14:10.759109 7933 raft_consensus.cc:729] T 4bfbd60c38444cf48df772bce4100690 P 2e91c181030b4aef90b034cd1ced5bb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e91c181030b4aef90b034cd1ced5bb6, State: Initialized, Role: FOLLOWER
I20260809 19:14:10.758916 7944 raft_consensus.cc:504] T 4bfbd60c38444cf48df772bce4100690 P af0d88cded154bde97bbd0bb185f3e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e91c181030b4aef90b034cd1ced5bb6" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 41265 } } peers { permanent_uuid: "af0d88cded154bde97bbd0bb185f3e3f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 39501 } } peers { permanent_uuid: "d746bc2a376f42d48129663767736e7d" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 34551 } }
I20260809 19:14:10.759646 7933 consensus_queue.cc:260] T 4bfbd60c38444cf48df772bce4100690 P 2e91c181030b4aef90b034cd1ced5bb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e91c181030b4aef90b034cd1ced5bb6" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 41265 } } peers { permanent_uuid: "af0d88cded154bde97bbd0bb185f3e3f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 39501 } } peers { permanent_uuid: "d746bc2a376f42d48129663767736e7d" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 34551 } }
I20260809 19:14:10.760591 7944 leader_election.cc:288] T 4bfbd60c38444cf48df772bce4100690 P af0d88cded154bde97bbd0bb185f3e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e91c181030b4aef90b034cd1ced5bb6 (127.7.39.1:41265), d746bc2a376f42d48129663767736e7d (127.7.39.2:34551)
I20260809 19:14:10.760637 7476 heartbeater.cc:503] Master 127.7.39.62:42347 was elected leader, sending a full tablet report...
I20260809 19:14:10.761233 7933 ts_tablet_manager.cc:1428] T 4bfbd60c38444cf48df772bce4100690 P 2e91c181030b4aef90b034cd1ced5bb6: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260809 19:14:10.767517 7904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:10.760895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.1:41265 (local address 127.7.39.3:44661)
0809 19:14:10.761607 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:10.761627 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:10.761736 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:10.762255 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:10.762261 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:10.762314 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:14:10.762548 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:10.762560 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.763897 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.763903 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:10.765393 (+ 1490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:10.765409 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.766795 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.766800 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:10.766972 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:10.767006 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 19:14:10.767103 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 19:14:10.767248 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577}
W20260809 19:14:10.767637 7478 tablet.cc:2369] T 4bfbd60c38444cf48df772bce4100690 P 2e91c181030b4aef90b034cd1ced5bb6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:14:10.768100 7923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:10.761760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:44661 (local address 127.7.39.1:41265)
0809 19:14:10.761948 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:10.761953 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:10.761969 (+ 16us) server_negotiation.cc:407] Connection header received
0809 19:14:10.762026 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:10.762031 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:10.762112 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:10.762205 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:14:10.762768 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.763739 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.765587 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.766501 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.766621 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:10.766705 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:10.767704 (+ 999us) server_negotiation.cc:299] Negotiation successful
0809 19:14:10.767829 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 19:14:10.769210 7398 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bfbd60c38444cf48df772bce4100690" candidate_uuid: "af0d88cded154bde97bbd0bb185f3e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e91c181030b4aef90b034cd1ced5bb6" is_pre_election: true
I20260809 19:14:10.769688 7947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:10.761178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.2:34551 (local address 127.7.39.3:33965)
0809 19:14:10.762893 (+ 1715us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:10.762910 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:10.763032 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:10.763348 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:10.763352 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:10.763376 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:14:10.763747 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:10.763760 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.765125 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.765130 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:10.767242 (+ 2112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:10.767257 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.769014 (+ 1757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.769020 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:10.769184 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:10.769214 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 19:14:10.769288 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 19:14:10.769402 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1608,"thread_start_us":1406,"threads_started":1}
I20260809 19:14:10.769697 7931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:10.761286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.39.3:33965 (local address 127.7.39.2:34551)
0809 19:14:10.761457 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:10.761463 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:10.762996 (+ 1533us) server_negotiation.cc:407] Connection header received
0809 19:14:10.763152 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:10.763157 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:10.763226 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:10.763309 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:14:10.763929 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.764947 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.767464 (+ 2517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.768571 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.768666 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:10.768755 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:10.769345 (+ 590us) server_negotiation.cc:299] Negotiation successful
0809 19:14:10.769470 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 19:14:10.769726 7398 raft_consensus.cc:2454] T 4bfbd60c38444cf48df772bce4100690 P 2e91c181030b4aef90b034cd1ced5bb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af0d88cded154bde97bbd0bb185f3e3f in term 0.
I20260809 19:14:10.770443 7710 leader_election.cc:302] T 4bfbd60c38444cf48df772bce4100690 P af0d88cded154bde97bbd0bb185f3e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e91c181030b4aef90b034cd1ced5bb6, af0d88cded154bde97bbd0bb185f3e3f; no voters:
I20260809 19:14:10.770555 7602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bfbd60c38444cf48df772bce4100690" candidate_uuid: "af0d88cded154bde97bbd0bb185f3e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d746bc2a376f42d48129663767736e7d" is_pre_election: true
I20260809 19:14:10.770954 7944 raft_consensus.cc:2781] T 4bfbd60c38444cf48df772bce4100690 P af0d88cded154bde97bbd0bb185f3e3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:14:10.771019 7602 raft_consensus.cc:2454] T 4bfbd60c38444cf48df772bce4100690 P d746bc2a376f42d48129663767736e7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af0d88cded154bde97bbd0bb185f3e3f in term 0.
I20260809 19:14:10.771099 7944 raft_consensus.cc:482] T 4bfbd60c38444cf48df772bce4100690 P af0d88cded154bde97bbd0bb185f3e3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:14:10.771193 7944 raft_consensus.cc:3037] T 4bfbd60c38444cf48df772bce4100690 P af0d88cded154bde97bbd0bb185f3e3f [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:10.773428 7944 raft_consensus.cc:504] T 4bfbd60c38444cf48df772bce4100690 P af0d88cded154bde97bbd0bb185f3e3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e91c181030b4aef90b034cd1ced5bb6" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 41265 } } peers { permanent_uuid: "af0d88cded154bde97bbd0bb185f3e3f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 39501 } } peers { permanent_uuid: "d746bc2a376f42d48129663767736e7d" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 34551 } }
I20260809 19:14:10.773974 7944 leader_election.cc:288] T 4bfbd60c38444cf48df772bce4100690 P af0d88cded154bde97bbd0bb185f3e3f [CANDIDATE]: Term 1 election: Requested vote from peers 2e91c181030b4aef90b034cd1ced5bb6 (127.7.39.1:41265), d746bc2a376f42d48129663767736e7d (127.7.39.2:34551)
I20260809 19:14:10.774362 7398 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bfbd60c38444cf48df772bce4100690" candidate_uuid: "af0d88cded154bde97bbd0bb185f3e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e91c181030b4aef90b034cd1ced5bb6"
I20260809 19:14:10.774538 7398 raft_consensus.cc:3037] T 4bfbd60c38444cf48df772bce4100690 P 2e91c181030b4aef90b034cd1ced5bb6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:10.774501 7602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bfbd60c38444cf48df772bce4100690" candidate_uuid: "af0d88cded154bde97bbd0bb185f3e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d746bc2a376f42d48129663767736e7d"
I20260809 19:14:10.774691 7602 raft_consensus.cc:3037] T 4bfbd60c38444cf48df772bce4100690 P d746bc2a376f42d48129663767736e7d [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:10.776737 7398 raft_consensus.cc:2454] T 4bfbd60c38444cf48df772bce4100690 P 2e91c181030b4aef90b034cd1ced5bb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af0d88cded154bde97bbd0bb185f3e3f in term 1.
I20260809 19:14:10.777052 7710 leader_election.cc:302] T 4bfbd60c38444cf48df772bce4100690 P af0d88cded154bde97bbd0bb185f3e3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e91c181030b4aef90b034cd1ced5bb6, af0d88cded154bde97bbd0bb185f3e3f; no voters:
I20260809 19:14:10.777297 7944 raft_consensus.cc:2781] T 4bfbd60c38444cf48df772bce4100690 P af0d88cded154bde97bbd0bb185f3e3f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:14:10.777727 7602 raft_consensus.cc:2454] T 4bfbd60c38444cf48df772bce4100690 P d746bc2a376f42d48129663767736e7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af0d88cded154bde97bbd0bb185f3e3f in term 1.
I20260809 19:14:10.777767 7944 raft_consensus.cc:686] T 4bfbd60c38444cf48df772bce4100690 P af0d88cded154bde97bbd0bb185f3e3f [term 1 LEADER]: Becoming Leader. State: Replica: af0d88cded154bde97bbd0bb185f3e3f, State: Running, Role: LEADER
I20260809 19:14:10.778530 7944 consensus_queue.cc:237] T 4bfbd60c38444cf48df772bce4100690 P af0d88cded154bde97bbd0bb185f3e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e91c181030b4aef90b034cd1ced5bb6" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 41265 } } peers { permanent_uuid: "af0d88cded154bde97bbd0bb185f3e3f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 39501 } } peers { permanent_uuid: "d746bc2a376f42d48129663767736e7d" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 34551 } }
I20260809 19:14:10.782475 7145 catalog_manager.cc:5495] T 4bfbd60c38444cf48df772bce4100690 P af0d88cded154bde97bbd0bb185f3e3f reported cstate change: term changed from 0 to 1, leader changed from <none> to af0d88cded154bde97bbd0bb185f3e3f (127.7.39.3). New cstate: current_term: 1 leader_uuid: "af0d88cded154bde97bbd0bb185f3e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e91c181030b4aef90b034cd1ced5bb6" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 41265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af0d88cded154bde97bbd0bb185f3e3f" member_type: VOTER last_known_addr { host: "127.7.39.3" port: 39501 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d746bc2a376f42d48129663767736e7d" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 34551 } health_report { overall_health: UNKNOWN } } }
I20260809 19:14:10.813716 7927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:10.809075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33450 (local address 127.7.39.3:39501)
0809 19:14:10.809262 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:10.809267 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:10.809283 (+ 16us) server_negotiation.cc:407] Connection header received
0809 19:14:10.809436 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:10.809440 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:10.809516 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:10.809633 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:14:10.809902 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.810615 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.811948 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.812338 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.812423 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:10.812831 (+ 408us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:14:10.813255 (+ 424us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:14:10.813354 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:10.813424 (+ 70us) server_negotiation.cc:299] Negotiation successful
0809 19:14:10.813481 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 19:14:10.820894 7602 raft_consensus.cc:1261] T 4bfbd60c38444cf48df772bce4100690 P d746bc2a376f42d48129663767736e7d [term 1 FOLLOWER]: Refusing update from remote peer af0d88cded154bde97bbd0bb185f3e3f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:14:10.820926 7398 raft_consensus.cc:1261] T 4bfbd60c38444cf48df772bce4100690 P 2e91c181030b4aef90b034cd1ced5bb6 [term 1 FOLLOWER]: Refusing update from remote peer af0d88cded154bde97bbd0bb185f3e3f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:14:10.821718 7948 consensus_queue.cc:1035] T 4bfbd60c38444cf48df772bce4100690 P af0d88cded154bde97bbd0bb185f3e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e91c181030b4aef90b034cd1ced5bb6" member_type: VOTER last_known_addr { host: "127.7.39.1" port: 41265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:14:10.822036 7944 consensus_queue.cc:1035] T 4bfbd60c38444cf48df772bce4100690 P af0d88cded154bde97bbd0bb185f3e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d746bc2a376f42d48129663767736e7d" member_type: VOTER last_known_addr { host: "127.7.39.2" port: 34551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:14:10.832283 7954 mvcc.cc:205] Tried to move back new op lower bound from 7316696476953985024 to 7316696476792463360. Current Snapshot: MvccSnapshot[applied={T|T < 7316696476953985024}]
I20260809 19:14:10.844327 7145 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36708:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:14:10.844547 7145 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36708:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:14:10.847667 7145 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0e38cd7b22884d5788ca0238879b69f7: Sending DeleteTablet for 3 replicas of tablet 4bfbd60c38444cf48df772bce4100690
I20260809 19:14:10.848636 7365 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bfbd60c38444cf48df772bce4100690 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:14:10 UTC) from {username='slave'} at 127.0.0.1:34560
I20260809 19:14:10.848824 7570 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bfbd60c38444cf48df772bce4100690 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:14:10 UTC) from {username='slave'} at 127.0.0.1:47838
I20260809 19:14:10.849633 7976 tablet_replica.cc:330] T 4bfbd60c38444cf48df772bce4100690 P 2e91c181030b4aef90b034cd1ced5bb6: stopping tablet replica
I20260809 19:14:10.849987 7784 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bfbd60c38444cf48df772bce4100690 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:14:10 UTC) from {username='slave'} at 127.0.0.1:33448
I20260809 19:14:10.850092 7976 raft_consensus.cc:2229] T 4bfbd60c38444cf48df772bce4100690 P 2e91c181030b4aef90b034cd1ced5bb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:14:10.850577 7976 raft_consensus.cc:2258] T 4bfbd60c38444cf48df772bce4100690 P 2e91c181030b4aef90b034cd1ced5bb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:14:10.850764 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 7243
I20260809 19:14:10.851233 7978 tablet_replica.cc:330] T 4bfbd60c38444cf48df772bce4100690 P d746bc2a376f42d48129663767736e7d: stopping tablet replica
I20260809 19:14:10.851590 7978 raft_consensus.cc:2229] T 4bfbd60c38444cf48df772bce4100690 P d746bc2a376f42d48129663767736e7d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:14:10.851998 7978 raft_consensus.cc:2258] T 4bfbd60c38444cf48df772bce4100690 P d746bc2a376f42d48129663767736e7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:14:10.853843 7976 ts_tablet_manager.cc:1905] T 4bfbd60c38444cf48df772bce4100690 P 2e91c181030b4aef90b034cd1ced5bb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:14:10.857957 7978 ts_tablet_manager.cc:1905] T 4bfbd60c38444cf48df772bce4100690 P d746bc2a376f42d48129663767736e7d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:14:10.864759 7978 ts_tablet_manager.cc:1918] T 4bfbd60c38444cf48df772bce4100690 P d746bc2a376f42d48129663767736e7d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:14:10.869140 7976 ts_tablet_manager.cc:1918] T 4bfbd60c38444cf48df772bce4100690 P 2e91c181030b4aef90b034cd1ced5bb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:14:10.869375 7976 log.cc:1196] T 4bfbd60c38444cf48df772bce4100690 P 2e91c181030b4aef90b034cd1ced5bb6: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-0/wal/wals/4bfbd60c38444cf48df772bce4100690
I20260809 19:14:10.870023 7976 ts_tablet_manager.cc:1939] T 4bfbd60c38444cf48df772bce4100690 P 2e91c181030b4aef90b034cd1ced5bb6: Deleting consensus metadata
I20260809 19:14:10.872325 7130 catalog_manager.cc:4841] TS 2e91c181030b4aef90b034cd1ced5bb6 (127.7.39.1:41265): tablet 4bfbd60c38444cf48df772bce4100690 (table test-table [id=7a116bca4a0a437fb63dc90d040c1f19]) successfully deleted
I20260809 19:14:10.872943 7923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:10.851829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34570 (local address 127.7.39.1:41265)
0809 19:14:10.851994 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:10.852000 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:10.864713 (+ 12713us) server_negotiation.cc:407] Connection header received
0809 19:14:10.864879 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:10.864885 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:10.864989 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:10.865099 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:10.865604 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.866904 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.868932 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.869641 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.869738 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:10.871241 (+ 1503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:10.871253 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:10.871272 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:10.872035 (+ 763us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:10.872107 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:10.872132 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:10.872223 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:10.872467 (+ 244us) server_negotiation.cc:299] Negotiation successful
0809 19:14:10.872584 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 19:14:10.873117 7983 tablet_replica.cc:330] T 4bfbd60c38444cf48df772bce4100690 P af0d88cded154bde97bbd0bb185f3e3f: stopping tablet replica
I20260809 19:14:10.873567 7983 raft_consensus.cc:2229] T 4bfbd60c38444cf48df772bce4100690 P af0d88cded154bde97bbd0bb185f3e3f [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:14:10.873895 7469 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:14:10.874326 7983 raft_consensus.cc:2258] T 4bfbd60c38444cf48df772bce4100690 P af0d88cded154bde97bbd0bb185f3e3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:14:10.876547 7983 ts_tablet_manager.cc:1905] T 4bfbd60c38444cf48df772bce4100690 P af0d88cded154bde97bbd0bb185f3e3f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:14:10.875079 7978 log.cc:1196] T 4bfbd60c38444cf48df772bce4100690 P d746bc2a376f42d48129663767736e7d: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-1/wal/wals/4bfbd60c38444cf48df772bce4100690
I20260809 19:14:10.882998 7978 ts_tablet_manager.cc:1939] T 4bfbd60c38444cf48df772bce4100690 P d746bc2a376f42d48129663767736e7d: Deleting consensus metadata
I20260809 19:14:10.883695 7983 ts_tablet_manager.cc:1918] T 4bfbd60c38444cf48df772bce4100690 P af0d88cded154bde97bbd0bb185f3e3f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:14:10.883915 7983 log.cc:1196] T 4bfbd60c38444cf48df772bce4100690 P af0d88cded154bde97bbd0bb185f3e3f: Deleting WAL directory at /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786302538618573-7324-0/minicluster-data/ts-2/wal/wals/4bfbd60c38444cf48df772bce4100690
I20260809 19:14:10.884572 7983 ts_tablet_manager.cc:1939] T 4bfbd60c38444cf48df772bce4100690 P af0d88cded154bde97bbd0bb185f3e3f: Deleting consensus metadata
I20260809 19:14:10.884902 7130 catalog_manager.cc:4841] TS d746bc2a376f42d48129663767736e7d (127.7.39.2:34551): tablet 4bfbd60c38444cf48df772bce4100690 (table test-table [id=7a116bca4a0a437fb63dc90d040c1f19]) successfully deleted
I20260809 19:14:10.886456 7130 catalog_manager.cc:4841] TS af0d88cded154bde97bbd0bb185f3e3f (127.7.39.3:39501): tablet 4bfbd60c38444cf48df772bce4100690 (table test-table [id=7a116bca4a0a437fb63dc90d040c1f19]) successfully deleted
I20260809 19:14:10.962162 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 7243
I20260809 19:14:10.984894 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 7481
I20260809 19:14:10.992583 7931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:10.985766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47852 (local address 127.7.39.2:34551)
0809 19:14:10.985949 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:10.985953 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:10.985983 (+ 30us) server_negotiation.cc:407] Connection header received
0809 19:14:10.986151 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:10.986155 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:10.986239 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:10.986445 (+ 206us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:10.986953 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.987639 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.989475 (+ 1836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:10.989840 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:10.989925 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:10.991026 (+ 1101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:10.991034 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:10.991050 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:10.991788 (+ 738us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:10.991847 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:10.991873 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:10.991991 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:10.992172 (+ 181us) server_negotiation.cc:299] Negotiation successful
0809 19:14:10.992280 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 19:14:10.993325 7662 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:14:11.083442 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 7481
I20260809 19:14:11.107136 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 7676
I20260809 19:14:11.114176 7927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:11.107876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33452 (local address 127.7.39.3:39501)
0809 19:14:11.108076 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:11.108081 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:11.108173 (+ 92us) server_negotiation.cc:407] Connection header received
0809 19:14:11.108349 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:11.108353 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:11.108429 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:11.108533 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:11.108958 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:11.109758 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:11.111162 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:11.111606 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:11.111722 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:11.112794 (+ 1072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:11.112802 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:11.112816 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:11.113429 (+ 613us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:11.113480 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:11.113500 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:11.113607 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:11.113735 (+ 128us) server_negotiation.cc:299] Negotiation successful
0809 19:14:11.113838 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 19:14:11.114882 7895 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:14:11.231415 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 7676
I20260809 19:14:11.260706 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 7097
I20260809 19:14:11.261723 7189 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:14:11.367515 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 7097
2026-08-09T19:14:11Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (2614 ms)
[----------] 6 tests from EncryptionPolicyTest (21030 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:14:11 dist-test-slave-4tdj krb5kdc[8003](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:14:11 dist-test-slave-4tdj krb5kdc[8003](info): set up 2 sockets
Aug 09 19:14:11 dist-test-slave-4tdj krb5kdc[8003](info): commencing operation
krb5kdc: starting...
W20260809 19:14:12.601110 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.185s user 0.005s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:14:12 dist-test-slave-4tdj krb5kdc[8003](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:14:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:14:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:14:12.839107 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43039
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43039
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:14:13.161088 8025 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:13.161373 8025 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:13.161513 8025 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:13.168498 8025 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:14:13.168617 8025 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:13.168695 8025 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:13.168778 8025 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:14:13.168844 8025 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:14:13.178432 8025 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43039
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43039
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:13.179702 8025 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:13.180985 8025 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:13.192034 8032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:13.192093 8037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:13.192107 8039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:13.192961 8025 server_base.cc:1034] running on GCE node
I20260809 19:14:13.193697 8025 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:13.195021 8025 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:13.196223 8025 hybrid_clock.cc:648] HybridClock initialized: now 1786302853196187 us; error 25 us; skew 500 ppm
I20260809 19:14:13.196516 8025 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:14:13 dist-test-slave-4tdj krb5kdc[8003](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302853, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:14:13.199441 8025 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:14:13.200816 8025 webserver.cc:460] Webserver started at http://127.0.0.1:42701/ using document root <none> and password file <none>
I20260809 19:14:13.201473 8025 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:13.201587 8025 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:13.201864 8025 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:13.204708 8025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "62f43ed6a6bf453a98d221cf6180e6e5"
format_stamp: "Formatted at 2026-08-09 19:14:13 on dist-test-slave-4tdj"
server_key: "97efe8bb049a034bbe1c38a2736b6ca7"
server_key_iv: "bd3a42da838bdc9b4842326a09424989"
server_key_version: "encryptionkey@0"
I20260809 19:14:13.205433 8025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "62f43ed6a6bf453a98d221cf6180e6e5"
format_stamp: "Formatted at 2026-08-09 19:14:13 on dist-test-slave-4tdj"
server_key: "97efe8bb049a034bbe1c38a2736b6ca7"
server_key_iv: "bd3a42da838bdc9b4842326a09424989"
server_key_version: "encryptionkey@0"
I20260809 19:14:13.210139 8025 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 19:14:13.213294 8049 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:13.214506 8025 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 19:14:13.214665 8025 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "62f43ed6a6bf453a98d221cf6180e6e5"
format_stamp: "Formatted at 2026-08-09 19:14:13 on dist-test-slave-4tdj"
server_key: "97efe8bb049a034bbe1c38a2736b6ca7"
server_key_iv: "bd3a42da838bdc9b4842326a09424989"
server_key_version: "encryptionkey@0"
I20260809 19:14:13.214828 8025 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:13.232993 8025 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:13.236858 8025 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:13.237110 8025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:13.253892 8025 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43039
I20260809 19:14:13.253926 8133 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43039 every 8 connection(s)
I20260809 19:14:13.255168 8025 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:14:13.258689 8135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:13.258733 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 8025
I20260809 19:14:13.258952 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:14:13.259766 7324 external_mini_cluster.cc:1428] Setting key bdc5c2912eb02961943612885941468d
I20260809 19:14:13.272047 8135 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62f43ed6a6bf453a98d221cf6180e6e5: Bootstrap starting.
Aug 09 19:14:13 dist-test-slave-4tdj krb5kdc[8003](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 19:14:13.275547 8135 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 62f43ed6a6bf453a98d221cf6180e6e5: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:13.276592 8135 log.cc:824] T 00000000000000000000000000000000 P 62f43ed6a6bf453a98d221cf6180e6e5: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:13.279722 8135 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62f43ed6a6bf453a98d221cf6180e6e5: No bootstrap required, opened a new log
I20260809 19:14:13.282816 8147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:13.261596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46029 (local address 127.0.0.1:43039)
0809 19:14:13.262371 (+ 775us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:13.262382 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:13.262422 (+ 40us) server_negotiation.cc:407] Connection header received
0809 19:14:13.264622 (+ 2200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:13.264643 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:13.264996 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:13.265326 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:13.266995 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:13.268236 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:13.270012 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:13.270702 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:13.270835 (+ 133us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:13.275406 (+ 4571us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:13.275413 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:13.275427 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:13.275465 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:13.278670 (+ 3205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:13.279538 (+ 868us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:13.279544 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:13.279549 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:13.279713 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:13.280220 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:13.280226 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:13.280228 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:13.280710 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:13.280943 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:13.281447 (+ 504us) server_negotiation.cc:299] Negotiation successful
0809 19:14:13.281710 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":555,"thread_start_us":327,"threads_started":1}
I20260809 19:14:13.286787 7324 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:14:13.288929 8135 raft_consensus.cc:348] T 00000000000000000000000000000000 P 62f43ed6a6bf453a98d221cf6180e6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62f43ed6a6bf453a98d221cf6180e6e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43039 } }
I20260809 19:14:13.289354 8135 raft_consensus.cc:374] T 00000000000000000000000000000000 P 62f43ed6a6bf453a98d221cf6180e6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:14:13.289460 8135 raft_consensus.cc:729] T 00000000000000000000000000000000 P 62f43ed6a6bf453a98d221cf6180e6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62f43ed6a6bf453a98d221cf6180e6e5, State: Initialized, Role: FOLLOWER
I20260809 19:14:13.290099 8135 consensus_queue.cc:260] T 00000000000000000000000000000000 P 62f43ed6a6bf453a98d221cf6180e6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62f43ed6a6bf453a98d221cf6180e6e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43039 } }
I20260809 19:14:13.290410 8135 raft_consensus.cc:388] T 00000000000000000000000000000000 P 62f43ed6a6bf453a98d221cf6180e6e5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:14:13.290560 8135 raft_consensus.cc:482] T 00000000000000000000000000000000 P 62f43ed6a6bf453a98d221cf6180e6e5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:14:13.290736 8135 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 62f43ed6a6bf453a98d221cf6180e6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:13.293263 8135 raft_consensus.cc:504] T 00000000000000000000000000000000 P 62f43ed6a6bf453a98d221cf6180e6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62f43ed6a6bf453a98d221cf6180e6e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43039 } }
I20260809 19:14:13.293711 8135 leader_election.cc:302] T 00000000000000000000000000000000 P 62f43ed6a6bf453a98d221cf6180e6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62f43ed6a6bf453a98d221cf6180e6e5; no voters:
I20260809 19:14:13.294269 8135 leader_election.cc:288] T 00000000000000000000000000000000 P 62f43ed6a6bf453a98d221cf6180e6e5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:14:13.294389 8157 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 62f43ed6a6bf453a98d221cf6180e6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:14:13.295560 8157 raft_consensus.cc:686] T 00000000000000000000000000000000 P 62f43ed6a6bf453a98d221cf6180e6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 62f43ed6a6bf453a98d221cf6180e6e5, State: Running, Role: LEADER
I20260809 19:14:13.296164 8157 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62f43ed6a6bf453a98d221cf6180e6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62f43ed6a6bf453a98d221cf6180e6e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43039 } }
I20260809 19:14:13.296489 8135 sys_catalog.cc:564] T 00000000000000000000000000000000 P 62f43ed6a6bf453a98d221cf6180e6e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:14:13.298930 8159 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62f43ed6a6bf453a98d221cf6180e6e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "62f43ed6a6bf453a98d221cf6180e6e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62f43ed6a6bf453a98d221cf6180e6e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43039 } } }
I20260809 19:14:13.299315 8159 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62f43ed6a6bf453a98d221cf6180e6e5 [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:13.300606 8160 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62f43ed6a6bf453a98d221cf6180e6e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62f43ed6a6bf453a98d221cf6180e6e5. Latest consensus state: current_term: 1 leader_uuid: "62f43ed6a6bf453a98d221cf6180e6e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62f43ed6a6bf453a98d221cf6180e6e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43039 } } }
I20260809 19:14:13.300978 8160 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62f43ed6a6bf453a98d221cf6180e6e5 [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:13.302855 8167 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:14:13.309672 8167 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:14:13.311261 8147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:13.292322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60727 (local address 127.0.0.1:43039)
0809 19:14:13.292518 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:13.292524 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:13.294797 (+ 2273us) server_negotiation.cc:407] Connection header received
0809 19:14:13.295051 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:13.295057 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:13.295138 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:13.295202 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:13.296882 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:13.297718 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:13.299495 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:13.300271 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:13.300386 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:13.303418 (+ 3032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:13.303426 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:13.303430 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:13.303473 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:13.307088 (+ 3615us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:13.308081 (+ 993us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:13.308087 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:13.308091 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:13.308236 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:13.308813 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:13.308817 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:13.308820 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:13.309201 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:13.309467 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:13.310683 (+ 1216us) server_negotiation.cc:299] Negotiation successful
0809 19:14:13.310868 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 19:14:13.319264 8167 catalog_manager.cc:1347] Generated new cluster ID: 97582708e7f8475db9b7df8a143cba3e
I20260809 19:14:13.319356 8167 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:14:13.346804 8167 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:14:13.347965 8167 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:14:13.354404 8167 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 62f43ed6a6bf453a98d221cf6180e6e5: Generated new TSK 0
I20260809 19:14:13.355065 8167 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:14:13.368845 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 8025
I20260809 19:14:13.370342 8127 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:14:13.458642 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 8025
W20260809 19:14:13.482893 7996 connection.cc:535] client connection to 127.0.0.1:43039 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43039): Connection reset by peer (error 104)
2026-08-09T19:14:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2086 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:14:13 dist-test-slave-4tdj krb5kdc[8189](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:14:13 dist-test-slave-4tdj krb5kdc[8189](info): set up 2 sockets
Aug 09 19:14:13 dist-test-slave-4tdj krb5kdc[8189](info): commencing operation
krb5kdc: starting...
W20260809 19:14:14.688126 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.185s user 0.002s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:14:14 dist-test-slave-4tdj krb5kdc[8189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302854, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:14:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:14:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:14:14.928840 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39909
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39909
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:14:15.260991 8211 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:15.261263 8211 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:15.261401 8211 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:15.268478 8211 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:14:15.268596 8211 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:15.268680 8211 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:15.268772 8211 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:14:15.268834 8211 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:14:15.278465 8211 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39909
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39909
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:15.279659 8211 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:15.280941 8211 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:15.292361 8222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:15.292542 8221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:15.292711 8225 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:15.293520 8211 server_base.cc:1034] running on GCE node
I20260809 19:14:15.294269 8211 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:15.295578 8211 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:15.296772 8211 hybrid_clock.cc:648] HybridClock initialized: now 1786302855296732 us; error 32 us; skew 500 ppm
I20260809 19:14:15.297089 8211 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:14:15 dist-test-slave-4tdj krb5kdc[8189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302855, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:14:15.299948 8211 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:14:15.301255 8211 webserver.cc:460] Webserver started at http://127.0.0.1:42975/ using document root <none> and password file <none>
I20260809 19:14:15.301867 8211 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:15.301981 8211 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:15.302263 8211 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:15.305131 8211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "0f0451c5b3fd42408a05eedf61e816ff"
format_stamp: "Formatted at 2026-08-09 19:14:15 on dist-test-slave-4tdj"
server_key: "6eb559c5f4add65518fe7d8b02d2c0ff"
server_key_iv: "75819f08c3eeec94caa32bff590131e7"
server_key_version: "encryptionkey@0"
I20260809 19:14:15.305837 8211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "0f0451c5b3fd42408a05eedf61e816ff"
format_stamp: "Formatted at 2026-08-09 19:14:15 on dist-test-slave-4tdj"
server_key: "6eb559c5f4add65518fe7d8b02d2c0ff"
server_key_iv: "75819f08c3eeec94caa32bff590131e7"
server_key_version: "encryptionkey@0"
I20260809 19:14:15.310595 8211 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.004s
I20260809 19:14:15.313738 8236 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:15.314920 8211 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 19:14:15.315085 8211 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "0f0451c5b3fd42408a05eedf61e816ff"
format_stamp: "Formatted at 2026-08-09 19:14:15 on dist-test-slave-4tdj"
server_key: "6eb559c5f4add65518fe7d8b02d2c0ff"
server_key_iv: "75819f08c3eeec94caa32bff590131e7"
server_key_version: "encryptionkey@0"
I20260809 19:14:15.315248 8211 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:15.334867 8211 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:15.338379 8211 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:15.338627 8211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:15.355190 8211 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39909
I20260809 19:14:15.355230 8321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39909 every 8 connection(s)
I20260809 19:14:15.356410 8211 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:14:15.359453 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 8211
I20260809 19:14:15.359611 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:14:15.359889 8322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:15.360078 7324 external_mini_cluster.cc:1428] Setting key 449f73efde87fc7f32d457a128f8ead5
I20260809 19:14:15.373463 8325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:15.361746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38509 (local address 127.0.0.1:39909)
0809 19:14:15.362563 (+ 817us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:15.362576 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:15.362629 (+ 53us) server_negotiation.cc:407] Connection header received
0809 19:14:15.364545 (+ 1916us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:15.364572 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:15.365031 (+ 459us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:15.365444 (+ 413us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:15.365941 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:15.367887 (+ 1946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:15.369158 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:15.370143 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:15.370354 (+ 211us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:15.371412 (+ 1058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:15.371422 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:15.371434 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:15.371945 (+ 511us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:15.372030 (+ 85us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:15.372054 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:15.372199 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:15.372479 (+ 280us) server_negotiation.cc:299] Negotiation successful
0809 19:14:15.372620 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":572,"thread_start_us":318,"threads_started":1}
I20260809 19:14:15.373512 8322 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f0451c5b3fd42408a05eedf61e816ff: Bootstrap starting.
I20260809 19:14:15.376890 8322 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f0451c5b3fd42408a05eedf61e816ff: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:15.377141 7324 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:14:15.377876 8322 log.cc:824] T 00000000000000000000000000000000 P 0f0451c5b3fd42408a05eedf61e816ff: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:15.380486 8322 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f0451c5b3fd42408a05eedf61e816ff: No bootstrap required, opened a new log
I20260809 19:14:15.387115 8325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:15.381304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48949 (local address 127.0.0.1:39909)
0809 19:14:15.381467 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:15.381477 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:15.381942 (+ 465us) server_negotiation.cc:407] Connection header received
0809 19:14:15.382107 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:15.382110 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:15.382168 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:15.382253 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:15.382750 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:15.383481 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:15.384861 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:15.385326 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:15.385451 (+ 125us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:15.386430 (+ 979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:15.386435 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:15.386438 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:15.386454 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:15.386491 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:15.386508 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:15.386617 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:15.386797 (+ 180us) server_negotiation.cc:299] Negotiation successful
0809 19:14:15.386843 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 19:14:15.387822 8322 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f0451c5b3fd42408a05eedf61e816ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f0451c5b3fd42408a05eedf61e816ff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39909 } }
I20260809 19:14:15.388167 8322 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0f0451c5b3fd42408a05eedf61e816ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:14:15.388273 8322 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f0451c5b3fd42408a05eedf61e816ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0451c5b3fd42408a05eedf61e816ff, State: Initialized, Role: FOLLOWER
I20260809 19:14:15.388810 8322 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f0451c5b3fd42408a05eedf61e816ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f0451c5b3fd42408a05eedf61e816ff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39909 } }
I20260809 19:14:15.389025 8322 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0f0451c5b3fd42408a05eedf61e816ff [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:14:15.389120 8322 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0f0451c5b3fd42408a05eedf61e816ff [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:14:15.389231 8322 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f0451c5b3fd42408a05eedf61e816ff [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:15.391338 8322 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0f0451c5b3fd42408a05eedf61e816ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f0451c5b3fd42408a05eedf61e816ff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39909 } }
I20260809 19:14:15.391790 8322 leader_election.cc:302] T 00000000000000000000000000000000 P 0f0451c5b3fd42408a05eedf61e816ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0f0451c5b3fd42408a05eedf61e816ff; no voters:
I20260809 19:14:15.392434 8322 leader_election.cc:288] T 00000000000000000000000000000000 P 0f0451c5b3fd42408a05eedf61e816ff [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:14:15.392540 8335 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0f0451c5b3fd42408a05eedf61e816ff [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:14:15.393185 8335 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0f0451c5b3fd42408a05eedf61e816ff [term 1 LEADER]: Becoming Leader. State: Replica: 0f0451c5b3fd42408a05eedf61e816ff, State: Running, Role: LEADER
I20260809 19:14:15.393707 8335 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0f0451c5b3fd42408a05eedf61e816ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f0451c5b3fd42408a05eedf61e816ff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39909 } }
I20260809 19:14:15.394614 8322 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f0451c5b3fd42408a05eedf61e816ff [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:14:15.396694 8336 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f0451c5b3fd42408a05eedf61e816ff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0f0451c5b3fd42408a05eedf61e816ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f0451c5b3fd42408a05eedf61e816ff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39909 } } }
I20260809 19:14:15.396708 8337 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f0451c5b3fd42408a05eedf61e816ff [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f0451c5b3fd42408a05eedf61e816ff. Latest consensus state: current_term: 1 leader_uuid: "0f0451c5b3fd42408a05eedf61e816ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f0451c5b3fd42408a05eedf61e816ff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39909 } } }
I20260809 19:14:15.397145 8337 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f0451c5b3fd42408a05eedf61e816ff [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:15.397142 8336 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f0451c5b3fd42408a05eedf61e816ff [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:15.398891 8348 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:14:15.403703 8348 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:14:15.412256 8348 catalog_manager.cc:1347] Generated new cluster ID: 25861340cdb144ab90edaa6ac97116fa
I20260809 19:14:15.412361 8348 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:14:15.427170 8348 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:14:15.428336 8348 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:14:15.434051 8348 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0f0451c5b3fd42408a05eedf61e816ff: Generated new TSK 0
I20260809 19:14:15.434800 8348 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:14:15.448248 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 8211
W20260809 19:14:15.449342 8316 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:38509
W20260809 19:14:15.450069 7324 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 8211: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 19:14:15.450234 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 8211
W20260809 19:14:15.470980 8186 connection.cc:535] client connection to 127.0.0.1:39909 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39909): Connection reset by peer (error 104)
2026-08-09T19:14:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1986 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:14:15 dist-test-slave-4tdj krb5kdc[8371](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:14:15 dist-test-slave-4tdj krb5kdc[8371](info): set up 2 sockets
Aug 09 19:14:15 dist-test-slave-4tdj krb5kdc[8371](info): commencing operation
krb5kdc: starting...
W20260809 19:14:16.651371 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.162s user 0.002s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:14:16 dist-test-slave-4tdj krb5kdc[8371](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302856, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:14:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:14:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:14:16.891412 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32873
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:32873
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:14:17.217192 8391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:17.217471 8391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:17.217614 8391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:17.224542 8391 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:14:17.224649 8391 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:17.224722 8391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:17.224810 8391 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:14:17.224869 8391 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:14:17.234174 8391 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:32873
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32873
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:17.235361 8391 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:17.236596 8391 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:17.247433 8398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:17.247468 8400 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:17.247386 8402 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:17.248499 8391 server_base.cc:1034] running on GCE node
I20260809 19:14:17.249233 8391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:17.250517 8391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:17.251720 8391 hybrid_clock.cc:648] HybridClock initialized: now 1786302857251682 us; error 33 us; skew 500 ppm
I20260809 19:14:17.252029 8391 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:14:17 dist-test-slave-4tdj krb5kdc[8371](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302857, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:14:17.257467 8391 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:14:17.258824 8391 webserver.cc:460] Webserver started at http://127.0.0.1:42193/ using document root <none> and password file <none>
I20260809 19:14:17.259433 8391 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:17.259538 8391 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:17.259828 8391 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:17.262638 8391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "946f077f2bef4231ab778710ffc5b1ee"
format_stamp: "Formatted at 2026-08-09 19:14:17 on dist-test-slave-4tdj"
server_key: "dac51c34f46255e979e6bc1af2d97225"
server_key_iv: "aa100fb59ae48498f2fe01b25ed87ff9"
server_key_version: "encryptionkey@0"
I20260809 19:14:17.263343 8391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "946f077f2bef4231ab778710ffc5b1ee"
format_stamp: "Formatted at 2026-08-09 19:14:17 on dist-test-slave-4tdj"
server_key: "dac51c34f46255e979e6bc1af2d97225"
server_key_iv: "aa100fb59ae48498f2fe01b25ed87ff9"
server_key_version: "encryptionkey@0"
I20260809 19:14:17.268071 8391 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 19:14:17.271201 8412 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:17.272363 8391 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 19:14:17.272511 8391 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "946f077f2bef4231ab778710ffc5b1ee"
format_stamp: "Formatted at 2026-08-09 19:14:17 on dist-test-slave-4tdj"
server_key: "dac51c34f46255e979e6bc1af2d97225"
server_key_iv: "aa100fb59ae48498f2fe01b25ed87ff9"
server_key_version: "encryptionkey@0"
I20260809 19:14:17.272689 8391 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:17.277985 8391 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:17.281406 8391 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:17.281672 8391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:17.298280 8391 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:32873
I20260809 19:14:17.298357 8492 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:32873 every 8 connection(s)
I20260809 19:14:17.299556 8391 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:14:17.302887 8493 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:17.306031 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 8391
I20260809 19:14:17.306186 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:14:17.306632 7324 external_mini_cluster.cc:1428] Setting key f0ef361ede487fc353cc9630d8f3580f
I20260809 19:14:17.314754 8498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:17.308361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49353 (local address 127.0.0.1:32873)
0809 19:14:17.309121 (+ 760us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:17.309134 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:17.309183 (+ 49us) server_negotiation.cc:407] Connection header received
0809 19:14:17.311140 (+ 1957us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:17.311168 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:17.311611 (+ 443us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:17.312013 (+ 402us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:17.312921 (+ 908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:17.312930 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:17.312946 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:17.312968 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:17.313046 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:17.313072 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:17.313287 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:17.313407 (+ 120us) server_negotiation.cc:299] Negotiation successful
0809 19:14:17.313601 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":519,"thread_start_us":301,"threads_started":1}
I20260809 19:14:17.315555 8493 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 946f077f2bef4231ab778710ffc5b1ee: Bootstrap starting.
I20260809 19:14:17.317981 7324 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:14:17.318696 8493 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 946f077f2bef4231ab778710ffc5b1ee: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:17.319872 8493 log.cc:824] T 00000000000000000000000000000000 P 946f077f2bef4231ab778710ffc5b1ee: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:17.323010 8493 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 946f077f2bef4231ab778710ffc5b1ee: No bootstrap required, opened a new log
I20260809 19:14:17.325130 8498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:17.323006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52489 (local address 127.0.0.1:32873)
0809 19:14:17.323152 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:17.323157 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:17.323483 (+ 326us) server_negotiation.cc:407] Connection header received
0809 19:14:17.323599 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:17.323604 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:17.323661 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:17.323765 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:17.324530 (+ 765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:17.324536 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:17.324540 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:17.324558 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:17.324611 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:17.324635 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:17.324747 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:17.324795 (+ 48us) server_negotiation.cc:299] Negotiation successful
0809 19:14:17.324845 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 19:14:17.330837 8493 raft_consensus.cc:348] T 00000000000000000000000000000000 P 946f077f2bef4231ab778710ffc5b1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "946f077f2bef4231ab778710ffc5b1ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32873 } }
I20260809 19:14:17.331176 8493 raft_consensus.cc:374] T 00000000000000000000000000000000 P 946f077f2bef4231ab778710ffc5b1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:14:17.331255 8493 raft_consensus.cc:729] T 00000000000000000000000000000000 P 946f077f2bef4231ab778710ffc5b1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 946f077f2bef4231ab778710ffc5b1ee, State: Initialized, Role: FOLLOWER
I20260809 19:14:17.331736 8493 consensus_queue.cc:260] T 00000000000000000000000000000000 P 946f077f2bef4231ab778710ffc5b1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "946f077f2bef4231ab778710ffc5b1ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32873 } }
I20260809 19:14:17.331944 8493 raft_consensus.cc:388] T 00000000000000000000000000000000 P 946f077f2bef4231ab778710ffc5b1ee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:14:17.332091 8493 raft_consensus.cc:482] T 00000000000000000000000000000000 P 946f077f2bef4231ab778710ffc5b1ee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:14:17.332284 8493 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 946f077f2bef4231ab778710ffc5b1ee [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:17.334414 8493 raft_consensus.cc:504] T 00000000000000000000000000000000 P 946f077f2bef4231ab778710ffc5b1ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "946f077f2bef4231ab778710ffc5b1ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32873 } }
I20260809 19:14:17.334853 8493 leader_election.cc:302] T 00000000000000000000000000000000 P 946f077f2bef4231ab778710ffc5b1ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 946f077f2bef4231ab778710ffc5b1ee; no voters:
I20260809 19:14:17.335387 8493 leader_election.cc:288] T 00000000000000000000000000000000 P 946f077f2bef4231ab778710ffc5b1ee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:14:17.335515 8510 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 946f077f2bef4231ab778710ffc5b1ee [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:14:17.336133 8510 raft_consensus.cc:686] T 00000000000000000000000000000000 P 946f077f2bef4231ab778710ffc5b1ee [term 1 LEADER]: Becoming Leader. State: Replica: 946f077f2bef4231ab778710ffc5b1ee, State: Running, Role: LEADER
I20260809 19:14:17.336661 8510 consensus_queue.cc:237] T 00000000000000000000000000000000 P 946f077f2bef4231ab778710ffc5b1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "946f077f2bef4231ab778710ffc5b1ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32873 } }
I20260809 19:14:17.337373 8493 sys_catalog.cc:564] T 00000000000000000000000000000000 P 946f077f2bef4231ab778710ffc5b1ee [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:14:17.339512 8513 sys_catalog.cc:455] T 00000000000000000000000000000000 P 946f077f2bef4231ab778710ffc5b1ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "946f077f2bef4231ab778710ffc5b1ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "946f077f2bef4231ab778710ffc5b1ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32873 } } }
I20260809 19:14:17.339555 8516 sys_catalog.cc:455] T 00000000000000000000000000000000 P 946f077f2bef4231ab778710ffc5b1ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 946f077f2bef4231ab778710ffc5b1ee. Latest consensus state: current_term: 1 leader_uuid: "946f077f2bef4231ab778710ffc5b1ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "946f077f2bef4231ab778710ffc5b1ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32873 } } }
I20260809 19:14:17.340090 8516 sys_catalog.cc:458] T 00000000000000000000000000000000 P 946f077f2bef4231ab778710ffc5b1ee [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:17.340767 8513 sys_catalog.cc:458] T 00000000000000000000000000000000 P 946f077f2bef4231ab778710ffc5b1ee [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:17.345409 8522 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:14:17.349571 8522 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:14:17.356992 8522 catalog_manager.cc:1347] Generated new cluster ID: 200eb3e74b4242298991ef120b2f75f4
I20260809 19:14:17.357103 8522 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:14:17.392868 8522 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:14:17.393337 8522 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:14:17.400704 8522 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 946f077f2bef4231ab778710ffc5b1ee: Generated new TSK 0
I20260809 19:14:17.401445 8522 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:14:17.406793 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 8391
W20260809 19:14:17.407778 8485 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:49353
W20260809 19:14:17.408560 7324 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 8391: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 19:14:17.408692 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 8391
2026-08-09T19:14:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1959 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:14:17 dist-test-slave-4tdj krb5kdc[8539](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:14:17 dist-test-slave-4tdj krb5kdc[8539](info): set up 2 sockets
Aug 09 19:14:17 dist-test-slave-4tdj krb5kdc[8539](info): commencing operation
krb5kdc: starting...
W20260809 19:14:18.628258 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.179s user 0.006s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:14:18 dist-test-slave-4tdj krb5kdc[8539](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302858, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:14:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:14:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:14:18.877261 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37421
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37421
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:14:19.202232 8559 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:19.202661 8559 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:19.202827 8559 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:19.211249 8559 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:14:19.211354 8559 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:19.211433 8559 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:19.211544 8559 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:14:19.211603 8559 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:14:19.221859 8559 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37421
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37421
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:19.223369 8559 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:19.225108 8559 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:19.236955 8565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:19.237049 8570 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:19.237092 8566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:19.237865 8559 server_base.cc:1034] running on GCE node
I20260809 19:14:19.238656 8559 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:19.239966 8559 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:19.241166 8559 hybrid_clock.cc:648] HybridClock initialized: now 1786302859241121 us; error 33 us; skew 500 ppm
I20260809 19:14:19.241483 8559 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:14:19 dist-test-slave-4tdj krb5kdc[8539](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302859, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:14:19.244457 8559 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:14:19.245824 8559 webserver.cc:460] Webserver started at http://127.0.0.1:40757/ using document root <none> and password file <none>
I20260809 19:14:19.246517 8559 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:19.246650 8559 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:19.246927 8559 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:19.249764 8559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "ac2d26e803f242208542d5c8bf51a4f0"
format_stamp: "Formatted at 2026-08-09 19:14:19 on dist-test-slave-4tdj"
server_key: "205d9ac5a50fc0fcdb0667a6cdd7be07"
server_key_iv: "ef4a9db4987e7add8aa9def9d5a96667"
server_key_version: "encryptionkey@0"
I20260809 19:14:19.250535 8559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "ac2d26e803f242208542d5c8bf51a4f0"
format_stamp: "Formatted at 2026-08-09 19:14:19 on dist-test-slave-4tdj"
server_key: "205d9ac5a50fc0fcdb0667a6cdd7be07"
server_key_iv: "ef4a9db4987e7add8aa9def9d5a96667"
server_key_version: "encryptionkey@0"
I20260809 19:14:19.255343 8559 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 19:14:19.258570 8579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:19.259785 8559 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 19:14:19.259954 8559 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "ac2d26e803f242208542d5c8bf51a4f0"
format_stamp: "Formatted at 2026-08-09 19:14:19 on dist-test-slave-4tdj"
server_key: "205d9ac5a50fc0fcdb0667a6cdd7be07"
server_key_iv: "ef4a9db4987e7add8aa9def9d5a96667"
server_key_version: "encryptionkey@0"
I20260809 19:14:19.260124 8559 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:19.276156 8559 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:19.280135 8559 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:19.280381 8559 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:19.297261 8559 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37421
I20260809 19:14:19.297290 8656 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37421 every 8 connection(s)
I20260809 19:14:19.298543 8559 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:14:19.299082 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 8559
I20260809 19:14:19.299291 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:14:19.299811 7324 external_mini_cluster.cc:1428] Setting key 0a77b0ef8f25ead6f12c4d8ce7fd942d
I20260809 19:14:19.303002 8657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 19:14:19 dist-test-slave-4tdj krb5kdc[8539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302858, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 19:14:19.315073 8657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac2d26e803f242208542d5c8bf51a4f0: Bootstrap starting.
I20260809 19:14:19.319116 8657 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ac2d26e803f242208542d5c8bf51a4f0: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:19.320297 8657 log.cc:824] T 00000000000000000000000000000000 P ac2d26e803f242208542d5c8bf51a4f0: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:19.323575 8657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac2d26e803f242208542d5c8bf51a4f0: No bootstrap required, opened a new log
I20260809 19:14:19.323594 8661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:19.301499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39141 (local address 127.0.0.1:37421)
0809 19:14:19.302335 (+ 836us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:19.302349 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:19.302400 (+ 51us) server_negotiation.cc:407] Connection header received
0809 19:14:19.304616 (+ 2216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:19.304642 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:19.305089 (+ 447us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:19.305521 (+ 432us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:19.306820 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:19.308825 (+ 2005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:19.310136 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:19.311143 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:19.311386 (+ 243us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:19.315345 (+ 3959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:19.315356 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:19.315374 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:19.315424 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:19.319228 (+ 3804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:19.319872 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:19.319881 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:19.319889 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:19.320100 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:19.320435 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:19.320440 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:19.320443 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:19.321120 (+ 677us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:19.321348 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:19.321861 (+ 513us) server_negotiation.cc:299] Negotiation successful
0809 19:14:19.322264 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":580,"thread_start_us":333,"threads_started":1}
I20260809 19:14:19.327037 7324 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:14:19.331545 8657 raft_consensus.cc:348] T 00000000000000000000000000000000 P ac2d26e803f242208542d5c8bf51a4f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac2d26e803f242208542d5c8bf51a4f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37421 } }
I20260809 19:14:19.331875 8657 raft_consensus.cc:374] T 00000000000000000000000000000000 P ac2d26e803f242208542d5c8bf51a4f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:14:19.331969 8657 raft_consensus.cc:729] T 00000000000000000000000000000000 P ac2d26e803f242208542d5c8bf51a4f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac2d26e803f242208542d5c8bf51a4f0, State: Initialized, Role: FOLLOWER
I20260809 19:14:19.332475 8657 consensus_queue.cc:260] T 00000000000000000000000000000000 P ac2d26e803f242208542d5c8bf51a4f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac2d26e803f242208542d5c8bf51a4f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37421 } }
I20260809 19:14:19.332705 8657 raft_consensus.cc:388] T 00000000000000000000000000000000 P ac2d26e803f242208542d5c8bf51a4f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:14:19.332821 8657 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac2d26e803f242208542d5c8bf51a4f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:14:19.332974 8657 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac2d26e803f242208542d5c8bf51a4f0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:19.335184 8657 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac2d26e803f242208542d5c8bf51a4f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac2d26e803f242208542d5c8bf51a4f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37421 } }
I20260809 19:14:19.335712 8657 leader_election.cc:302] T 00000000000000000000000000000000 P ac2d26e803f242208542d5c8bf51a4f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ac2d26e803f242208542d5c8bf51a4f0; no voters:
I20260809 19:14:19.336403 8657 leader_election.cc:288] T 00000000000000000000000000000000 P ac2d26e803f242208542d5c8bf51a4f0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:14:19.336506 8669 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ac2d26e803f242208542d5c8bf51a4f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:14:19.338172 8657 sys_catalog.cc:564] T 00000000000000000000000000000000 P ac2d26e803f242208542d5c8bf51a4f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:14:19.339571 8669 raft_consensus.cc:686] T 00000000000000000000000000000000 P ac2d26e803f242208542d5c8bf51a4f0 [term 1 LEADER]: Becoming Leader. State: Replica: ac2d26e803f242208542d5c8bf51a4f0, State: Running, Role: LEADER
I20260809 19:14:19.340557 8669 consensus_queue.cc:237] T 00000000000000000000000000000000 P ac2d26e803f242208542d5c8bf51a4f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac2d26e803f242208542d5c8bf51a4f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37421 } }
I20260809 19:14:19.343981 8672 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac2d26e803f242208542d5c8bf51a4f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac2d26e803f242208542d5c8bf51a4f0. Latest consensus state: current_term: 1 leader_uuid: "ac2d26e803f242208542d5c8bf51a4f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac2d26e803f242208542d5c8bf51a4f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37421 } } }
I20260809 19:14:19.344369 8672 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac2d26e803f242208542d5c8bf51a4f0 [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:19.344900 8671 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac2d26e803f242208542d5c8bf51a4f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ac2d26e803f242208542d5c8bf51a4f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac2d26e803f242208542d5c8bf51a4f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37421 } } }
I20260809 19:14:19.345234 8671 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac2d26e803f242208542d5c8bf51a4f0 [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:19.347395 8661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:19.330971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38353 (local address 127.0.0.1:37421)
0809 19:14:19.331115 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:19.331121 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:19.331508 (+ 387us) server_negotiation.cc:407] Connection header received
0809 19:14:19.331674 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:19.331679 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:19.331736 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:19.331811 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:19.333335 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:19.334099 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:19.335413 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:19.336070 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:19.336212 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:19.339188 (+ 2976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:19.339196 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:19.339201 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:19.339244 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:19.343350 (+ 4106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:19.344260 (+ 910us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:19.344265 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:19.344268 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:19.344467 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:19.344963 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:19.344969 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:19.344972 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:19.345388 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:19.345654 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:19.346780 (+ 1126us) server_negotiation.cc:299] Negotiation successful
0809 19:14:19.346998 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 19:14:19.350323 8699 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:14:19.355194 8699 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:14:19.363755 8699 catalog_manager.cc:1347] Generated new cluster ID: a70ee82c25964c759c169eb6c50b1588
I20260809 19:14:19.363863 8699 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:14:19.392699 8699 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:14:19.393894 8699 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:14:19.401114 8699 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ac2d26e803f242208542d5c8bf51a4f0: Generated new TSK 0
I20260809 19:14:19.401810 8699 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:14:19.407050 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 8559
I20260809 19:14:19.408156 8651 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:14:19.497098 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 8559
2026-08-09T19:14:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2085 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:14:19 dist-test-slave-4tdj krb5kdc[8720](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:14:19 dist-test-slave-4tdj krb5kdc[8720](info): set up 2 sockets
Aug 09 19:14:19 dist-test-slave-4tdj krb5kdc[8720](info): commencing operation
krb5kdc: starting...
W20260809 19:14:20.708896 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.174s user 0.006s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:14:20 dist-test-slave-4tdj krb5kdc[8720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:14:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:14:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:14:20.962925 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39503
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39503
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:14:21.291978 8741 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:21.292271 8741 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:21.292414 8741 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:21.299342 8741 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:14:21.299456 8741 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:21.299536 8741 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:21.299623 8741 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:14:21.299686 8741 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:14:21.309079 8741 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39503
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39503
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:21.310312 8741 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:21.311599 8741 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:21.322819 8751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:21.322779 8748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:21.323225 8747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:21.323909 8741 server_base.cc:1034] running on GCE node
I20260809 19:14:21.324659 8741 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:21.325970 8741 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:21.327148 8741 hybrid_clock.cc:648] HybridClock initialized: now 1786302861327101 us; error 42 us; skew 500 ppm
I20260809 19:14:21.327461 8741 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:14:21 dist-test-slave-4tdj krb5kdc[8720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302861, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:14:21.330605 8741 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:14:21.331943 8741 webserver.cc:460] Webserver started at http://127.0.0.1:34013/ using document root <none> and password file <none>
I20260809 19:14:21.332566 8741 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:21.332661 8741 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:21.332906 8741 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:21.335909 8741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "375840a378124f0c83f51207f9751c8f"
format_stamp: "Formatted at 2026-08-09 19:14:21 on dist-test-slave-4tdj"
server_key: "3697dbcc14d2a4cc2bdcfd165920d645"
server_key_iv: "d7903f5e868fd9824c0725b60d2384e8"
server_key_version: "encryptionkey@0"
I20260809 19:14:21.336604 8741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "375840a378124f0c83f51207f9751c8f"
format_stamp: "Formatted at 2026-08-09 19:14:21 on dist-test-slave-4tdj"
server_key: "3697dbcc14d2a4cc2bdcfd165920d645"
server_key_iv: "d7903f5e868fd9824c0725b60d2384e8"
server_key_version: "encryptionkey@0"
I20260809 19:14:21.341373 8741 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 19:14:21.344558 8760 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:21.345790 8741 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 19:14:21.345927 8741 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "375840a378124f0c83f51207f9751c8f"
format_stamp: "Formatted at 2026-08-09 19:14:21 on dist-test-slave-4tdj"
server_key: "3697dbcc14d2a4cc2bdcfd165920d645"
server_key_iv: "d7903f5e868fd9824c0725b60d2384e8"
server_key_version: "encryptionkey@0"
I20260809 19:14:21.346077 8741 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:21.360448 8741 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:21.363859 8741 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:21.364081 8741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:21.380437 8741 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39503
I20260809 19:14:21.380491 8841 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39503 every 8 connection(s)
I20260809 19:14:21.381615 8741 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:14:21.384940 8842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:21.386154 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 8741
I20260809 19:14:21.386336 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:14:21.386767 7324 external_mini_cluster.cc:1428] Setting key 1cbdf1e63ef88ee601f6d73c730afc6f
I20260809 19:14:21.397683 8842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 375840a378124f0c83f51207f9751c8f: Bootstrap starting.
I20260809 19:14:21.399111 8849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:21.388362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33365 (local address 127.0.0.1:39503)
0809 19:14:21.389090 (+ 728us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:21.389100 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:21.389142 (+ 42us) server_negotiation.cc:407] Connection header received
0809 19:14:21.390772 (+ 1630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:21.390793 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:21.391150 (+ 357us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:21.391456 (+ 306us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:21.392024 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:21.393240 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:21.395110 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:21.395767 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:21.395884 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:21.397032 (+ 1148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:21.397039 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:21.397050 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:21.397545 (+ 495us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:21.397616 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:21.397640 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:21.397725 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:21.397951 (+ 226us) server_negotiation.cc:299] Negotiation successful
0809 19:14:21.398166 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":532,"thread_start_us":331,"threads_started":1}
I20260809 19:14:21.401065 8842 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 375840a378124f0c83f51207f9751c8f: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:21.402230 8842 log.cc:824] T 00000000000000000000000000000000 P 375840a378124f0c83f51207f9751c8f: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:21.402738 7324 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:14:21.405110 8842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 375840a378124f0c83f51207f9751c8f: No bootstrap required, opened a new log
I20260809 19:14:21.413314 8849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:21.407318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47879 (local address 127.0.0.1:39503)
0809 19:14:21.407483 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:21.407488 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:21.407878 (+ 390us) server_negotiation.cc:407] Connection header received
0809 19:14:21.408011 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:21.408016 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:21.408096 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:21.408195 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:21.408624 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:21.409676 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:21.410947 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:21.411659 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:21.411779 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:21.412643 (+ 864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:21.412649 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:21.412653 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:21.412676 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:21.412725 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:21.412744 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:21.412831 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:21.412923 (+ 92us) server_negotiation.cc:299] Negotiation successful
0809 19:14:21.413010 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 19:14:21.414276 8842 raft_consensus.cc:348] T 00000000000000000000000000000000 P 375840a378124f0c83f51207f9751c8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "375840a378124f0c83f51207f9751c8f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39503 } }
I20260809 19:14:21.414677 8842 raft_consensus.cc:374] T 00000000000000000000000000000000 P 375840a378124f0c83f51207f9751c8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:14:21.414765 8842 raft_consensus.cc:729] T 00000000000000000000000000000000 P 375840a378124f0c83f51207f9751c8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 375840a378124f0c83f51207f9751c8f, State: Initialized, Role: FOLLOWER
I20260809 19:14:21.415338 8842 consensus_queue.cc:260] T 00000000000000000000000000000000 P 375840a378124f0c83f51207f9751c8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "375840a378124f0c83f51207f9751c8f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39503 } }
I20260809 19:14:21.415560 8842 raft_consensus.cc:388] T 00000000000000000000000000000000 P 375840a378124f0c83f51207f9751c8f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:14:21.415688 8842 raft_consensus.cc:482] T 00000000000000000000000000000000 P 375840a378124f0c83f51207f9751c8f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:14:21.415838 8842 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 375840a378124f0c83f51207f9751c8f [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:21.417831 8842 raft_consensus.cc:504] T 00000000000000000000000000000000 P 375840a378124f0c83f51207f9751c8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "375840a378124f0c83f51207f9751c8f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39503 } }
I20260809 19:14:21.418308 8842 leader_election.cc:302] T 00000000000000000000000000000000 P 375840a378124f0c83f51207f9751c8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 375840a378124f0c83f51207f9751c8f; no voters:
I20260809 19:14:21.418874 8842 leader_election.cc:288] T 00000000000000000000000000000000 P 375840a378124f0c83f51207f9751c8f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:14:21.418972 8861 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 375840a378124f0c83f51207f9751c8f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:14:21.420233 8861 raft_consensus.cc:686] T 00000000000000000000000000000000 P 375840a378124f0c83f51207f9751c8f [term 1 LEADER]: Becoming Leader. State: Replica: 375840a378124f0c83f51207f9751c8f, State: Running, Role: LEADER
I20260809 19:14:21.420794 8842 sys_catalog.cc:564] T 00000000000000000000000000000000 P 375840a378124f0c83f51207f9751c8f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:14:21.420712 8861 consensus_queue.cc:237] T 00000000000000000000000000000000 P 375840a378124f0c83f51207f9751c8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "375840a378124f0c83f51207f9751c8f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39503 } }
I20260809 19:14:21.423310 8865 sys_catalog.cc:455] T 00000000000000000000000000000000 P 375840a378124f0c83f51207f9751c8f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 375840a378124f0c83f51207f9751c8f. Latest consensus state: current_term: 1 leader_uuid: "375840a378124f0c83f51207f9751c8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "375840a378124f0c83f51207f9751c8f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39503 } } }
I20260809 19:14:21.423435 8863 sys_catalog.cc:455] T 00000000000000000000000000000000 P 375840a378124f0c83f51207f9751c8f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "375840a378124f0c83f51207f9751c8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "375840a378124f0c83f51207f9751c8f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39503 } } }
I20260809 19:14:21.423697 8863 sys_catalog.cc:458] T 00000000000000000000000000000000 P 375840a378124f0c83f51207f9751c8f [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:21.423697 8865 sys_catalog.cc:458] T 00000000000000000000000000000000 P 375840a378124f0c83f51207f9751c8f [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:21.425669 8880 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:14:21.430459 8880 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:14:21.438835 8880 catalog_manager.cc:1347] Generated new cluster ID: 25388416f84a49ffb53bc8fc93126f53
I20260809 19:14:21.438939 8880 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:14:21.466885 8880 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:14:21.468420 8880 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:14:21.475793 8880 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 375840a378124f0c83f51207f9751c8f: Generated new TSK 0
I20260809 19:14:21.476743 8880 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:14:21.485086 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 8741
W20260809 19:14:21.486171 8835 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:33365
W20260809 19:14:21.486788 7324 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 8741: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 19:14:21.486946 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 8741
2026-08-09T19:14:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2001 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:14:21 dist-test-slave-4tdj krb5kdc[8895](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:14:21 dist-test-slave-4tdj krb5kdc[8895](info): set up 2 sockets
Aug 09 19:14:21 dist-test-slave-4tdj krb5kdc[8895](info): commencing operation
krb5kdc: starting...
W20260809 19:14:22.706122 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.169s user 0.000s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:14:22 dist-test-slave-4tdj krb5kdc[8895](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302862, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:14:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:14:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:14:22.961403 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42247
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42247
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:14:23.286118 8916 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:23.286438 8916 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:23.286567 8916 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:23.293359 8916 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:14:23.293452 8916 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:23.293507 8916 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:23.293589 8916 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:14:23.293649 8916 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:14:23.303033 8916 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42247
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42247
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:23.304153 8916 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:23.305425 8916 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:23.316035 8922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:23.316097 8926 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:23.316191 8923 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:23.317327 8916 server_base.cc:1034] running on GCE node
I20260809 19:14:23.318068 8916 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:23.319541 8916 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:23.320739 8916 hybrid_clock.cc:648] HybridClock initialized: now 1786302863320689 us; error 44 us; skew 500 ppm
I20260809 19:14:23.321053 8916 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:14:23 dist-test-slave-4tdj krb5kdc[8895](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302863, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:14:23.323907 8916 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:14:23.325232 8916 webserver.cc:460] Webserver started at http://127.0.0.1:33959/ using document root <none> and password file <none>
I20260809 19:14:23.325855 8916 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:23.325968 8916 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:23.326253 8916 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:23.329015 8916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "b255fc49364f44bdb92dec3f190ec3b7"
format_stamp: "Formatted at 2026-08-09 19:14:23 on dist-test-slave-4tdj"
server_key: "f0e1a9e8269a8f1c3859ed60f0226e61"
server_key_iv: "6ce2967b17d8c85a82d1bc0c0bde542c"
server_key_version: "encryptionkey@0"
I20260809 19:14:23.329723 8916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "b255fc49364f44bdb92dec3f190ec3b7"
format_stamp: "Formatted at 2026-08-09 19:14:23 on dist-test-slave-4tdj"
server_key: "f0e1a9e8269a8f1c3859ed60f0226e61"
server_key_iv: "6ce2967b17d8c85a82d1bc0c0bde542c"
server_key_version: "encryptionkey@0"
I20260809 19:14:23.334421 8916 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 19:14:23.337494 8937 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:23.338704 8916 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 19:14:23.338861 8916 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "b255fc49364f44bdb92dec3f190ec3b7"
format_stamp: "Formatted at 2026-08-09 19:14:23 on dist-test-slave-4tdj"
server_key: "f0e1a9e8269a8f1c3859ed60f0226e61"
server_key_iv: "6ce2967b17d8c85a82d1bc0c0bde542c"
server_key_version: "encryptionkey@0"
I20260809 19:14:23.339027 8916 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:23.344201 8916 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:23.347685 8916 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:23.347935 8916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:23.364468 8916 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42247
I20260809 19:14:23.364519 9027 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42247 every 8 connection(s)
I20260809 19:14:23.365751 8916 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:14:23.366729 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 8916
I20260809 19:14:23.366914 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:14:23.367470 7324 external_mini_cluster.cc:1428] Setting key dacb83c20cb0a5361273c74ada08444b
I20260809 19:14:23.369921 9032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:23.374683 9037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:23.369104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53677 (local address 127.0.0.1:42247)
0809 19:14:23.369830 (+ 726us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:23.369842 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:23.369881 (+ 39us) server_negotiation.cc:407] Connection header received
0809 19:14:23.371547 (+ 1666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:23.371574 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:23.371921 (+ 347us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:23.372293 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:23.373211 (+ 918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:23.373217 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:23.373229 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:23.373242 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:23.373311 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:23.373332 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:23.373499 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:23.373602 (+ 103us) server_negotiation.cc:299] Negotiation successful
0809 19:14:23.373766 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":522,"thread_start_us":311,"threads_started":1}
I20260809 19:14:23.377807 7324 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:14:23.381875 9032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b255fc49364f44bdb92dec3f190ec3b7: Bootstrap starting.
I20260809 19:14:23.384713 9037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:23.382595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35115 (local address 127.0.0.1:42247)
0809 19:14:23.382748 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:23.382753 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:23.383171 (+ 418us) server_negotiation.cc:407] Connection header received
0809 19:14:23.383300 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:23.383306 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:23.383365 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:23.383474 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:23.384183 (+ 709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:23.384188 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:23.384192 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:23.384208 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:23.384250 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:23.384268 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:23.384374 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:23.384418 (+ 44us) server_negotiation.cc:299] Negotiation successful
0809 19:14:23.384467 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 19:14:23.385308 9032 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b255fc49364f44bdb92dec3f190ec3b7: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:23.386282 9032 log.cc:824] T 00000000000000000000000000000000 P b255fc49364f44bdb92dec3f190ec3b7: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:23.388644 9032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b255fc49364f44bdb92dec3f190ec3b7: No bootstrap required, opened a new log
I20260809 19:14:23.395262 9032 raft_consensus.cc:348] T 00000000000000000000000000000000 P b255fc49364f44bdb92dec3f190ec3b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b255fc49364f44bdb92dec3f190ec3b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42247 } }
I20260809 19:14:23.395581 9032 raft_consensus.cc:374] T 00000000000000000000000000000000 P b255fc49364f44bdb92dec3f190ec3b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:14:23.395668 9032 raft_consensus.cc:729] T 00000000000000000000000000000000 P b255fc49364f44bdb92dec3f190ec3b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b255fc49364f44bdb92dec3f190ec3b7, State: Initialized, Role: FOLLOWER
I20260809 19:14:23.396152 9032 consensus_queue.cc:260] T 00000000000000000000000000000000 P b255fc49364f44bdb92dec3f190ec3b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b255fc49364f44bdb92dec3f190ec3b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42247 } }
I20260809 19:14:23.396354 9032 raft_consensus.cc:388] T 00000000000000000000000000000000 P b255fc49364f44bdb92dec3f190ec3b7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:14:23.396477 9032 raft_consensus.cc:482] T 00000000000000000000000000000000 P b255fc49364f44bdb92dec3f190ec3b7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:14:23.396644 9032 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b255fc49364f44bdb92dec3f190ec3b7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:23.398630 9032 raft_consensus.cc:504] T 00000000000000000000000000000000 P b255fc49364f44bdb92dec3f190ec3b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b255fc49364f44bdb92dec3f190ec3b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42247 } }
I20260809 19:14:23.399065 9032 leader_election.cc:302] T 00000000000000000000000000000000 P b255fc49364f44bdb92dec3f190ec3b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b255fc49364f44bdb92dec3f190ec3b7; no voters:
I20260809 19:14:23.399540 9032 leader_election.cc:288] T 00000000000000000000000000000000 P b255fc49364f44bdb92dec3f190ec3b7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:14:23.399649 9052 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b255fc49364f44bdb92dec3f190ec3b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:14:23.400652 9052 raft_consensus.cc:686] T 00000000000000000000000000000000 P b255fc49364f44bdb92dec3f190ec3b7 [term 1 LEADER]: Becoming Leader. State: Replica: b255fc49364f44bdb92dec3f190ec3b7, State: Running, Role: LEADER
I20260809 19:14:23.401175 9052 consensus_queue.cc:237] T 00000000000000000000000000000000 P b255fc49364f44bdb92dec3f190ec3b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b255fc49364f44bdb92dec3f190ec3b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42247 } }
I20260809 19:14:23.401373 9032 sys_catalog.cc:564] T 00000000000000000000000000000000 P b255fc49364f44bdb92dec3f190ec3b7 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:14:23.403548 9056 sys_catalog.cc:455] T 00000000000000000000000000000000 P b255fc49364f44bdb92dec3f190ec3b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b255fc49364f44bdb92dec3f190ec3b7. Latest consensus state: current_term: 1 leader_uuid: "b255fc49364f44bdb92dec3f190ec3b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b255fc49364f44bdb92dec3f190ec3b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42247 } } }
I20260809 19:14:23.403947 9056 sys_catalog.cc:458] T 00000000000000000000000000000000 P b255fc49364f44bdb92dec3f190ec3b7 [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:23.404784 9055 sys_catalog.cc:455] T 00000000000000000000000000000000 P b255fc49364f44bdb92dec3f190ec3b7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b255fc49364f44bdb92dec3f190ec3b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b255fc49364f44bdb92dec3f190ec3b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42247 } } }
I20260809 19:14:23.405081 9055 sys_catalog.cc:458] T 00000000000000000000000000000000 P b255fc49364f44bdb92dec3f190ec3b7 [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:23.407166 9063 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:14:23.411916 9063 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:14:23.420300 9063 catalog_manager.cc:1347] Generated new cluster ID: ea90d119a1224467bcd60655766a6c1b
I20260809 19:14:23.420389 9063 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:14:23.440312 9063 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:14:23.440764 9063 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:14:23.451664 9063 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b255fc49364f44bdb92dec3f190ec3b7: Generated new TSK 0
I20260809 19:14:23.452533 9063 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:14:23.464068 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 8916
W20260809 19:14:23.465065 9023 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:53677
W20260809 19:14:23.465701 7324 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 8916: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 19:14:23.465847 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 8916
2026-08-09T19:14:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1971 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:14:23 dist-test-slave-4tdj krb5kdc[9087](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:14:23 dist-test-slave-4tdj krb5kdc[9087](info): set up 2 sockets
Aug 09 19:14:23 dist-test-slave-4tdj krb5kdc[9087](info): commencing operation
krb5kdc: starting...
W20260809 19:14:24.680181 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.171s user 0.000s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:14:24 dist-test-slave-4tdj krb5kdc[9087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302864, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:14:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:14:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:14:24.925055 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32793
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:32793
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:14:25.247380 9108 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:25.247648 9108 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:25.247787 9108 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:25.254724 9108 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:14:25.254832 9108 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:25.254906 9108 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:25.254990 9108 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:14:25.255050 9108 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:14:25.264392 9108 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:32793
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32793
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:25.265537 9108 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:25.266800 9108 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:25.277773 9119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:25.277827 9116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:25.277855 9117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:25.278837 9108 server_base.cc:1034] running on GCE node
I20260809 19:14:25.279532 9108 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:25.280745 9108 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:25.281939 9108 hybrid_clock.cc:648] HybridClock initialized: now 1786302865281895 us; error 38 us; skew 500 ppm
I20260809 19:14:25.282251 9108 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:14:25 dist-test-slave-4tdj krb5kdc[9087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302865, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:14:25.285076 9108 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:14:25.286424 9108 webserver.cc:460] Webserver started at http://127.0.0.1:45771/ using document root <none> and password file <none>
I20260809 19:14:25.287055 9108 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:25.287164 9108 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:25.287439 9108 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:25.290150 9108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "03f47fb602be428e825d72b659cea3b0"
format_stamp: "Formatted at 2026-08-09 19:14:25 on dist-test-slave-4tdj"
server_key: "18684108e16342d90944e8d73c9911c9"
server_key_iv: "33083c8adadd399e9b95082f4f1e3e7a"
server_key_version: "encryptionkey@0"
I20260809 19:14:25.290879 9108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "03f47fb602be428e825d72b659cea3b0"
format_stamp: "Formatted at 2026-08-09 19:14:25 on dist-test-slave-4tdj"
server_key: "18684108e16342d90944e8d73c9911c9"
server_key_iv: "33083c8adadd399e9b95082f4f1e3e7a"
server_key_version: "encryptionkey@0"
I20260809 19:14:25.295488 9108 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260809 19:14:25.298686 9132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:25.299860 9108 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 19:14:25.300025 9108 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "03f47fb602be428e825d72b659cea3b0"
format_stamp: "Formatted at 2026-08-09 19:14:25 on dist-test-slave-4tdj"
server_key: "18684108e16342d90944e8d73c9911c9"
server_key_iv: "33083c8adadd399e9b95082f4f1e3e7a"
server_key_version: "encryptionkey@0"
I20260809 19:14:25.300206 9108 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:25.319417 9108 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:25.323292 9108 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:25.323539 9108 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:25.340547 9108 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:32793
I20260809 19:14:25.340579 9210 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:32793 every 8 connection(s)
I20260809 19:14:25.341782 9108 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:14:25.344491 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 9108
I20260809 19:14:25.344655 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:14:25.345098 7324 external_mini_cluster.cc:1428] Setting key 32426b22cb4968f3236ec2fd16b33be3
I20260809 19:14:25.345439 9211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:25.358912 9211 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03f47fb602be428e825d72b659cea3b0: Bootstrap starting.
Aug 09 19:14:25 dist-test-slave-4tdj krb5kdc[9087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302864, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 19:14:25.362432 9211 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 03f47fb602be428e825d72b659cea3b0: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:25.363751 9211 log.cc:824] T 00000000000000000000000000000000 P 03f47fb602be428e825d72b659cea3b0: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:25.367017 9211 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03f47fb602be428e825d72b659cea3b0: No bootstrap required, opened a new log
I20260809 19:14:25.368551 9214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:25.346779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.56:43971 (local address 127.0.0.1:32793)
0809 19:14:25.347562 (+ 783us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:25.347577 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:25.347625 (+ 48us) server_negotiation.cc:407] Connection header received
0809 19:14:25.349940 (+ 2315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:25.349968 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:25.350514 (+ 546us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:25.350927 (+ 413us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:25.352206 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:25.354112 (+ 1906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:25.355361 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:25.356411 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:25.356597 (+ 186us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:25.360447 (+ 3850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:25.360457 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:25.360475 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:25.360519 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:25.364120 (+ 3601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:25.365017 (+ 897us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:25.365024 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:25.365032 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:25.365243 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:25.365656 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:25.365661 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:25.365664 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:25.366345 (+ 681us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:25.366642 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:25.366998 (+ 356us) server_negotiation.cc:299] Negotiation successful
0809 19:14:25.367317 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":314,"threads_started":1}
I20260809 19:14:25.372140 7324 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:14:25.376361 9211 raft_consensus.cc:348] T 00000000000000000000000000000000 P 03f47fb602be428e825d72b659cea3b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f47fb602be428e825d72b659cea3b0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32793 } }
I20260809 19:14:25.376791 9211 raft_consensus.cc:374] T 00000000000000000000000000000000 P 03f47fb602be428e825d72b659cea3b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:14:25.376900 9211 raft_consensus.cc:729] T 00000000000000000000000000000000 P 03f47fb602be428e825d72b659cea3b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03f47fb602be428e825d72b659cea3b0, State: Initialized, Role: FOLLOWER
I20260809 19:14:25.377604 9211 consensus_queue.cc:260] T 00000000000000000000000000000000 P 03f47fb602be428e825d72b659cea3b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f47fb602be428e825d72b659cea3b0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32793 } }
I20260809 19:14:25.377843 9211 raft_consensus.cc:388] T 00000000000000000000000000000000 P 03f47fb602be428e825d72b659cea3b0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:14:25.377985 9211 raft_consensus.cc:482] T 00000000000000000000000000000000 P 03f47fb602be428e825d72b659cea3b0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:14:25.378187 9211 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 03f47fb602be428e825d72b659cea3b0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:25.380730 9211 raft_consensus.cc:504] T 00000000000000000000000000000000 P 03f47fb602be428e825d72b659cea3b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f47fb602be428e825d72b659cea3b0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32793 } }
I20260809 19:14:25.381173 9211 leader_election.cc:302] T 00000000000000000000000000000000 P 03f47fb602be428e825d72b659cea3b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 03f47fb602be428e825d72b659cea3b0; no voters:
I20260809 19:14:25.381771 9211 leader_election.cc:288] T 00000000000000000000000000000000 P 03f47fb602be428e825d72b659cea3b0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:14:25.381861 9223 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 03f47fb602be428e825d72b659cea3b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:14:25.384016 9211 sys_catalog.cc:564] T 00000000000000000000000000000000 P 03f47fb602be428e825d72b659cea3b0 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:14:25.388870 9223 raft_consensus.cc:686] T 00000000000000000000000000000000 P 03f47fb602be428e825d72b659cea3b0 [term 1 LEADER]: Becoming Leader. State: Replica: 03f47fb602be428e825d72b659cea3b0, State: Running, Role: LEADER
I20260809 19:14:25.389541 9223 consensus_queue.cc:237] T 00000000000000000000000000000000 P 03f47fb602be428e825d72b659cea3b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f47fb602be428e825d72b659cea3b0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32793 } }
I20260809 19:14:25.392694 9227 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03f47fb602be428e825d72b659cea3b0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "03f47fb602be428e825d72b659cea3b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f47fb602be428e825d72b659cea3b0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32793 } } }
I20260809 19:14:25.393153 9227 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03f47fb602be428e825d72b659cea3b0 [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:25.393164 9214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:25.377246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.56:56643 (local address 127.0.0.1:32793)
0809 19:14:25.377407 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:25.377413 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:25.377754 (+ 341us) server_negotiation.cc:407] Connection header received
0809 19:14:25.377903 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:25.377909 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:25.377999 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:25.378100 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:25.379431 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:25.380501 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:25.381987 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:25.382851 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:25.382993 (+ 142us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:25.385788 (+ 2795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:25.385793 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:25.385796 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:25.385828 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:25.388796 (+ 2968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:25.389724 (+ 928us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:25.389731 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:25.389734 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:25.389905 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:25.390458 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:25.390463 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:25.390467 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:25.390951 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:25.392277 (+ 1326us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:25.392484 (+ 207us) server_negotiation.cc:299] Negotiation successful
0809 19:14:25.392681 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 19:14:25.393690 9228 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03f47fb602be428e825d72b659cea3b0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03f47fb602be428e825d72b659cea3b0. Latest consensus state: current_term: 1 leader_uuid: "03f47fb602be428e825d72b659cea3b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f47fb602be428e825d72b659cea3b0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32793 } } }
I20260809 19:14:25.393982 9228 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03f47fb602be428e825d72b659cea3b0 [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:25.394079 9241 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:14:25.405484 9241 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:14:25.414711 9241 catalog_manager.cc:1347] Generated new cluster ID: 31ff5cc4df87469e83eec626f95454c3
I20260809 19:14:25.414809 9241 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:14:25.423949 9241 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:14:25.425088 9241 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:14:25.435982 9241 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 03f47fb602be428e825d72b659cea3b0: Generated new TSK 0
I20260809 19:14:25.436676 9241 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:14:25.442838 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 9108
I20260809 19:14:25.443948 9206 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:14:25.530062 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 9108
W20260809 19:14:25.551935 9085 connection.cc:535] client connection to 127.0.0.1:32793 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:32793): Connection reset by peer (error 104)
2026-08-09T19:14:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2061 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:14:25 dist-test-slave-4tdj krb5kdc[9261](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:14:25 dist-test-slave-4tdj krb5kdc[9261](info): set up 2 sockets
Aug 09 19:14:25 dist-test-slave-4tdj krb5kdc[9261](info): commencing operation
krb5kdc: starting...
W20260809 19:14:26.751368 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.181s user 0.005s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:14:26 dist-test-slave-4tdj krb5kdc[9261](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302866, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:14:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:14:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:14:27.004987 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35121
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35121
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:14:27.339670 9281 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:27.339980 9281 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:27.340137 9281 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:27.347182 9281 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:14:27.347309 9281 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:27.347399 9281 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:27.347494 9281 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:14:27.347565 9281 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:14:27.357039 9281 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35121
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35121
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:27.358222 9281 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:27.359519 9281 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:27.370919 9292 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:27.370951 9295 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:27.371026 9290 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:27.372048 9281 server_base.cc:1034] running on GCE node
I20260809 19:14:27.372835 9281 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:27.374117 9281 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:27.375332 9281 hybrid_clock.cc:648] HybridClock initialized: now 1786302867375282 us; error 35 us; skew 500 ppm
I20260809 19:14:27.375676 9281 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:14:27 dist-test-slave-4tdj krb5kdc[9261](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302867, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:14:27.382828 9281 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:14:27.384274 9281 webserver.cc:460] Webserver started at http://127.0.0.1:44581/ using document root <none> and password file <none>
I20260809 19:14:27.384928 9281 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:27.385064 9281 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:27.385371 9281 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:27.388360 9281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "ee93a8132e374ae1a1c5ac014856c9a0"
format_stamp: "Formatted at 2026-08-09 19:14:27 on dist-test-slave-4tdj"
server_key: "dbd961e3ee6be69c012cd825b6a11305"
server_key_iv: "90cfd6066862e11b1389ce9dcb52ba2b"
server_key_version: "encryptionkey@0"
I20260809 19:14:27.389227 9281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "ee93a8132e374ae1a1c5ac014856c9a0"
format_stamp: "Formatted at 2026-08-09 19:14:27 on dist-test-slave-4tdj"
server_key: "dbd961e3ee6be69c012cd825b6a11305"
server_key_iv: "90cfd6066862e11b1389ce9dcb52ba2b"
server_key_version: "encryptionkey@0"
I20260809 19:14:27.394273 9281 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 19:14:27.397675 9307 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:27.398963 9281 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260809 19:14:27.399134 9281 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "ee93a8132e374ae1a1c5ac014856c9a0"
format_stamp: "Formatted at 2026-08-09 19:14:27 on dist-test-slave-4tdj"
server_key: "dbd961e3ee6be69c012cd825b6a11305"
server_key_iv: "90cfd6066862e11b1389ce9dcb52ba2b"
server_key_version: "encryptionkey@0"
I20260809 19:14:27.399318 9281 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:27.420977 9281 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:27.424782 9281 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:27.425066 9281 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:27.443604 9281 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35121
I20260809 19:14:27.443634 9393 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35121 every 8 connection(s)
I20260809 19:14:27.444945 9281 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:14:27.448530 9398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:27.451393 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 9281
I20260809 19:14:27.451591 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:14:27.452057 7324 external_mini_cluster.cc:1428] Setting key f1f34bc9c441ccb62b06f20f9c8b392f
I20260809 19:14:27.460052 9398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee93a8132e374ae1a1c5ac014856c9a0: Bootstrap starting.
I20260809 19:14:27.463531 9398 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee93a8132e374ae1a1c5ac014856c9a0: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:27.464690 9398 log.cc:824] T 00000000000000000000000000000000 P ee93a8132e374ae1a1c5ac014856c9a0: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:27.465682 9408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:27.453934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.56:37657 (local address 127.0.0.1:35121)
0809 19:14:27.454700 (+ 766us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:27.454712 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:27.454755 (+ 43us) server_negotiation.cc:407] Connection header received
0809 19:14:27.456438 (+ 1683us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:27.456467 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:27.456877 (+ 410us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:27.457210 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:27.457808 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:27.459235 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:27.461092 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:27.461758 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:27.461886 (+ 128us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:27.463156 (+ 1270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:27.463164 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:27.463177 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:27.463739 (+ 562us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:27.463827 (+ 88us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:27.463855 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:27.464020 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:27.464262 (+ 242us) server_negotiation.cc:299] Negotiation successful
0809 19:14:27.464433 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":334,"threads_started":1}
I20260809 19:14:27.467734 9398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee93a8132e374ae1a1c5ac014856c9a0: No bootstrap required, opened a new log
I20260809 19:14:27.469564 7324 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:14:27.476931 9398 raft_consensus.cc:348] T 00000000000000000000000000000000 P ee93a8132e374ae1a1c5ac014856c9a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee93a8132e374ae1a1c5ac014856c9a0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35121 } }
I20260809 19:14:27.477355 9398 raft_consensus.cc:374] T 00000000000000000000000000000000 P ee93a8132e374ae1a1c5ac014856c9a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:14:27.477465 9398 raft_consensus.cc:729] T 00000000000000000000000000000000 P ee93a8132e374ae1a1c5ac014856c9a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee93a8132e374ae1a1c5ac014856c9a0, State: Initialized, Role: FOLLOWER
I20260809 19:14:27.478081 9398 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee93a8132e374ae1a1c5ac014856c9a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee93a8132e374ae1a1c5ac014856c9a0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35121 } }
I20260809 19:14:27.478379 9398 raft_consensus.cc:388] T 00000000000000000000000000000000 P ee93a8132e374ae1a1c5ac014856c9a0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:14:27.478546 9398 raft_consensus.cc:482] T 00000000000000000000000000000000 P ee93a8132e374ae1a1c5ac014856c9a0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:14:27.478725 9398 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ee93a8132e374ae1a1c5ac014856c9a0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:27.480948 9408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:27.474446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.56:36435 (local address 127.0.0.1:35121)
0809 19:14:27.474615 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:27.474622 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:27.475116 (+ 494us) server_negotiation.cc:407] Connection header received
0809 19:14:27.475259 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:27.475263 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:27.475326 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:27.475411 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:27.475937 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:27.476673 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:27.478454 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:27.479074 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:27.479182 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:27.480270 (+ 1088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:27.480275 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:27.480278 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:27.480293 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:27.480352 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:27.480367 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:27.480452 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:27.480619 (+ 167us) server_negotiation.cc:299] Negotiation successful
0809 19:14:27.480656 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 19:14:27.481473 9398 raft_consensus.cc:504] T 00000000000000000000000000000000 P ee93a8132e374ae1a1c5ac014856c9a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee93a8132e374ae1a1c5ac014856c9a0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35121 } }
I20260809 19:14:27.481926 9398 leader_election.cc:302] T 00000000000000000000000000000000 P ee93a8132e374ae1a1c5ac014856c9a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee93a8132e374ae1a1c5ac014856c9a0; no voters:
I20260809 19:14:27.482508 9398 leader_election.cc:288] T 00000000000000000000000000000000 P ee93a8132e374ae1a1c5ac014856c9a0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:14:27.482621 9421 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ee93a8132e374ae1a1c5ac014856c9a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:14:27.483218 9421 raft_consensus.cc:686] T 00000000000000000000000000000000 P ee93a8132e374ae1a1c5ac014856c9a0 [term 1 LEADER]: Becoming Leader. State: Replica: ee93a8132e374ae1a1c5ac014856c9a0, State: Running, Role: LEADER
I20260809 19:14:27.483742 9421 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee93a8132e374ae1a1c5ac014856c9a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee93a8132e374ae1a1c5ac014856c9a0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35121 } }
I20260809 19:14:27.484290 9398 sys_catalog.cc:564] T 00000000000000000000000000000000 P ee93a8132e374ae1a1c5ac014856c9a0 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:14:27.486433 9422 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee93a8132e374ae1a1c5ac014856c9a0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee93a8132e374ae1a1c5ac014856c9a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee93a8132e374ae1a1c5ac014856c9a0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35121 } } }
I20260809 19:14:27.486829 9422 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee93a8132e374ae1a1c5ac014856c9a0 [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:27.486361 9425 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee93a8132e374ae1a1c5ac014856c9a0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee93a8132e374ae1a1c5ac014856c9a0. Latest consensus state: current_term: 1 leader_uuid: "ee93a8132e374ae1a1c5ac014856c9a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee93a8132e374ae1a1c5ac014856c9a0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35121 } } }
I20260809 19:14:27.487571 9425 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee93a8132e374ae1a1c5ac014856c9a0 [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:27.487643 9435 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:14:27.493889 9435 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:14:27.502786 9435 catalog_manager.cc:1347] Generated new cluster ID: 719c564c00d442089a44feb5811b7b75
I20260809 19:14:27.502883 9435 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:14:27.518945 9435 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:14:27.520138 9435 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:14:27.526473 9435 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ee93a8132e374ae1a1c5ac014856c9a0: Generated new TSK 0
I20260809 19:14:27.527158 9435 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:14:27.542999 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 9281
W20260809 19:14:27.544337 9387 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.56:37657
W20260809 19:14:27.545030 7324 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 9281: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 19:14:27.545145 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 9281
W20260809 19:14:27.567718 9256 connection.cc:535] client connection to 127.0.0.1:35121 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35121): Connection reset by peer (error 104)
2026-08-09T19:14:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2015 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:14:27 dist-test-slave-4tdj krb5kdc[9454](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:14:27 dist-test-slave-4tdj krb5kdc[9454](info): set up 2 sockets
Aug 09 19:14:27 dist-test-slave-4tdj krb5kdc[9454](info): commencing operation
krb5kdc: starting...
W20260809 19:14:28.746927 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.161s user 0.008s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:14:28 dist-test-slave-4tdj krb5kdc[9454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302868, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:14:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:14:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:14:29.006752 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35139
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35139
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:14:29.335494 9475 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:29.335775 9475 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:29.335911 9475 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:29.342839 9475 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:14:29.342952 9475 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:29.343030 9475 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:29.343115 9475 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:14:29.343183 9475 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:14:29.352593 9475 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35139
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35139
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:29.353770 9475 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:29.355065 9475 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:29.366151 9484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:29.366195 9488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:29.366221 9485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:29.366950 9475 server_base.cc:1034] running on GCE node
I20260809 19:14:29.367666 9475 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:29.368929 9475 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:29.370131 9475 hybrid_clock.cc:648] HybridClock initialized: now 1786302869370086 us; error 38 us; skew 500 ppm
I20260809 19:14:29.370482 9475 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:14:29 dist-test-slave-4tdj krb5kdc[9454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302869, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:14:29.373541 9475 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:14:29.374953 9475 webserver.cc:460] Webserver started at http://127.0.0.1:34331/ using document root <none> and password file <none>
I20260809 19:14:29.375595 9475 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:29.375722 9475 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:29.376004 9475 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:29.378866 9475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "9bd0b383d6e0453b83502334428cb7e1"
format_stamp: "Formatted at 2026-08-09 19:14:29 on dist-test-slave-4tdj"
server_key: "01653db2bfbc2283f4f6717bb5799622"
server_key_iv: "45f8cdb2d463adc8fdfe3742ce18197b"
server_key_version: "encryptionkey@0"
I20260809 19:14:29.379611 9475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "9bd0b383d6e0453b83502334428cb7e1"
format_stamp: "Formatted at 2026-08-09 19:14:29 on dist-test-slave-4tdj"
server_key: "01653db2bfbc2283f4f6717bb5799622"
server_key_iv: "45f8cdb2d463adc8fdfe3742ce18197b"
server_key_version: "encryptionkey@0"
I20260809 19:14:29.384423 9475 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260809 19:14:29.387699 9497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:29.388897 9475 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 19:14:29.389050 9475 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "9bd0b383d6e0453b83502334428cb7e1"
format_stamp: "Formatted at 2026-08-09 19:14:29 on dist-test-slave-4tdj"
server_key: "01653db2bfbc2283f4f6717bb5799622"
server_key_iv: "45f8cdb2d463adc8fdfe3742ce18197b"
server_key_version: "encryptionkey@0"
I20260809 19:14:29.389220 9475 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:29.394536 9475 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:29.398396 9475 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:29.398666 9475 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:29.415496 9475 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35139
I20260809 19:14:29.415547 9584 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35139 every 8 connection(s)
I20260809 19:14:29.416726 9475 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:14:29.420099 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 9475
I20260809 19:14:29.420281 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:14:29.420382 9585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:29.420861 7324 external_mini_cluster.cc:1428] Setting key 2b4f1798959608a9dedc5b519f53bc08
I20260809 19:14:29.428066 9591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:29.422599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.56:35145 (local address 127.0.0.1:35139)
0809 19:14:29.423346 (+ 747us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:29.423357 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:29.423396 (+ 39us) server_negotiation.cc:407] Connection header received
0809 19:14:29.424964 (+ 1568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:29.424985 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:29.425314 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:29.425629 (+ 315us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:29.426650 (+ 1021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:29.426656 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:29.426668 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:29.426682 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:29.426749 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:29.426769 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:29.426941 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:29.427031 (+ 90us) server_negotiation.cc:299] Negotiation successful
0809 19:14:29.427195 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":530,"thread_start_us":323,"threads_started":1}
I20260809 19:14:29.431368 7324 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:14:29.433507 9585 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9bd0b383d6e0453b83502334428cb7e1: Bootstrap starting.
I20260809 19:14:29.437232 9585 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9bd0b383d6e0453b83502334428cb7e1: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:29.438521 9585 log.cc:824] T 00000000000000000000000000000000 P 9bd0b383d6e0453b83502334428cb7e1: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:29.438939 9591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:29.436410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.56:50519 (local address 127.0.0.1:35139)
0809 19:14:29.436532 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:29.436535 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:29.436879 (+ 344us) server_negotiation.cc:407] Connection header received
0809 19:14:29.437032 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:29.437036 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:29.437080 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:29.437155 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:29.437982 (+ 827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:29.437987 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:29.437991 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:29.438008 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:29.438052 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:29.438071 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:29.438181 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:29.438379 (+ 198us) server_negotiation.cc:299] Negotiation successful
0809 19:14:29.438472 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 19:14:29.441377 9585 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9bd0b383d6e0453b83502334428cb7e1: No bootstrap required, opened a new log
I20260809 19:14:29.448531 9585 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9bd0b383d6e0453b83502334428cb7e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bd0b383d6e0453b83502334428cb7e1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35139 } }
I20260809 19:14:29.448886 9585 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9bd0b383d6e0453b83502334428cb7e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:14:29.448971 9585 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9bd0b383d6e0453b83502334428cb7e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd0b383d6e0453b83502334428cb7e1, State: Initialized, Role: FOLLOWER
I20260809 19:14:29.449469 9585 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9bd0b383d6e0453b83502334428cb7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bd0b383d6e0453b83502334428cb7e1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35139 } }
I20260809 19:14:29.449692 9585 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9bd0b383d6e0453b83502334428cb7e1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:14:29.449812 9585 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9bd0b383d6e0453b83502334428cb7e1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:14:29.449970 9585 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9bd0b383d6e0453b83502334428cb7e1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:29.452004 9585 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9bd0b383d6e0453b83502334428cb7e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bd0b383d6e0453b83502334428cb7e1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35139 } }
I20260809 19:14:29.452430 9585 leader_election.cc:302] T 00000000000000000000000000000000 P 9bd0b383d6e0453b83502334428cb7e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9bd0b383d6e0453b83502334428cb7e1; no voters:
I20260809 19:14:29.452967 9585 leader_election.cc:288] T 00000000000000000000000000000000 P 9bd0b383d6e0453b83502334428cb7e1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:14:29.453078 9611 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9bd0b383d6e0453b83502334428cb7e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:14:29.453683 9611 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9bd0b383d6e0453b83502334428cb7e1 [term 1 LEADER]: Becoming Leader. State: Replica: 9bd0b383d6e0453b83502334428cb7e1, State: Running, Role: LEADER
I20260809 19:14:29.454252 9611 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9bd0b383d6e0453b83502334428cb7e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bd0b383d6e0453b83502334428cb7e1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35139 } }
I20260809 19:14:29.454995 9585 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9bd0b383d6e0453b83502334428cb7e1 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:14:29.456816 9612 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9bd0b383d6e0453b83502334428cb7e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9bd0b383d6e0453b83502334428cb7e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bd0b383d6e0453b83502334428cb7e1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35139 } } }
I20260809 19:14:29.457285 9612 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9bd0b383d6e0453b83502334428cb7e1 [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:29.456830 9613 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9bd0b383d6e0453b83502334428cb7e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9bd0b383d6e0453b83502334428cb7e1. Latest consensus state: current_term: 1 leader_uuid: "9bd0b383d6e0453b83502334428cb7e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bd0b383d6e0453b83502334428cb7e1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35139 } } }
I20260809 19:14:29.457950 9613 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9bd0b383d6e0453b83502334428cb7e1 [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:29.458806 9618 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:14:29.463505 9618 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:14:29.473675 9618 catalog_manager.cc:1347] Generated new cluster ID: ce043d079c0147b9b594ba55870ae9ba
I20260809 19:14:29.473770 9618 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:14:29.520632 9618 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:14:29.521018 9618 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:14:29.527448 9618 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9bd0b383d6e0453b83502334428cb7e1: Generated new TSK 0
I20260809 19:14:29.528391 9618 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:14:29.543980 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 9475
W20260809 19:14:29.545313 9575 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.56:35145
W20260809 19:14:29.546002 7324 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 9475: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 19:14:29.546154 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 9475
2026-08-09T19:14:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2000 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:14:29 dist-test-slave-4tdj krb5kdc[9640](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:14:29 dist-test-slave-4tdj krb5kdc[9640](info): set up 2 sockets
Aug 09 19:14:29 dist-test-slave-4tdj krb5kdc[9640](info): commencing operation
krb5kdc: starting...
W20260809 19:14:30.754269 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.168s user 0.007s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:14:30 dist-test-slave-4tdj krb5kdc[9640](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:14:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:14:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:14:31.009295 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38477
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38477
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:14:31.331844 9656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:31.332110 9656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:31.332240 9656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:31.339154 9656 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:14:31.339254 9656 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:31.339331 9656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:31.339407 9656 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:14:31.339465 9656 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:14:31.348719 9656 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38477
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38477
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:31.349891 9656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:31.351140 9656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:31.362075 9661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:31.362118 9662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:31.362159 9670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:31.362860 9656 server_base.cc:1034] running on GCE node
I20260809 19:14:31.363617 9656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:31.364823 9656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:31.366017 9656 hybrid_clock.cc:648] HybridClock initialized: now 1786302871365970 us; error 36 us; skew 500 ppm
I20260809 19:14:31.366372 9656 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:14:31 dist-test-slave-4tdj krb5kdc[9640](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302871, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:14:31.369199 9656 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:14:31.370625 9656 webserver.cc:460] Webserver started at http://127.0.0.1:39613/ using document root <none> and password file <none>
I20260809 19:14:31.371260 9656 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:31.371373 9656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:31.371647 9656 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:31.374445 9656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "34933afe75a94359b05a4b14d59393ef"
format_stamp: "Formatted at 2026-08-09 19:14:31 on dist-test-slave-4tdj"
server_key: "b12e8899519e86e0c1f6c34872c2fae3"
server_key_iv: "7c40b3c3b1beaaa5d839511583c9c687"
server_key_version: "encryptionkey@0"
I20260809 19:14:31.375155 9656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "34933afe75a94359b05a4b14d59393ef"
format_stamp: "Formatted at 2026-08-09 19:14:31 on dist-test-slave-4tdj"
server_key: "b12e8899519e86e0c1f6c34872c2fae3"
server_key_iv: "7c40b3c3b1beaaa5d839511583c9c687"
server_key_version: "encryptionkey@0"
I20260809 19:14:31.379817 9656 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 19:14:31.382968 9682 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:31.384132 9656 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 19:14:31.384291 9656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "34933afe75a94359b05a4b14d59393ef"
format_stamp: "Formatted at 2026-08-09 19:14:31 on dist-test-slave-4tdj"
server_key: "b12e8899519e86e0c1f6c34872c2fae3"
server_key_iv: "7c40b3c3b1beaaa5d839511583c9c687"
server_key_version: "encryptionkey@0"
I20260809 19:14:31.384455 9656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:31.413904 9656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:31.417331 9656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:31.417580 9656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:31.434412 9656 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38477
I20260809 19:14:31.434432 9754 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38477 every 8 connection(s)
I20260809 19:14:31.435588 9656 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:14:31.438974 9757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:31.443778 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 9656
I20260809 19:14:31.443933 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:14:31.444319 7324 external_mini_cluster.cc:1428] Setting key 9b04a2b37bb4accaebdce96258e8d0c9
I20260809 19:14:31.449334 9757 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34933afe75a94359b05a4b14d59393ef: Bootstrap starting.
I20260809 19:14:31.452723 9757 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 34933afe75a94359b05a4b14d59393ef: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:31.453902 9757 log.cc:824] T 00000000000000000000000000000000 P 34933afe75a94359b05a4b14d59393ef: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:31.457046 9757 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34933afe75a94359b05a4b14d59393ef: No bootstrap required, opened a new log
Aug 09 19:14:31 dist-test-slave-4tdj krb5kdc[9640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 19:14:31.465387 9757 raft_consensus.cc:348] T 00000000000000000000000000000000 P 34933afe75a94359b05a4b14d59393ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34933afe75a94359b05a4b14d59393ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38477 } }
I20260809 19:14:31.465832 9757 raft_consensus.cc:374] T 00000000000000000000000000000000 P 34933afe75a94359b05a4b14d59393ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:14:31.465984 9757 raft_consensus.cc:729] T 00000000000000000000000000000000 P 34933afe75a94359b05a4b14d59393ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34933afe75a94359b05a4b14d59393ef, State: Initialized, Role: FOLLOWER
I20260809 19:14:31.466563 9757 consensus_queue.cc:260] T 00000000000000000000000000000000 P 34933afe75a94359b05a4b14d59393ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34933afe75a94359b05a4b14d59393ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38477 } }
I20260809 19:14:31.466800 9757 raft_consensus.cc:388] T 00000000000000000000000000000000 P 34933afe75a94359b05a4b14d59393ef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:14:31.466922 9757 raft_consensus.cc:482] T 00000000000000000000000000000000 P 34933afe75a94359b05a4b14d59393ef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:14:31.467082 9757 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 34933afe75a94359b05a4b14d59393ef [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:31.467152 9763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:31.445997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.56:56607 (local address 127.0.0.1:38477)
0809 19:14:31.446875 (+ 878us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:31.446889 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:31.446948 (+ 59us) server_negotiation.cc:407] Connection header received
0809 19:14:31.448736 (+ 1788us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:31.448758 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:31.449109 (+ 351us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:31.449399 (+ 290us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:31.451152 (+ 1753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:31.452388 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:31.454134 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:31.455144 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:31.455288 (+ 144us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:31.459977 (+ 4689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:31.459985 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:31.459998 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:31.460031 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:31.462976 (+ 2945us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:31.463852 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:31.463862 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:31.463868 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:31.464034 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:31.464468 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:31.464471 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:31.464477 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:31.464951 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:31.465166 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:31.465728 (+ 562us) server_negotiation.cc:299] Negotiation successful
0809 19:14:31.466047 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":608,"thread_start_us":345,"threads_started":1}
I20260809 19:14:31.469784 9757 raft_consensus.cc:504] T 00000000000000000000000000000000 P 34933afe75a94359b05a4b14d59393ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34933afe75a94359b05a4b14d59393ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38477 } }
I20260809 19:14:31.470278 9757 leader_election.cc:302] T 00000000000000000000000000000000 P 34933afe75a94359b05a4b14d59393ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 34933afe75a94359b05a4b14d59393ef; no voters:
I20260809 19:14:31.470796 7324 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:14:31.470914 9757 leader_election.cc:288] T 00000000000000000000000000000000 P 34933afe75a94359b05a4b14d59393ef [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:14:31.471006 9767 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 34933afe75a94359b05a4b14d59393ef [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:14:31.472143 9767 raft_consensus.cc:686] T 00000000000000000000000000000000 P 34933afe75a94359b05a4b14d59393ef [term 1 LEADER]: Becoming Leader. State: Replica: 34933afe75a94359b05a4b14d59393ef, State: Running, Role: LEADER
I20260809 19:14:31.472647 9767 consensus_queue.cc:237] T 00000000000000000000000000000000 P 34933afe75a94359b05a4b14d59393ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34933afe75a94359b05a4b14d59393ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38477 } }
I20260809 19:14:31.472865 9757 sys_catalog.cc:564] T 00000000000000000000000000000000 P 34933afe75a94359b05a4b14d59393ef [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:14:31.475533 9770 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34933afe75a94359b05a4b14d59393ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "34933afe75a94359b05a4b14d59393ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34933afe75a94359b05a4b14d59393ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38477 } } }
I20260809 19:14:31.476222 9770 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34933afe75a94359b05a4b14d59393ef [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:31.475592 9771 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34933afe75a94359b05a4b14d59393ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 34933afe75a94359b05a4b14d59393ef. Latest consensus state: current_term: 1 leader_uuid: "34933afe75a94359b05a4b14d59393ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34933afe75a94359b05a4b14d59393ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38477 } } }
I20260809 19:14:31.476565 9771 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34933afe75a94359b05a4b14d59393ef [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:31.480508 9786 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:14:31.485288 9786 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:14:31.498550 9763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:31.477834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.56:54291 (local address 127.0.0.1:38477)
0809 19:14:31.477978 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:31.477983 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:31.479886 (+ 1903us) server_negotiation.cc:407] Connection header received
0809 19:14:31.480049 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:31.480054 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:31.480145 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:31.480259 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:31.482394 (+ 2135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:31.483773 (+ 1379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:31.485877 (+ 2104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:31.486631 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:31.486757 (+ 126us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:31.490424 (+ 3667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:31.490431 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:31.490437 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:31.490479 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:31.494792 (+ 4313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:31.495778 (+ 986us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:31.495784 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:31.495788 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:31.495940 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:31.496548 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:31.496553 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:31.496557 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:31.496980 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:31.497223 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:31.497957 (+ 734us) server_negotiation.cc:299] Negotiation successful
0809 19:14:31.498150 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 19:14:31.503554 9802 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 19:14:31.504724 9786 catalog_manager.cc:1347] Generated new cluster ID: 561f7610334d45db8720e30bf6999d32
I20260809 19:14:31.505003 9786 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:14:31.535279 9786 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:14:31.536496 9786 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:14:31.549511 9786 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 34933afe75a94359b05a4b14d59393ef: Generated new TSK 0
I20260809 19:14:31.550220 9786 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:14:31.560304 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 9656
I20260809 19:14:31.562067 9748 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:14:31.650985 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 9656
W20260809 19:14:31.673736 9636 connection.cc:535] client connection to 127.0.0.1:38477 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38477): Connection reset by peer (error 104)
2026-08-09T19:14:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2105 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:14:31 dist-test-slave-4tdj krb5kdc[9808](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:14:31 dist-test-slave-4tdj krb5kdc[9808](info): set up 2 sockets
Aug 09 19:14:31 dist-test-slave-4tdj krb5kdc[9808](info): commencing operation
krb5kdc: starting...
W20260809 19:14:32.872464 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.180s user 0.004s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:14:33 dist-test-slave-4tdj krb5kdc[9808](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302873, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:14:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:14:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:14:33.144973 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37581
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37581
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:14:33.469355 9823 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:33.469645 9823 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:33.469782 9823 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:33.476727 9823 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:14:33.476837 9823 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:33.476914 9823 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:33.476994 9823 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:14:33.477057 9823 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:14:33.486549 9823 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37581
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37581
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:33.487790 9823 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:33.489058 9823 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:33.500144 9831 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:33.500176 9832 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:33.500094 9834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:33.500893 9823 server_base.cc:1034] running on GCE node
I20260809 19:14:33.501605 9823 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:33.502899 9823 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:33.504094 9823 hybrid_clock.cc:648] HybridClock initialized: now 1786302873504054 us; error 31 us; skew 500 ppm
I20260809 19:14:33.504418 9823 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:14:33 dist-test-slave-4tdj krb5kdc[9808](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302873, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:14:33.511212 9823 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:14:33.512570 9823 webserver.cc:460] Webserver started at http://127.0.0.1:39365/ using document root <none> and password file <none>
I20260809 19:14:33.513190 9823 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:33.513307 9823 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:33.513588 9823 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:33.516511 9823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "80bf147103fb4188aac9971065cfee19"
format_stamp: "Formatted at 2026-08-09 19:14:33 on dist-test-slave-4tdj"
server_key: "fb8e7c4f5797b2508356e3e448286595"
server_key_iv: "feb38a0851d90e78f13bfabf2e305ff2"
server_key_version: "encryptionkey@0"
I20260809 19:14:33.517264 9823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "80bf147103fb4188aac9971065cfee19"
format_stamp: "Formatted at 2026-08-09 19:14:33 on dist-test-slave-4tdj"
server_key: "fb8e7c4f5797b2508356e3e448286595"
server_key_iv: "feb38a0851d90e78f13bfabf2e305ff2"
server_key_version: "encryptionkey@0"
I20260809 19:14:33.522197 9823 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 19:14:33.525430 9846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:33.526726 9823 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:14:33.526885 9823 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "80bf147103fb4188aac9971065cfee19"
format_stamp: "Formatted at 2026-08-09 19:14:33 on dist-test-slave-4tdj"
server_key: "fb8e7c4f5797b2508356e3e448286595"
server_key_iv: "feb38a0851d90e78f13bfabf2e305ff2"
server_key_version: "encryptionkey@0"
I20260809 19:14:33.527055 9823 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:33.539608 9823 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:33.543239 9823 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:33.543480 9823 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:33.560407 9823 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37581
I20260809 19:14:33.560447 9930 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37581 every 8 connection(s)
I20260809 19:14:33.561656 9823 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:14:33.565133 9931 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:33.567687 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 9823
I20260809 19:14:33.567863 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:14:33.568358 7324 external_mini_cluster.cc:1428] Setting key d1a456657dbd987aa97cc9ce62024fbf
I20260809 19:14:33.576639 9931 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80bf147103fb4188aac9971065cfee19: Bootstrap starting.
I20260809 19:14:33.580035 9931 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 80bf147103fb4188aac9971065cfee19: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:33.581104 9931 log.cc:824] T 00000000000000000000000000000000 P 80bf147103fb4188aac9971065cfee19: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:33.581256 9934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:33.570071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.56:34745 (local address 127.0.0.1:37581)
0809 19:14:33.570895 (+ 824us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:33.570905 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:33.570944 (+ 39us) server_negotiation.cc:407] Connection header received
0809 19:14:33.572535 (+ 1591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:33.572557 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:33.572912 (+ 355us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:33.573219 (+ 307us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:33.573823 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:33.575172 (+ 1349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:33.577004 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:33.577653 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:33.577771 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:33.579061 (+ 1290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:33.579069 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:33.579081 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:33.579614 (+ 533us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:33.579686 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:33.579711 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:33.579830 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:33.580111 (+ 281us) server_negotiation.cc:299] Negotiation successful
0809 19:14:33.580276 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":636,"thread_start_us":373,"threads_started":1}
I20260809 19:14:33.583864 9931 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80bf147103fb4188aac9971065cfee19: No bootstrap required, opened a new log
I20260809 19:14:33.584779 7324 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:14:33.591377 9931 raft_consensus.cc:348] T 00000000000000000000000000000000 P 80bf147103fb4188aac9971065cfee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80bf147103fb4188aac9971065cfee19" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37581 } }
I20260809 19:14:33.591706 9931 raft_consensus.cc:374] T 00000000000000000000000000000000 P 80bf147103fb4188aac9971065cfee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:14:33.591800 9931 raft_consensus.cc:729] T 00000000000000000000000000000000 P 80bf147103fb4188aac9971065cfee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80bf147103fb4188aac9971065cfee19, State: Initialized, Role: FOLLOWER
I20260809 19:14:33.592371 9931 consensus_queue.cc:260] T 00000000000000000000000000000000 P 80bf147103fb4188aac9971065cfee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80bf147103fb4188aac9971065cfee19" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37581 } }
I20260809 19:14:33.592607 9931 raft_consensus.cc:388] T 00000000000000000000000000000000 P 80bf147103fb4188aac9971065cfee19 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:14:33.592733 9931 raft_consensus.cc:482] T 00000000000000000000000000000000 P 80bf147103fb4188aac9971065cfee19 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:14:33.592900 9931 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 80bf147103fb4188aac9971065cfee19 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:33.594942 9934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:33.588909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.56:60609 (local address 127.0.0.1:37581)
0809 19:14:33.589038 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:33.589042 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:33.589567 (+ 525us) server_negotiation.cc:407] Connection header received
0809 19:14:33.589738 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:33.589743 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:33.589803 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:33.589885 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:33.590387 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:33.591149 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:33.592522 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:33.593103 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:33.593218 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:33.594248 (+ 1030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:33.594252 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:33.594255 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:33.594271 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:33.594333 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:33.594354 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:33.594454 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:33.594639 (+ 185us) server_negotiation.cc:299] Negotiation successful
0809 19:14:33.594687 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 19:14:33.595212 9931 raft_consensus.cc:504] T 00000000000000000000000000000000 P 80bf147103fb4188aac9971065cfee19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80bf147103fb4188aac9971065cfee19" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37581 } }
I20260809 19:14:33.595674 9931 leader_election.cc:302] T 00000000000000000000000000000000 P 80bf147103fb4188aac9971065cfee19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 80bf147103fb4188aac9971065cfee19; no voters:
I20260809 19:14:33.596237 9931 leader_election.cc:288] T 00000000000000000000000000000000 P 80bf147103fb4188aac9971065cfee19 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:14:33.596307 9951 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 80bf147103fb4188aac9971065cfee19 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:14:33.597002 9951 raft_consensus.cc:686] T 00000000000000000000000000000000 P 80bf147103fb4188aac9971065cfee19 [term 1 LEADER]: Becoming Leader. State: Replica: 80bf147103fb4188aac9971065cfee19, State: Running, Role: LEADER
I20260809 19:14:33.597543 9951 consensus_queue.cc:237] T 00000000000000000000000000000000 P 80bf147103fb4188aac9971065cfee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80bf147103fb4188aac9971065cfee19" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37581 } }
I20260809 19:14:33.598261 9931 sys_catalog.cc:564] T 00000000000000000000000000000000 P 80bf147103fb4188aac9971065cfee19 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:14:33.600039 9953 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80bf147103fb4188aac9971065cfee19 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "80bf147103fb4188aac9971065cfee19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80bf147103fb4188aac9971065cfee19" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37581 } } }
I20260809 19:14:33.600769 9953 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80bf147103fb4188aac9971065cfee19 [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:33.605602 9954 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80bf147103fb4188aac9971065cfee19 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 80bf147103fb4188aac9971065cfee19. Latest consensus state: current_term: 1 leader_uuid: "80bf147103fb4188aac9971065cfee19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80bf147103fb4188aac9971065cfee19" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37581 } } }
I20260809 19:14:33.605906 9954 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80bf147103fb4188aac9971065cfee19 [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:33.607043 9962 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:14:33.612315 9962 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:14:33.620841 9962 catalog_manager.cc:1347] Generated new cluster ID: 86f0eb08739e44008ff957037d637046
I20260809 19:14:33.620961 9962 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:14:33.636747 9962 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:14:33.637907 9962 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:14:33.643180 9962 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 80bf147103fb4188aac9971065cfee19: Generated new TSK 0
I20260809 19:14:33.643850 9962 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:14:33.652163 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 9823
W20260809 19:14:33.653209 9922 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.56:34745
W20260809 19:14:33.653927 7324 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 9823: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 19:14:33.654047 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 9823
W20260809 19:14:33.682051 9805 connection.cc:535] client connection to 127.0.0.1:37581 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37581): Connection reset by peer (error 104)
2026-08-09T19:14:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2012 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:14:33 dist-test-slave-4tdj krb5kdc[9987](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:14:33 dist-test-slave-4tdj krb5kdc[9987](info): set up 2 sockets
Aug 09 19:14:33 dist-test-slave-4tdj krb5kdc[9987](info): commencing operation
krb5kdc: starting...
W20260809 19:14:34.883810 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.179s user 0.000s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:14:35 dist-test-slave-4tdj krb5kdc[9987](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302875, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:14:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:14:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:14:35.135298 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36125
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36125
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:14:35.464319 10004 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:35.464619 10004 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:35.464783 10004 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:35.471827 10004 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:14:35.471953 10004 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:35.472045 10004 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:35.472142 10004 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:14:35.472213 10004 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:14:35.481678 10004 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36125
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786302538618573-7324-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36125
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:35.482971 10004 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:35.484308 10004 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:35.496001 10011 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:35.496117 10010 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:35.496167 10013 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:35.496989 10004 server_base.cc:1034] running on GCE node
I20260809 19:14:35.497773 10004 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:35.499167 10004 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:35.500388 10004 hybrid_clock.cc:648] HybridClock initialized: now 1786302875500335 us; error 41 us; skew 500 ppm
I20260809 19:14:35.500731 10004 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:14:35 dist-test-slave-4tdj krb5kdc[9987](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302875, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:14:35.503881 10004 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:14:35.505342 10004 webserver.cc:460] Webserver started at http://127.0.0.1:35207/ using document root <none> and password file <none>
I20260809 19:14:35.505972 10004 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:35.506096 10004 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:35.506445 10004 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:35.509407 10004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "fc66d2bb6b2c42e6a9f468ee60a6e7fa"
format_stamp: "Formatted at 2026-08-09 19:14:35 on dist-test-slave-4tdj"
server_key: "3eae56bfb2fb640d562b546b4f50e93b"
server_key_iv: "b3f39160e633539341b2b97bda43e7c1"
server_key_version: "encryptionkey@0"
I20260809 19:14:35.510201 10004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "fc66d2bb6b2c42e6a9f468ee60a6e7fa"
format_stamp: "Formatted at 2026-08-09 19:14:35 on dist-test-slave-4tdj"
server_key: "3eae56bfb2fb640d562b546b4f50e93b"
server_key_iv: "b3f39160e633539341b2b97bda43e7c1"
server_key_version: "encryptionkey@0"
I20260809 19:14:35.515233 10004 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 19:14:35.518567 10028 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:35.519759 10004 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 19:14:35.519923 10004 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "fc66d2bb6b2c42e6a9f468ee60a6e7fa"
format_stamp: "Formatted at 2026-08-09 19:14:35 on dist-test-slave-4tdj"
server_key: "3eae56bfb2fb640d562b546b4f50e93b"
server_key_iv: "b3f39160e633539341b2b97bda43e7c1"
server_key_version: "encryptionkey@0"
I20260809 19:14:35.520143 10004 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:35.525763 10004 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:35.529799 10004 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:35.530105 10004 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:35.548462 10004 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36125
I20260809 19:14:35.548527 10116 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36125 every 8 connection(s)
I20260809 19:14:35.549818 10004 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:14:35.553314 10117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:35.556407 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 10004
I20260809 19:14:35.556579 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:14:35.557020 7324 external_mini_cluster.cc:1428] Setting key 14847c9598d14e277c017e41657ac311
I20260809 19:14:35.565090 10121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:35.558752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.56:55057 (local address 127.0.0.1:36125)
0809 19:14:35.559540 (+ 788us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:35.559554 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:35.559602 (+ 48us) server_negotiation.cc:407] Connection header received
0809 19:14:35.561490 (+ 1888us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:35.561518 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:35.561928 (+ 410us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:35.562368 (+ 440us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:35.563297 (+ 929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:35.563305 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:35.563322 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:35.563338 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:35.563407 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:35.563432 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:35.563667 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:35.563798 (+ 131us) server_negotiation.cc:299] Negotiation successful
0809 19:14:35.563979 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":552,"thread_start_us":316,"threads_started":1}
I20260809 19:14:35.565866 10117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc66d2bb6b2c42e6a9f468ee60a6e7fa: Bootstrap starting.
I20260809 19:14:35.568658 7324 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:14:35.569303 10117 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc66d2bb6b2c42e6a9f468ee60a6e7fa: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:35.570487 10117 log.cc:824] T 00000000000000000000000000000000 P fc66d2bb6b2c42e6a9f468ee60a6e7fa: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:35.573491 10117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc66d2bb6b2c42e6a9f468ee60a6e7fa: No bootstrap required, opened a new log
I20260809 19:14:35.575512 10121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:35.573514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.56:36575 (local address 127.0.0.1:36125)
0809 19:14:35.573660 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:35.573665 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:35.573888 (+ 223us) server_negotiation.cc:407] Connection header received
0809 19:14:35.573999 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:35.574003 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:35.574053 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:35.574160 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:35.574905 (+ 745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:35.574910 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:35.574914 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:35.574931 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:35.574972 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:35.574991 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:35.575112 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:35.575157 (+ 45us) server_negotiation.cc:299] Negotiation successful
0809 19:14:35.575209 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 19:14:35.581120 10117 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc66d2bb6b2c42e6a9f468ee60a6e7fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc66d2bb6b2c42e6a9f468ee60a6e7fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36125 } }
I20260809 19:14:35.581426 10117 raft_consensus.cc:374] T 00000000000000000000000000000000 P fc66d2bb6b2c42e6a9f468ee60a6e7fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:14:35.581499 10117 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc66d2bb6b2c42e6a9f468ee60a6e7fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc66d2bb6b2c42e6a9f468ee60a6e7fa, State: Initialized, Role: FOLLOWER
I20260809 19:14:35.581943 10117 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc66d2bb6b2c42e6a9f468ee60a6e7fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc66d2bb6b2c42e6a9f468ee60a6e7fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36125 } }
I20260809 19:14:35.582162 10117 raft_consensus.cc:388] T 00000000000000000000000000000000 P fc66d2bb6b2c42e6a9f468ee60a6e7fa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:14:35.582286 10117 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc66d2bb6b2c42e6a9f468ee60a6e7fa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:14:35.582477 10117 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc66d2bb6b2c42e6a9f468ee60a6e7fa [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:35.584460 10117 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc66d2bb6b2c42e6a9f468ee60a6e7fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc66d2bb6b2c42e6a9f468ee60a6e7fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36125 } }
I20260809 19:14:35.584892 10117 leader_election.cc:302] T 00000000000000000000000000000000 P fc66d2bb6b2c42e6a9f468ee60a6e7fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc66d2bb6b2c42e6a9f468ee60a6e7fa; no voters:
I20260809 19:14:35.585439 10117 leader_election.cc:288] T 00000000000000000000000000000000 P fc66d2bb6b2c42e6a9f468ee60a6e7fa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:14:35.585537 10132 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fc66d2bb6b2c42e6a9f468ee60a6e7fa [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:14:35.586148 10132 raft_consensus.cc:686] T 00000000000000000000000000000000 P fc66d2bb6b2c42e6a9f468ee60a6e7fa [term 1 LEADER]: Becoming Leader. State: Replica: fc66d2bb6b2c42e6a9f468ee60a6e7fa, State: Running, Role: LEADER
I20260809 19:14:35.586748 10132 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc66d2bb6b2c42e6a9f468ee60a6e7fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc66d2bb6b2c42e6a9f468ee60a6e7fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36125 } }
I20260809 19:14:35.587536 10117 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc66d2bb6b2c42e6a9f468ee60a6e7fa [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:14:35.589636 10134 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc66d2bb6b2c42e6a9f468ee60a6e7fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc66d2bb6b2c42e6a9f468ee60a6e7fa. Latest consensus state: current_term: 1 leader_uuid: "fc66d2bb6b2c42e6a9f468ee60a6e7fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc66d2bb6b2c42e6a9f468ee60a6e7fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36125 } } }
I20260809 19:14:35.589658 10133 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc66d2bb6b2c42e6a9f468ee60a6e7fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fc66d2bb6b2c42e6a9f468ee60a6e7fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc66d2bb6b2c42e6a9f468ee60a6e7fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36125 } } }
I20260809 19:14:35.590169 10133 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc66d2bb6b2c42e6a9f468ee60a6e7fa [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:35.590713 10134 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc66d2bb6b2c42e6a9f468ee60a6e7fa [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:35.592587 10145 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:14:35.596689 10145 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:14:35.604386 10145 catalog_manager.cc:1347] Generated new cluster ID: 99d447f8c0564fcb939815445598872c
I20260809 19:14:35.604482 10145 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:14:35.619699 10145 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:14:35.620048 10145 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:14:35.628614 10145 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fc66d2bb6b2c42e6a9f468ee60a6e7fa: Generated new TSK 0
I20260809 19:14:35.629261 10145 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:14:35.641036 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 10004
W20260809 19:14:35.642024 10107 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.56:55057
W20260809 19:14:35.642653 7324 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 10004: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 19:14:35.642773 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 10004
2026-08-09T19:14:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1982 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:14:35 dist-test-slave-4tdj krb5kdc[10163](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:14:35 dist-test-slave-4tdj krb5kdc[10163](info): set up 2 sockets
Aug 09 19:14:35 dist-test-slave-4tdj krb5kdc[10163](info): commencing operation
krb5kdc: starting...
W20260809 19:14:36.859870 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.172s user 0.004s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:14:37 dist-test-slave-4tdj krb5kdc[10163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302877, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:14:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:14:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.39.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
I20260809 19:14:37.115530 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:37161
--webserver_interface=127.7.39.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:39613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:37161
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:14:37.436199 10180 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:37.436491 10180 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:37.436638 10180 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:37.443528 10180 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:14:37.443625 10180 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:37.443701 10180 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:37.443782 10180 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:14:37.443852 10180 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:14:37.453773 10180 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:39613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:37161
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:37161
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:37.454919 10180 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:37.456130 10180 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:37.467022 10186 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:37.466950 10187 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:37.466992 10190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:37.467962 10180 server_base.cc:1034] running on GCE node
I20260809 19:14:37.468660 10180 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:37.469866 10180 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:37.471058 10180 hybrid_clock.cc:648] HybridClock initialized: now 1786302877471012 us; error 37 us; skew 500 ppm
I20260809 19:14:37.471369 10180 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:14:37 dist-test-slave-4tdj krb5kdc[10163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302877, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:14:37.474231 10180 init.cc:377] Logged in from keytab as kudu/127.7.39.62@KRBTEST.COM (short username kudu)
I20260809 19:14:37.475564 10180 webserver.cc:460] Webserver started at http://127.7.39.62:33287/ using document root <none> and password file <none>
I20260809 19:14:37.476177 10180 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:37.476293 10180 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:37.476577 10180 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:37.479408 10180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "63950191f7db4cee9f4798f073285953"
format_stamp: "Formatted at 2026-08-09 19:14:37 on dist-test-slave-4tdj"
server_key: "16f8dd1651a63c2e5b69bedb390776f4"
server_key_iv: "80f27905b05ccb0f6e7bd8d6623c51cb"
server_key_version: "encryptionkey@0"
I20260809 19:14:37.480127 10180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "63950191f7db4cee9f4798f073285953"
format_stamp: "Formatted at 2026-08-09 19:14:37 on dist-test-slave-4tdj"
server_key: "16f8dd1651a63c2e5b69bedb390776f4"
server_key_iv: "80f27905b05ccb0f6e7bd8d6623c51cb"
server_key_version: "encryptionkey@0"
I20260809 19:14:37.484905 10180 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 19:14:37.488186 10207 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:37.489336 10180 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 19:14:37.489500 10180 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "63950191f7db4cee9f4798f073285953"
format_stamp: "Formatted at 2026-08-09 19:14:37 on dist-test-slave-4tdj"
server_key: "16f8dd1651a63c2e5b69bedb390776f4"
server_key_iv: "80f27905b05ccb0f6e7bd8d6623c51cb"
server_key_version: "encryptionkey@0"
I20260809 19:14:37.489671 10180 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:37.510150 10180 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:37.514007 10180 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:37.514251 10180 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:37.530933 10180 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:37161
I20260809 19:14:37.530985 10297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:37161 every 8 connection(s)
I20260809 19:14:37.532152 10180 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:14:37.535611 10298 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:37.537992 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 10180
I20260809 19:14:37.538192 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:14:37.538753 7324 external_mini_cluster.cc:1428] Setting key 3cd2f73c7b8c1604714394f1132d5cde
I20260809 19:14:37.547367 10298 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63950191f7db4cee9f4798f073285953: Bootstrap starting.
I20260809 19:14:37.550992 10298 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 63950191f7db4cee9f4798f073285953: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:37.552261 10298 log.cc:824] T 00000000000000000000000000000000 P 63950191f7db4cee9f4798f073285953: Log is configured to *not* fsync() on all Append() calls
Aug 09 19:14:37 dist-test-slave-4tdj krb5kdc[10163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302877, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:14:37.554963 10298 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63950191f7db4cee9f4798f073285953: No bootstrap required, opened a new log
I20260809 19:14:37.560745 10309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:37.540509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54873 (local address 127.7.39.62:37161)
0809 19:14:37.541289 (+ 780us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:37.541303 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:37.541345 (+ 42us) server_negotiation.cc:407] Connection header received
0809 19:14:37.543025 (+ 1680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:37.543047 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:37.543398 (+ 351us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:37.543695 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:37.545414 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:37.546709 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:37.548411 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:37.549052 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:37.549173 (+ 121us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:37.554059 (+ 4886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:37.554066 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:37.554078 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:37.554118 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:37.556942 (+ 2824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:37.557654 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:37.557660 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:37.557666 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:37.557821 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:37.558245 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:37.558248 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:37.558250 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:37.558749 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:37.559078 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:37.559544 (+ 466us) server_negotiation.cc:299] Negotiation successful
0809 19:14:37.559812 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":588,"thread_start_us":343,"threads_started":1}
I20260809 19:14:37.562518 10298 raft_consensus.cc:348] T 00000000000000000000000000000000 P 63950191f7db4cee9f4798f073285953 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63950191f7db4cee9f4798f073285953" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 37161 } }
I20260809 19:14:37.562897 10298 raft_consensus.cc:374] T 00000000000000000000000000000000 P 63950191f7db4cee9f4798f073285953 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:14:37.563011 10298 raft_consensus.cc:729] T 00000000000000000000000000000000 P 63950191f7db4cee9f4798f073285953 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63950191f7db4cee9f4798f073285953, State: Initialized, Role: FOLLOWER
I20260809 19:14:37.563616 10298 consensus_queue.cc:260] T 00000000000000000000000000000000 P 63950191f7db4cee9f4798f073285953 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63950191f7db4cee9f4798f073285953" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 37161 } }
I20260809 19:14:37.563855 10298 raft_consensus.cc:388] T 00000000000000000000000000000000 P 63950191f7db4cee9f4798f073285953 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:14:37.563995 10298 raft_consensus.cc:482] T 00000000000000000000000000000000 P 63950191f7db4cee9f4798f073285953 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:14:37.564162 10298 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 63950191f7db4cee9f4798f073285953 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:37.564227 7324 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:14:37.567091 10298 raft_consensus.cc:504] T 00000000000000000000000000000000 P 63950191f7db4cee9f4798f073285953 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63950191f7db4cee9f4798f073285953" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 37161 } }
I20260809 19:14:37.567675 10298 leader_election.cc:302] T 00000000000000000000000000000000 P 63950191f7db4cee9f4798f073285953 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 63950191f7db4cee9f4798f073285953; no voters:
I20260809 19:14:37.568279 10298 leader_election.cc:288] T 00000000000000000000000000000000 P 63950191f7db4cee9f4798f073285953 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:14:37.568346 10318 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 63950191f7db4cee9f4798f073285953 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:14:37.569597 10318 raft_consensus.cc:686] T 00000000000000000000000000000000 P 63950191f7db4cee9f4798f073285953 [term 1 LEADER]: Becoming Leader. State: Replica: 63950191f7db4cee9f4798f073285953, State: Running, Role: LEADER
I20260809 19:14:37.570238 10318 consensus_queue.cc:237] T 00000000000000000000000000000000 P 63950191f7db4cee9f4798f073285953 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63950191f7db4cee9f4798f073285953" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 37161 } }
I20260809 19:14:37.570587 10298 sys_catalog.cc:564] T 00000000000000000000000000000000 P 63950191f7db4cee9f4798f073285953 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:14:37.574651 10321 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63950191f7db4cee9f4798f073285953 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "63950191f7db4cee9f4798f073285953" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63950191f7db4cee9f4798f073285953" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 37161 } } }
I20260809 19:14:37.574993 10321 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63950191f7db4cee9f4798f073285953 [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:37.581743 10323 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63950191f7db4cee9f4798f073285953 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 63950191f7db4cee9f4798f073285953. Latest consensus state: current_term: 1 leader_uuid: "63950191f7db4cee9f4798f073285953" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63950191f7db4cee9f4798f073285953" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 37161 } } }
I20260809 19:14:37.582028 10337 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:14:37.582427 10323 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63950191f7db4cee9f4798f073285953 [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:37.587657 10337 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:14:37.588197 10309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:37.569924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37075 (local address 127.7.39.62:37161)
0809 19:14:37.570069 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:37.570074 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:37.570721 (+ 647us) server_negotiation.cc:407] Connection header received
0809 19:14:37.570964 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:37.570970 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:37.571042 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:37.571148 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:37.573057 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:37.574386 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:37.576323 (+ 1937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:37.577022 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:37.577140 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:37.580398 (+ 3258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:37.580409 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:37.580414 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:37.580448 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:37.584049 (+ 3601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:37.584988 (+ 939us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:37.584993 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:37.584996 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:37.585129 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:37.585717 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:37.585725 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:37.585729 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:37.586169 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:37.586466 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:37.587679 (+ 1213us) server_negotiation.cc:299] Negotiation successful
0809 19:14:37.587848 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 19:14:37.597318 10337 catalog_manager.cc:1347] Generated new cluster ID: 811d242bcacf43e3bfea4a76da7fa69a
I20260809 19:14:37.597424 10337 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:14:37.614418 10337 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:14:37.615530 10337 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:14:37.623534 10337 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 63950191f7db4cee9f4798f073285953: Generated new TSK 0
I20260809 19:14:37.624214 10337 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:14:37.630054 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 10180
I20260809 19:14:37.631888 10291 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:14:37.717696 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 10180
W20260809 19:14:37.739460 10159 connection.cc:535] client connection to 127.7.39.62:37161 recv error: Network error: failed to read from TLS socket (remote: 127.7.39.62:37161): Connection reset by peer (error 104)
2026-08-09T19:14:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2070 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:14:37 dist-test-slave-4tdj krb5kdc[10355](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:14:37 dist-test-slave-4tdj krb5kdc[10355](info): set up 2 sockets
Aug 09 19:14:37 dist-test-slave-4tdj krb5kdc[10355](info): commencing operation
krb5kdc: starting...
W20260809 19:14:38.932797 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.175s user 0.000s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:14:39 dist-test-slave-4tdj krb5kdc[10355](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302879, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:14:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:14:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.39.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
I20260809 19:14:39.185168 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:39993
--webserver_interface=127.7.39.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:35191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:39993
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:14:39.508458 10376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:39.508747 10376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:39.508888 10376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:39.515802 10376 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:14:39.515911 10376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:39.515988 10376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:39.516074 10376 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:14:39.516136 10376 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:14:39.525484 10376 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:35191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:39993
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:39993
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:39.526701 10376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:39.527969 10376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:39.538988 10384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:39.539023 10388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:39.539198 10391 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:39.540002 10376 server_base.cc:1034] running on GCE node
I20260809 19:14:39.540738 10376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:39.541970 10376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:39.543162 10376 hybrid_clock.cc:648] HybridClock initialized: now 1786302879543122 us; error 27 us; skew 500 ppm
I20260809 19:14:39.543475 10376 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:14:39 dist-test-slave-4tdj krb5kdc[10355](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302879, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:14:39.550680 10376 init.cc:377] Logged in from keytab as kudu/127.7.39.62@KRBTEST.COM (short username kudu)
I20260809 19:14:39.552048 10376 webserver.cc:460] Webserver started at http://127.7.39.62:33755/ using document root <none> and password file <none>
I20260809 19:14:39.552675 10376 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:39.552790 10376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:39.553069 10376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:39.555912 10376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "9798f88bd42c46d1a80573ea3f871854"
format_stamp: "Formatted at 2026-08-09 19:14:39 on dist-test-slave-4tdj"
server_key: "7f7ac8c4ce3ac669e0aabf295fee665d"
server_key_iv: "b8c91f0743800eab72e5748eb95189ef"
server_key_version: "encryptionkey@0"
I20260809 19:14:39.556628 10376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "9798f88bd42c46d1a80573ea3f871854"
format_stamp: "Formatted at 2026-08-09 19:14:39 on dist-test-slave-4tdj"
server_key: "7f7ac8c4ce3ac669e0aabf295fee665d"
server_key_iv: "b8c91f0743800eab72e5748eb95189ef"
server_key_version: "encryptionkey@0"
I20260809 19:14:39.561470 10376 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260809 19:14:39.564646 10407 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:39.565832 10376 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 19:14:39.565989 10376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "9798f88bd42c46d1a80573ea3f871854"
format_stamp: "Formatted at 2026-08-09 19:14:39 on dist-test-slave-4tdj"
server_key: "7f7ac8c4ce3ac669e0aabf295fee665d"
server_key_iv: "b8c91f0743800eab72e5748eb95189ef"
server_key_version: "encryptionkey@0"
I20260809 19:14:39.566155 10376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:39.584348 10376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:39.588011 10376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:39.588249 10376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:39.605301 10376 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:39993
I20260809 19:14:39.605360 10481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:39993 every 8 connection(s)
I20260809 19:14:39.606561 10376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:14:39.608372 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 10376
I20260809 19:14:39.608530 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:14:39.608946 7324 external_mini_cluster.cc:1428] Setting key 5550e2eee410ec43ca80950375c44c77
I20260809 19:14:39.610435 10482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:39.621588 10486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:39.610543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60337 (local address 127.7.39.62:39993)
0809 19:14:39.611269 (+ 726us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:39.611279 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:39.611318 (+ 39us) server_negotiation.cc:407] Connection header received
0809 19:14:39.612831 (+ 1513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:39.612850 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:39.613201 (+ 351us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:39.613506 (+ 305us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:39.614137 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:39.615426 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:39.617339 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:39.617963 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:39.618078 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:39.619433 (+ 1355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:39.619440 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:39.619455 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:39.619973 (+ 518us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:39.620046 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:39.620073 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:39.620190 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:39.620487 (+ 297us) server_negotiation.cc:299] Negotiation successful
0809 19:14:39.620654 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":536,"thread_start_us":324,"threads_started":1}
I20260809 19:14:39.623057 10482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9798f88bd42c46d1a80573ea3f871854: Bootstrap starting.
I20260809 19:14:39.625031 7324 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:14:39.626632 10482 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9798f88bd42c46d1a80573ea3f871854: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:39.627897 10482 log.cc:824] T 00000000000000000000000000000000 P 9798f88bd42c46d1a80573ea3f871854: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:39.630998 10482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9798f88bd42c46d1a80573ea3f871854: No bootstrap required, opened a new log
I20260809 19:14:39.636616 10486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:39.630257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57079 (local address 127.7.39.62:39993)
0809 19:14:39.630434 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:39.630440 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:39.630905 (+ 465us) server_negotiation.cc:407] Connection header received
0809 19:14:39.631047 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:39.631054 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:39.631128 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:39.631240 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:39.631664 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:39.632732 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:39.633970 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:39.634740 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:39.634886 (+ 146us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:39.635809 (+ 923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:39.635816 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:39.635822 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:39.635843 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:39.635905 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:39.635931 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:39.636098 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:39.636204 (+ 106us) server_negotiation.cc:299] Negotiation successful
0809 19:14:39.636264 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 19:14:39.639827 10482 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9798f88bd42c46d1a80573ea3f871854 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9798f88bd42c46d1a80573ea3f871854" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39993 } }
I20260809 19:14:39.640151 10482 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9798f88bd42c46d1a80573ea3f871854 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:14:39.640231 10482 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9798f88bd42c46d1a80573ea3f871854 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9798f88bd42c46d1a80573ea3f871854, State: Initialized, Role: FOLLOWER
I20260809 19:14:39.640723 10482 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9798f88bd42c46d1a80573ea3f871854 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9798f88bd42c46d1a80573ea3f871854" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39993 } }
I20260809 19:14:39.640945 10482 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9798f88bd42c46d1a80573ea3f871854 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:14:39.641050 10482 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9798f88bd42c46d1a80573ea3f871854 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:14:39.641194 10482 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9798f88bd42c46d1a80573ea3f871854 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:39.643342 10482 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9798f88bd42c46d1a80573ea3f871854 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9798f88bd42c46d1a80573ea3f871854" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39993 } }
I20260809 19:14:39.643839 10482 leader_election.cc:302] T 00000000000000000000000000000000 P 9798f88bd42c46d1a80573ea3f871854 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9798f88bd42c46d1a80573ea3f871854; no voters:
I20260809 19:14:39.644400 10482 leader_election.cc:288] T 00000000000000000000000000000000 P 9798f88bd42c46d1a80573ea3f871854 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:14:39.644500 10496 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9798f88bd42c46d1a80573ea3f871854 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:14:39.645175 10496 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9798f88bd42c46d1a80573ea3f871854 [term 1 LEADER]: Becoming Leader. State: Replica: 9798f88bd42c46d1a80573ea3f871854, State: Running, Role: LEADER
I20260809 19:14:39.645659 10496 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9798f88bd42c46d1a80573ea3f871854 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9798f88bd42c46d1a80573ea3f871854" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39993 } }
I20260809 19:14:39.646483 10482 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9798f88bd42c46d1a80573ea3f871854 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:14:39.648257 10501 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9798f88bd42c46d1a80573ea3f871854 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9798f88bd42c46d1a80573ea3f871854" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9798f88bd42c46d1a80573ea3f871854" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39993 } } }
I20260809 19:14:39.648732 10501 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9798f88bd42c46d1a80573ea3f871854 [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:39.649210 10503 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9798f88bd42c46d1a80573ea3f871854 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9798f88bd42c46d1a80573ea3f871854. Latest consensus state: current_term: 1 leader_uuid: "9798f88bd42c46d1a80573ea3f871854" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9798f88bd42c46d1a80573ea3f871854" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39993 } } }
I20260809 19:14:39.649528 10503 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9798f88bd42c46d1a80573ea3f871854 [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:39.654116 10513 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:14:39.659765 10513 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:14:39.668682 10513 catalog_manager.cc:1347] Generated new cluster ID: 74a770cbfbef470aac94d000481c2b53
I20260809 19:14:39.668771 10513 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:14:39.679234 10513 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:14:39.680879 10513 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:14:39.692098 10513 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9798f88bd42c46d1a80573ea3f871854: Generated new TSK 0
I20260809 19:14:39.692921 10513 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:14:39.704667 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 10376
W20260809 19:14:39.705636 10476 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:60337
W20260809 19:14:39.706319 7324 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 10376: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 19:14:39.706480 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 10376
W20260809 19:14:39.731751 10353 connection.cc:535] client connection to 127.7.39.62:39993 recv error: Network error: failed to read from TLS socket (remote: 127.7.39.62:39993): Connection reset by peer (error 104)
2026-08-09T19:14:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1992 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:14:39 dist-test-slave-4tdj krb5kdc[10533](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:14:39 dist-test-slave-4tdj krb5kdc[10533](info): set up 2 sockets
Aug 09 19:14:39 dist-test-slave-4tdj krb5kdc[10533](info): commencing operation
krb5kdc: starting...
W20260809 19:14:40.920445 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.170s user 0.004s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:14:41 dist-test-slave-4tdj krb5kdc[10533](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302881, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:14:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:14:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.39.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
I20260809 19:14:41.193197 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:39163
--webserver_interface=127.7.39.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:32919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:39163
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:14:41.518234 10558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:41.518522 10558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:41.518659 10558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:41.525483 10558 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:14:41.525597 10558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:41.525677 10558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:41.525760 10558 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:14:41.525821 10558 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:14:41.535054 10558 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:32919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:39163
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:39163
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:41.536208 10558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:41.537469 10558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:41.548471 10566 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:41.548565 10568 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:41.548542 10573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:41.549376 10558 server_base.cc:1034] running on GCE node
I20260809 19:14:41.550135 10558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:41.551422 10558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:41.552625 10558 hybrid_clock.cc:648] HybridClock initialized: now 1786302881552584 us; error 36 us; skew 500 ppm
I20260809 19:14:41.552944 10558 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:14:41 dist-test-slave-4tdj krb5kdc[10533](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302881, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:14:41.555884 10558 init.cc:377] Logged in from keytab as kudu/127.7.39.62@KRBTEST.COM (short username kudu)
I20260809 19:14:41.557260 10558 webserver.cc:460] Webserver started at http://127.7.39.62:33239/ using document root <none> and password file <none>
I20260809 19:14:41.557883 10558 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:41.558005 10558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:41.558285 10558 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:41.561138 10558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "e28eb7dc1f8644bc9b593bd94d28238f"
format_stamp: "Formatted at 2026-08-09 19:14:41 on dist-test-slave-4tdj"
server_key: "80301ceaea13f733086bd19f3c4c83c4"
server_key_iv: "68124e81635a0804cf90e711a73646f4"
server_key_version: "encryptionkey@0"
I20260809 19:14:41.561857 10558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "e28eb7dc1f8644bc9b593bd94d28238f"
format_stamp: "Formatted at 2026-08-09 19:14:41 on dist-test-slave-4tdj"
server_key: "80301ceaea13f733086bd19f3c4c83c4"
server_key_iv: "68124e81635a0804cf90e711a73646f4"
server_key_version: "encryptionkey@0"
I20260809 19:14:41.566675 10558 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 19:14:41.569868 10587 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:41.571097 10558 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.002s
I20260809 19:14:41.571247 10558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "e28eb7dc1f8644bc9b593bd94d28238f"
format_stamp: "Formatted at 2026-08-09 19:14:41 on dist-test-slave-4tdj"
server_key: "80301ceaea13f733086bd19f3c4c83c4"
server_key_iv: "68124e81635a0804cf90e711a73646f4"
server_key_version: "encryptionkey@0"
I20260809 19:14:41.571422 10558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:41.577162 10558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:41.580673 10558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:41.580931 10558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:41.597597 10558 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:39163
I20260809 19:14:41.597653 10667 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:39163 every 8 connection(s)
I20260809 19:14:41.598933 10558 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:14:41.602285 10675 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:41.607748 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 10558
I20260809 19:14:41.607932 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:14:41.608446 7324 external_mini_cluster.cc:1428] Setting key aa1a36c0c039dd192241fbb51666a9ee
I20260809 19:14:41.612785 10675 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e28eb7dc1f8644bc9b593bd94d28238f: Bootstrap starting.
I20260809 19:14:41.615758 10679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:41.610149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50449 (local address 127.7.39.62:39163)
0809 19:14:41.611012 (+ 863us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:41.611023 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:41.611063 (+ 40us) server_negotiation.cc:407] Connection header received
0809 19:14:41.612633 (+ 1570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:41.612655 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:41.612981 (+ 326us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:41.613281 (+ 300us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:41.614322 (+ 1041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:41.614331 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:41.614347 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:41.614365 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:41.614425 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:41.614445 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:41.614637 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:41.614729 (+ 92us) server_negotiation.cc:299] Negotiation successful
0809 19:14:41.614903 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":639,"thread_start_us":427,"threads_started":1}
I20260809 19:14:41.616158 10675 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e28eb7dc1f8644bc9b593bd94d28238f: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:41.617185 10675 log.cc:824] T 00000000000000000000000000000000 P e28eb7dc1f8644bc9b593bd94d28238f: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:41.619207 7324 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:14:41.620085 10675 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e28eb7dc1f8644bc9b593bd94d28238f: No bootstrap required, opened a new log
I20260809 19:14:41.626151 10679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:41.624023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51037 (local address 127.7.39.62:39163)
0809 19:14:41.624155 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:41.624159 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:41.624491 (+ 332us) server_negotiation.cc:407] Connection header received
0809 19:14:41.624644 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:41.624648 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:41.624690 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:41.624771 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:41.625607 (+ 836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:41.625614 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:41.625617 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:41.625631 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:41.625665 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:41.625679 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:41.625774 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:41.625874 (+ 100us) server_negotiation.cc:299] Negotiation successful
0809 19:14:41.625918 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 19:14:41.628786 10675 raft_consensus.cc:348] T 00000000000000000000000000000000 P e28eb7dc1f8644bc9b593bd94d28238f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e28eb7dc1f8644bc9b593bd94d28238f" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39163 } }
I20260809 19:14:41.629110 10675 raft_consensus.cc:374] T 00000000000000000000000000000000 P e28eb7dc1f8644bc9b593bd94d28238f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:14:41.629205 10675 raft_consensus.cc:729] T 00000000000000000000000000000000 P e28eb7dc1f8644bc9b593bd94d28238f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e28eb7dc1f8644bc9b593bd94d28238f, State: Initialized, Role: FOLLOWER
I20260809 19:14:41.629750 10675 consensus_queue.cc:260] T 00000000000000000000000000000000 P e28eb7dc1f8644bc9b593bd94d28238f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e28eb7dc1f8644bc9b593bd94d28238f" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39163 } }
I20260809 19:14:41.629967 10675 raft_consensus.cc:388] T 00000000000000000000000000000000 P e28eb7dc1f8644bc9b593bd94d28238f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:14:41.630102 10675 raft_consensus.cc:482] T 00000000000000000000000000000000 P e28eb7dc1f8644bc9b593bd94d28238f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:14:41.630249 10675 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e28eb7dc1f8644bc9b593bd94d28238f [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:41.632274 10675 raft_consensus.cc:504] T 00000000000000000000000000000000 P e28eb7dc1f8644bc9b593bd94d28238f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e28eb7dc1f8644bc9b593bd94d28238f" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39163 } }
I20260809 19:14:41.632706 10675 leader_election.cc:302] T 00000000000000000000000000000000 P e28eb7dc1f8644bc9b593bd94d28238f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e28eb7dc1f8644bc9b593bd94d28238f; no voters:
I20260809 19:14:41.633287 10675 leader_election.cc:288] T 00000000000000000000000000000000 P e28eb7dc1f8644bc9b593bd94d28238f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:14:41.633383 10694 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e28eb7dc1f8644bc9b593bd94d28238f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:14:41.633978 10694 raft_consensus.cc:686] T 00000000000000000000000000000000 P e28eb7dc1f8644bc9b593bd94d28238f [term 1 LEADER]: Becoming Leader. State: Replica: e28eb7dc1f8644bc9b593bd94d28238f, State: Running, Role: LEADER
I20260809 19:14:41.634595 10694 consensus_queue.cc:237] T 00000000000000000000000000000000 P e28eb7dc1f8644bc9b593bd94d28238f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e28eb7dc1f8644bc9b593bd94d28238f" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39163 } }
I20260809 19:14:41.635426 10675 sys_catalog.cc:564] T 00000000000000000000000000000000 P e28eb7dc1f8644bc9b593bd94d28238f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:14:41.637336 10696 sys_catalog.cc:455] T 00000000000000000000000000000000 P e28eb7dc1f8644bc9b593bd94d28238f [sys.catalog]: SysCatalogTable state changed. Reason: New leader e28eb7dc1f8644bc9b593bd94d28238f. Latest consensus state: current_term: 1 leader_uuid: "e28eb7dc1f8644bc9b593bd94d28238f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e28eb7dc1f8644bc9b593bd94d28238f" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39163 } } }
I20260809 19:14:41.637701 10696 sys_catalog.cc:458] T 00000000000000000000000000000000 P e28eb7dc1f8644bc9b593bd94d28238f [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:41.642454 10695 sys_catalog.cc:455] T 00000000000000000000000000000000 P e28eb7dc1f8644bc9b593bd94d28238f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e28eb7dc1f8644bc9b593bd94d28238f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e28eb7dc1f8644bc9b593bd94d28238f" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39163 } } }
I20260809 19:14:41.642882 10704 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:14:41.642915 10695 sys_catalog.cc:458] T 00000000000000000000000000000000 P e28eb7dc1f8644bc9b593bd94d28238f [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:41.647600 10704 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:14:41.655905 10704 catalog_manager.cc:1347] Generated new cluster ID: bd6bc8d4c334439f8db64ffed5c4cb8b
I20260809 19:14:41.656003 10704 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:14:41.673916 10704 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:14:41.674365 10704 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:14:41.689581 10704 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e28eb7dc1f8644bc9b593bd94d28238f: Generated new TSK 0
I20260809 19:14:41.690470 10704 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:14:41.698685 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 10558
W20260809 19:14:41.699955 10660 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:50449
W20260809 19:14:41.700558 7324 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 10558: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 19:14:41.700681 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 10558
2026-08-09T19:14:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1994 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:14:41 dist-test-slave-4tdj krb5kdc[10728](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:14:41 dist-test-slave-4tdj krb5kdc[10728](info): set up 2 sockets
Aug 09 19:14:41 dist-test-slave-4tdj krb5kdc[10728](info): commencing operation
krb5kdc: starting...
W20260809 19:14:42.955615 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.210s user 0.000s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:14:43 dist-test-slave-4tdj krb5kdc[10728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302883, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:14:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:14:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.39.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
I20260809 19:14:43.198941 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:43757
--webserver_interface=127.7.39.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:41061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:43757
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:14:43.519294 10755 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:43.519580 10755 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:43.519726 10755 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:43.526633 10755 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:14:43.526747 10755 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:43.526827 10755 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:43.526913 10755 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:14:43.526978 10755 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:14:43.536446 10755 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:41061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:43757
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:43757
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:43.537770 10755 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:43.539115 10755 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:43.550431 10765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:43.550375 10763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:43.550459 10762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:43.551435 10755 server_base.cc:1034] running on GCE node
I20260809 19:14:43.552163 10755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:43.553558 10755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:43.554754 10755 hybrid_clock.cc:648] HybridClock initialized: now 1786302883554710 us; error 30 us; skew 500 ppm
I20260809 19:14:43.555096 10755 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:14:43 dist-test-slave-4tdj krb5kdc[10728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302883, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:14:43.557950 10755 init.cc:377] Logged in from keytab as kudu/127.7.39.62@KRBTEST.COM (short username kudu)
I20260809 19:14:43.559358 10755 webserver.cc:460] Webserver started at http://127.7.39.62:41217/ using document root <none> and password file <none>
I20260809 19:14:43.559986 10755 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:43.560117 10755 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:43.560396 10755 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:43.563295 10755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "382dcd15136942f59891c40eeb52db09"
format_stamp: "Formatted at 2026-08-09 19:14:43 on dist-test-slave-4tdj"
server_key: "e57aec5c2de25ad73ab355b606b13738"
server_key_iv: "108b2e3ef4f9997acbaa07fbf74e8352"
server_key_version: "encryptionkey@0"
I20260809 19:14:43.564011 10755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "382dcd15136942f59891c40eeb52db09"
format_stamp: "Formatted at 2026-08-09 19:14:43 on dist-test-slave-4tdj"
server_key: "e57aec5c2de25ad73ab355b606b13738"
server_key_iv: "108b2e3ef4f9997acbaa07fbf74e8352"
server_key_version: "encryptionkey@0"
I20260809 19:14:43.568758 10755 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 19:14:43.571952 10772 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:43.573150 10755 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 19:14:43.573311 10755 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "382dcd15136942f59891c40eeb52db09"
format_stamp: "Formatted at 2026-08-09 19:14:43 on dist-test-slave-4tdj"
server_key: "e57aec5c2de25ad73ab355b606b13738"
server_key_iv: "108b2e3ef4f9997acbaa07fbf74e8352"
server_key_version: "encryptionkey@0"
I20260809 19:14:43.573486 10755 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:43.613754 10755 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:43.617439 10755 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:43.617699 10755 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:43.634845 10755 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:43757
I20260809 19:14:43.634881 10860 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:43757 every 8 connection(s)
I20260809 19:14:43.636123 10755 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:14:43.639770 10862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:43.640232 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 10755
I20260809 19:14:43.640409 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:14:43.640955 7324 external_mini_cluster.cc:1428] Setting key cf50c67607c870fd10997f9c2c9b1d12
I20260809 19:14:43.653249 10862 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 382dcd15136942f59891c40eeb52db09: Bootstrap starting.
Aug 09 19:14:43 dist-test-slave-4tdj krb5kdc[10728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302883, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:14:43.656977 10862 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 382dcd15136942f59891c40eeb52db09: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:43.658010 10862 log.cc:824] T 00000000000000000000000000000000 P 382dcd15136942f59891c40eeb52db09: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:43.661017 10862 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 382dcd15136942f59891c40eeb52db09: No bootstrap required, opened a new log
I20260809 19:14:43.664621 10868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:43.642752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60625 (local address 127.7.39.62:43757)
0809 19:14:43.643534 (+ 782us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:43.643545 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:43.643591 (+ 46us) server_negotiation.cc:407] Connection header received
0809 19:14:43.645781 (+ 2190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:43.645803 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:43.646182 (+ 379us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:43.646539 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:43.648281 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:43.649580 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:43.651524 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:43.652142 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:43.652261 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:43.656933 (+ 4672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:43.656941 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:43.656953 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:43.656990 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:43.660295 (+ 3305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:43.660936 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:43.660944 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:43.660951 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:43.661178 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:43.661529 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:43.661534 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:43.661537 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:43.662225 (+ 688us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:43.662565 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:43.662892 (+ 327us) server_negotiation.cc:299] Negotiation successful
0809 19:14:43.663335 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":345,"threads_started":1}
I20260809 19:14:43.668051 7324 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:14:43.670306 10862 raft_consensus.cc:348] T 00000000000000000000000000000000 P 382dcd15136942f59891c40eeb52db09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "382dcd15136942f59891c40eeb52db09" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 43757 } }
I20260809 19:14:43.670735 10862 raft_consensus.cc:374] T 00000000000000000000000000000000 P 382dcd15136942f59891c40eeb52db09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:14:43.670837 10862 raft_consensus.cc:729] T 00000000000000000000000000000000 P 382dcd15136942f59891c40eeb52db09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382dcd15136942f59891c40eeb52db09, State: Initialized, Role: FOLLOWER
I20260809 19:14:43.671489 10862 consensus_queue.cc:260] T 00000000000000000000000000000000 P 382dcd15136942f59891c40eeb52db09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "382dcd15136942f59891c40eeb52db09" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 43757 } }
I20260809 19:14:43.671792 10862 raft_consensus.cc:388] T 00000000000000000000000000000000 P 382dcd15136942f59891c40eeb52db09 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:14:43.671950 10862 raft_consensus.cc:482] T 00000000000000000000000000000000 P 382dcd15136942f59891c40eeb52db09 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:14:43.672127 10862 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 382dcd15136942f59891c40eeb52db09 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:43.675115 10862 raft_consensus.cc:504] T 00000000000000000000000000000000 P 382dcd15136942f59891c40eeb52db09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "382dcd15136942f59891c40eeb52db09" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 43757 } }
I20260809 19:14:43.675694 10862 leader_election.cc:302] T 00000000000000000000000000000000 P 382dcd15136942f59891c40eeb52db09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 382dcd15136942f59891c40eeb52db09; no voters:
I20260809 19:14:43.676370 10862 leader_election.cc:288] T 00000000000000000000000000000000 P 382dcd15136942f59891c40eeb52db09 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:14:43.676473 10883 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 382dcd15136942f59891c40eeb52db09 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:14:43.678570 10862 sys_catalog.cc:564] T 00000000000000000000000000000000 P 382dcd15136942f59891c40eeb52db09 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:14:43.683163 10883 raft_consensus.cc:686] T 00000000000000000000000000000000 P 382dcd15136942f59891c40eeb52db09 [term 1 LEADER]: Becoming Leader. State: Replica: 382dcd15136942f59891c40eeb52db09, State: Running, Role: LEADER
I20260809 19:14:43.683763 10883 consensus_queue.cc:237] T 00000000000000000000000000000000 P 382dcd15136942f59891c40eeb52db09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "382dcd15136942f59891c40eeb52db09" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 43757 } }
I20260809 19:14:43.686720 10884 sys_catalog.cc:455] T 00000000000000000000000000000000 P 382dcd15136942f59891c40eeb52db09 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "382dcd15136942f59891c40eeb52db09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "382dcd15136942f59891c40eeb52db09" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 43757 } } }
I20260809 19:14:43.687161 10884 sys_catalog.cc:458] T 00000000000000000000000000000000 P 382dcd15136942f59891c40eeb52db09 [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:43.689237 10868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:43.673195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33079 (local address 127.7.39.62:43757)
0809 19:14:43.673370 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:43.673376 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:43.673906 (+ 530us) server_negotiation.cc:407] Connection header received
0809 19:14:43.674048 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:43.674052 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:43.674106 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:43.674175 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:43.675965 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:43.676944 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:43.678470 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:43.678944 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:43.679053 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:43.681283 (+ 2230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:43.681288 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:43.681291 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:43.681320 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:43.685018 (+ 3698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:43.685897 (+ 879us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:43.685903 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:43.685910 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:43.686087 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:43.686565 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:43.686571 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:43.686575 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:43.687140 (+ 565us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:43.687409 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:43.688596 (+ 1187us) server_negotiation.cc:299] Negotiation successful
0809 19:14:43.688815 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 19:14:43.691049 10894 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:14:43.691282 10886 sys_catalog.cc:455] T 00000000000000000000000000000000 P 382dcd15136942f59891c40eeb52db09 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 382dcd15136942f59891c40eeb52db09. Latest consensus state: current_term: 1 leader_uuid: "382dcd15136942f59891c40eeb52db09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "382dcd15136942f59891c40eeb52db09" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 43757 } } }
I20260809 19:14:43.691555 10886 sys_catalog.cc:458] T 00000000000000000000000000000000 P 382dcd15136942f59891c40eeb52db09 [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:43.696319 10894 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:14:43.704720 10894 catalog_manager.cc:1347] Generated new cluster ID: 461297dcd33f491bb8947c18d0ff6d3b
I20260809 19:14:43.704818 10894 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:14:43.719792 10894 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:14:43.720956 10894 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:14:43.735049 10894 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 382dcd15136942f59891c40eeb52db09: Generated new TSK 0
I20260809 19:14:43.735773 10894 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:14:43.740806 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 10755
I20260809 19:14:43.741927 10853 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:14:43.829075 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 10755
2026-08-09T19:14:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2121 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:14:43 dist-test-slave-4tdj krb5kdc[10915](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:14:43 dist-test-slave-4tdj krb5kdc[10915](info): set up 2 sockets
Aug 09 19:14:43 dist-test-slave-4tdj krb5kdc[10915](info): commencing operation
krb5kdc: starting...
W20260809 19:14:45.060040 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.193s user 0.002s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:14:45 dist-test-slave-4tdj krb5kdc[10915](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:14:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:14:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.39.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
I20260809 19:14:45.313673 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:33025
--webserver_interface=127.7.39.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:37543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:33025
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:14:45.632441 10939 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:45.632694 10939 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:45.632810 10939 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:45.639674 10939 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:14:45.639768 10939 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:45.639840 10939 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:45.639918 10939 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:14:45.639981 10939 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:14:45.649241 10939 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:37543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:33025
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:33025
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:45.650476 10939 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:45.651676 10939 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:45.662472 10946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:45.662601 10947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:45.662626 10950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:45.663420 10939 server_base.cc:1034] running on GCE node
I20260809 19:14:45.664153 10939 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:45.665383 10939 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:45.666579 10939 hybrid_clock.cc:648] HybridClock initialized: now 1786302885666539 us; error 30 us; skew 500 ppm
I20260809 19:14:45.666870 10939 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:14:45 dist-test-slave-4tdj krb5kdc[10915](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302885, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:14:45.672521 10939 init.cc:377] Logged in from keytab as kudu/127.7.39.62@KRBTEST.COM (short username kudu)
I20260809 19:14:45.673813 10939 webserver.cc:460] Webserver started at http://127.7.39.62:44585/ using document root <none> and password file <none>
I20260809 19:14:45.674470 10939 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:45.674585 10939 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:45.674829 10939 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:45.677711 10939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "79c99a99ecec465aa54862028fd94a02"
format_stamp: "Formatted at 2026-08-09 19:14:45 on dist-test-slave-4tdj"
server_key: "99d86735106077b50970c87c175fae88"
server_key_iv: "0bbe0b1aa627c24fdbd05138e1231909"
server_key_version: "encryptionkey@0"
I20260809 19:14:45.678486 10939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "79c99a99ecec465aa54862028fd94a02"
format_stamp: "Formatted at 2026-08-09 19:14:45 on dist-test-slave-4tdj"
server_key: "99d86735106077b50970c87c175fae88"
server_key_iv: "0bbe0b1aa627c24fdbd05138e1231909"
server_key_version: "encryptionkey@0"
I20260809 19:14:45.683274 10939 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 19:14:45.686458 10960 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:45.687680 10939 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 19:14:45.687819 10939 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "79c99a99ecec465aa54862028fd94a02"
format_stamp: "Formatted at 2026-08-09 19:14:45 on dist-test-slave-4tdj"
server_key: "99d86735106077b50970c87c175fae88"
server_key_iv: "0bbe0b1aa627c24fdbd05138e1231909"
server_key_version: "encryptionkey@0"
I20260809 19:14:45.687969 10939 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:45.700397 10939 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:45.704180 10939 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:45.704389 10939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:45.720886 10939 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:33025
I20260809 19:14:45.720921 11042 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:33025 every 8 connection(s)
I20260809 19:14:45.722139 10939 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:14:45.725677 11043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:45.726106 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 10939
I20260809 19:14:45.726312 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:14:45.726918 7324 external_mini_cluster.cc:1428] Setting key b3f24d1f3a4a5d9f235ae2563d7584a2
I20260809 19:14:45.738499 11043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79c99a99ecec465aa54862028fd94a02: Bootstrap starting.
I20260809 19:14:45.739940 11047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:45.728588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57383 (local address 127.7.39.62:33025)
0809 19:14:45.729355 (+ 767us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:45.729366 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:45.729407 (+ 41us) server_negotiation.cc:407] Connection header received
0809 19:14:45.731604 (+ 2197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:45.731626 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:45.731991 (+ 365us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:45.732301 (+ 310us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:45.732864 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:45.734089 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:45.735905 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:45.736579 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:45.736697 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:45.737835 (+ 1138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:45.737841 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:45.737853 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:45.738372 (+ 519us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:45.738450 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:45.738474 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:45.738567 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:45.738787 (+ 220us) server_negotiation.cc:299] Negotiation successful
0809 19:14:45.739025 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":561,"thread_start_us":335,"threads_started":1}
I20260809 19:14:45.741854 11043 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 79c99a99ecec465aa54862028fd94a02: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:45.743052 11043 log.cc:824] T 00000000000000000000000000000000 P 79c99a99ecec465aa54862028fd94a02: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:45.743512 7324 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:14:45.745950 11043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79c99a99ecec465aa54862028fd94a02: No bootstrap required, opened a new log
I20260809 19:14:45.754669 11043 raft_consensus.cc:348] T 00000000000000000000000000000000 P 79c99a99ecec465aa54862028fd94a02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79c99a99ecec465aa54862028fd94a02" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33025 } }
I20260809 19:14:45.755059 11043 raft_consensus.cc:374] T 00000000000000000000000000000000 P 79c99a99ecec465aa54862028fd94a02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:14:45.755160 11043 raft_consensus.cc:729] T 00000000000000000000000000000000 P 79c99a99ecec465aa54862028fd94a02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c99a99ecec465aa54862028fd94a02, State: Initialized, Role: FOLLOWER
I20260809 19:14:45.755744 11047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:45.748478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40765 (local address 127.7.39.62:33025)
0809 19:14:45.748795 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:45.748825 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:45.750277 (+ 1452us) server_negotiation.cc:407] Connection header received
0809 19:14:45.750483 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:45.750489 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:45.750572 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:45.750636 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:45.751415 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:45.752125 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:45.753420 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:45.753869 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:45.753975 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:45.755048 (+ 1073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:45.755053 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:45.755058 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:45.755079 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:45.755119 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:45.755134 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:45.755217 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:45.755366 (+ 149us) server_negotiation.cc:299] Negotiation successful
0809 19:14:45.755445 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168}
I20260809 19:14:45.755800 11043 consensus_queue.cc:260] T 00000000000000000000000000000000 P 79c99a99ecec465aa54862028fd94a02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79c99a99ecec465aa54862028fd94a02" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33025 } }
I20260809 19:14:45.756093 11043 raft_consensus.cc:388] T 00000000000000000000000000000000 P 79c99a99ecec465aa54862028fd94a02 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:14:45.756227 11043 raft_consensus.cc:482] T 00000000000000000000000000000000 P 79c99a99ecec465aa54862028fd94a02 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:14:45.756408 11043 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 79c99a99ecec465aa54862028fd94a02 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:45.758571 11043 raft_consensus.cc:504] T 00000000000000000000000000000000 P 79c99a99ecec465aa54862028fd94a02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79c99a99ecec465aa54862028fd94a02" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33025 } }
I20260809 19:14:45.759023 11043 leader_election.cc:302] T 00000000000000000000000000000000 P 79c99a99ecec465aa54862028fd94a02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 79c99a99ecec465aa54862028fd94a02; no voters:
I20260809 19:14:45.759590 11043 leader_election.cc:288] T 00000000000000000000000000000000 P 79c99a99ecec465aa54862028fd94a02 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:14:45.759704 11054 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 79c99a99ecec465aa54862028fd94a02 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:14:45.760571 11054 raft_consensus.cc:686] T 00000000000000000000000000000000 P 79c99a99ecec465aa54862028fd94a02 [term 1 LEADER]: Becoming Leader. State: Replica: 79c99a99ecec465aa54862028fd94a02, State: Running, Role: LEADER
I20260809 19:14:45.761153 11054 consensus_queue.cc:237] T 00000000000000000000000000000000 P 79c99a99ecec465aa54862028fd94a02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79c99a99ecec465aa54862028fd94a02" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33025 } }
I20260809 19:14:45.762032 11043 sys_catalog.cc:564] T 00000000000000000000000000000000 P 79c99a99ecec465aa54862028fd94a02 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:14:45.763877 11056 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79c99a99ecec465aa54862028fd94a02 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "79c99a99ecec465aa54862028fd94a02" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79c99a99ecec465aa54862028fd94a02" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33025 } } }
I20260809 19:14:45.764300 11056 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79c99a99ecec465aa54862028fd94a02 [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:45.765018 11058 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79c99a99ecec465aa54862028fd94a02 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 79c99a99ecec465aa54862028fd94a02. Latest consensus state: current_term: 1 leader_uuid: "79c99a99ecec465aa54862028fd94a02" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79c99a99ecec465aa54862028fd94a02" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 33025 } } }
I20260809 19:14:45.765409 11058 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79c99a99ecec465aa54862028fd94a02 [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:45.766953 11069 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:14:45.771404 11069 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:14:45.779263 11069 catalog_manager.cc:1347] Generated new cluster ID: 2e01a3139536444a91e5da72632f185e
I20260809 19:14:45.779357 11069 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:14:45.799579 11069 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:14:45.801321 11069 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:14:45.818929 11069 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 79c99a99ecec465aa54862028fd94a02: Generated new TSK 0
I20260809 19:14:45.819860 11069 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:14:45.829386 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 10939
W20260809 19:14:45.830687 11035 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:57383
W20260809 19:14:45.831305 7324 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 10939: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 19:14:45.831462 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 10939
2026-08-09T19:14:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2007 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:14:45 dist-test-slave-4tdj krb5kdc[11086](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:14:45 dist-test-slave-4tdj krb5kdc[11086](info): set up 2 sockets
Aug 09 19:14:45 dist-test-slave-4tdj krb5kdc[11086](info): commencing operation
krb5kdc: starting...
W20260809 19:14:47.043457 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.170s user 0.005s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:14:47 dist-test-slave-4tdj krb5kdc[11086](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302887, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:14:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:14:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.39.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
I20260809 19:14:47.302008 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:34573
--webserver_interface=127.7.39.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:41561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:34573
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:14:47.620761 11110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:47.621008 11110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:47.621137 11110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:47.627959 11110 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:14:47.628054 11110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:47.628131 11110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:47.628213 11110 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:14:47.628273 11110 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:14:47.637396 11110 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:41561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:34573
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:34573
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:47.638491 11110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:47.639704 11110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:47.650488 11121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:47.650451 11116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:47.650552 11117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:47.651367 11110 server_base.cc:1034] running on GCE node
I20260809 19:14:47.652061 11110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:47.653247 11110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:47.654433 11110 hybrid_clock.cc:648] HybridClock initialized: now 1786302887654391 us; error 36 us; skew 500 ppm
I20260809 19:14:47.654758 11110 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:14:47 dist-test-slave-4tdj krb5kdc[11086](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302887, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:14:47.657632 11110 init.cc:377] Logged in from keytab as kudu/127.7.39.62@KRBTEST.COM (short username kudu)
I20260809 19:14:47.658977 11110 webserver.cc:460] Webserver started at http://127.7.39.62:39337/ using document root <none> and password file <none>
I20260809 19:14:47.659588 11110 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:47.659703 11110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:47.660043 11110 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:47.662927 11110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "43bf145119374c6db364b463c57c7ad8"
format_stamp: "Formatted at 2026-08-09 19:14:47 on dist-test-slave-4tdj"
server_key: "d8c814417770ff31a56167cfb6368981"
server_key_iv: "dd799339c82f55a5e2448283e94be704"
server_key_version: "encryptionkey@0"
I20260809 19:14:47.663647 11110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "43bf145119374c6db364b463c57c7ad8"
format_stamp: "Formatted at 2026-08-09 19:14:47 on dist-test-slave-4tdj"
server_key: "d8c814417770ff31a56167cfb6368981"
server_key_iv: "dd799339c82f55a5e2448283e94be704"
server_key_version: "encryptionkey@0"
I20260809 19:14:47.668433 11110 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 19:14:47.671736 11130 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:47.672950 11110 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 19:14:47.673094 11110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "43bf145119374c6db364b463c57c7ad8"
format_stamp: "Formatted at 2026-08-09 19:14:47 on dist-test-slave-4tdj"
server_key: "d8c814417770ff31a56167cfb6368981"
server_key_iv: "dd799339c82f55a5e2448283e94be704"
server_key_version: "encryptionkey@0"
I20260809 19:14:47.673257 11110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:47.678442 11110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:47.681939 11110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:47.682192 11110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:47.698974 11110 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:34573
I20260809 19:14:47.699038 11212 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:34573 every 8 connection(s)
I20260809 19:14:47.700191 11110 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:14:47.702077 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 11110
I20260809 19:14:47.702231 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:14:47.702663 7324 external_mini_cluster.cc:1428] Setting key f2e23e6b5d5ad51b8f4b4de59c1ca3ab
I20260809 19:14:47.703902 11213 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:47.710625 11218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:47.704249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52945 (local address 127.7.39.62:34573)
0809 19:14:47.705070 (+ 821us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:47.705084 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:47.705134 (+ 50us) server_negotiation.cc:407] Connection header received
0809 19:14:47.707006 (+ 1872us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:47.707032 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:47.707433 (+ 401us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:47.707858 (+ 425us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:47.708780 (+ 922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:47.708788 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:47.708804 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:47.708821 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:47.708909 (+ 88us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:47.708941 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:47.709147 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:47.709283 (+ 136us) server_negotiation.cc:299] Negotiation successful
0809 19:14:47.709456 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":579,"thread_start_us":339,"threads_started":1}
I20260809 19:14:47.713805 7324 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:14:47.717621 11213 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43bf145119374c6db364b463c57c7ad8: Bootstrap starting.
I20260809 19:14:47.720892 11218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:47.718837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44871 (local address 127.7.39.62:34573)
0809 19:14:47.718986 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:47.718991 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:47.719283 (+ 292us) server_negotiation.cc:407] Connection header received
0809 19:14:47.719406 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:47.719411 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:47.719467 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:47.719574 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:47.720344 (+ 770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:47.720349 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:47.720353 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:14:47.720371 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:47.720411 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:14:47.720429 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:47.720544 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:47.720592 (+ 48us) server_negotiation.cc:299] Negotiation successful
0809 19:14:47.720639 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 19:14:47.721117 11213 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 43bf145119374c6db364b463c57c7ad8: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:47.722106 11213 log.cc:824] T 00000000000000000000000000000000 P 43bf145119374c6db364b463c57c7ad8: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:47.724519 11213 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43bf145119374c6db364b463c57c7ad8: No bootstrap required, opened a new log
I20260809 19:14:47.731206 11213 raft_consensus.cc:348] T 00000000000000000000000000000000 P 43bf145119374c6db364b463c57c7ad8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43bf145119374c6db364b463c57c7ad8" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34573 } }
I20260809 19:14:47.731534 11213 raft_consensus.cc:374] T 00000000000000000000000000000000 P 43bf145119374c6db364b463c57c7ad8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:14:47.731621 11213 raft_consensus.cc:729] T 00000000000000000000000000000000 P 43bf145119374c6db364b463c57c7ad8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43bf145119374c6db364b463c57c7ad8, State: Initialized, Role: FOLLOWER
I20260809 19:14:47.732113 11213 consensus_queue.cc:260] T 00000000000000000000000000000000 P 43bf145119374c6db364b463c57c7ad8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43bf145119374c6db364b463c57c7ad8" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34573 } }
I20260809 19:14:47.732316 11213 raft_consensus.cc:388] T 00000000000000000000000000000000 P 43bf145119374c6db364b463c57c7ad8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:14:47.732440 11213 raft_consensus.cc:482] T 00000000000000000000000000000000 P 43bf145119374c6db364b463c57c7ad8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:14:47.732585 11213 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 43bf145119374c6db364b463c57c7ad8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:47.734669 11213 raft_consensus.cc:504] T 00000000000000000000000000000000 P 43bf145119374c6db364b463c57c7ad8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43bf145119374c6db364b463c57c7ad8" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34573 } }
I20260809 19:14:47.735100 11213 leader_election.cc:302] T 00000000000000000000000000000000 P 43bf145119374c6db364b463c57c7ad8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 43bf145119374c6db364b463c57c7ad8; no voters:
I20260809 19:14:47.735596 11213 leader_election.cc:288] T 00000000000000000000000000000000 P 43bf145119374c6db364b463c57c7ad8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:14:47.735698 11230 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 43bf145119374c6db364b463c57c7ad8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:14:47.736330 11230 raft_consensus.cc:686] T 00000000000000000000000000000000 P 43bf145119374c6db364b463c57c7ad8 [term 1 LEADER]: Becoming Leader. State: Replica: 43bf145119374c6db364b463c57c7ad8, State: Running, Role: LEADER
I20260809 19:14:47.736845 11230 consensus_queue.cc:237] T 00000000000000000000000000000000 P 43bf145119374c6db364b463c57c7ad8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43bf145119374c6db364b463c57c7ad8" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34573 } }
I20260809 19:14:47.737440 11213 sys_catalog.cc:564] T 00000000000000000000000000000000 P 43bf145119374c6db364b463c57c7ad8 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:14:47.739413 11232 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43bf145119374c6db364b463c57c7ad8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 43bf145119374c6db364b463c57c7ad8. Latest consensus state: current_term: 1 leader_uuid: "43bf145119374c6db364b463c57c7ad8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43bf145119374c6db364b463c57c7ad8" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34573 } } }
I20260809 19:14:47.739408 11231 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43bf145119374c6db364b463c57c7ad8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "43bf145119374c6db364b463c57c7ad8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43bf145119374c6db364b463c57c7ad8" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 34573 } } }
I20260809 19:14:47.739862 11231 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43bf145119374c6db364b463c57c7ad8 [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:47.742400 11232 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43bf145119374c6db364b463c57c7ad8 [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:47.747123 11238 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:14:47.751027 11238 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:14:47.759162 11238 catalog_manager.cc:1347] Generated new cluster ID: b5979c434e3c49299f7429a771874eb0
I20260809 19:14:47.759260 11238 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:14:47.782202 11238 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:14:47.782618 11238 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:14:47.793355 11238 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 43bf145119374c6db364b463c57c7ad8: Generated new TSK 0
I20260809 19:14:47.794067 11238 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:14:47.811993 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 11110
W20260809 19:14:47.813108 11205 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:52945
W20260809 19:14:47.813738 7324 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 11110: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 19:14:47.813889 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 11110
2026-08-09T19:14:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1980 ms)
[----------] 18 tests from AuthTokenIssuingTest (36439 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:14:47 dist-test-slave-4tdj krb5kdc[11259](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:14:47 dist-test-slave-4tdj krb5kdc[11259](info): set up 2 sockets
Aug 09 19:14:47 dist-test-slave-4tdj krb5kdc[11259](info): commencing operation
krb5kdc: starting...
W20260809 19:14:49.037930 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.183s user 0.002s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:14:49 dist-test-slave-4tdj krb5kdc[11259](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302889, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:14:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:14:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.39.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
I20260809 19:14:49.311686 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:40309
--webserver_interface=127.7.39.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:45691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:40309,127.7.39.61:33239,127.7.39.60:42149
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:14:49.644505 11280 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 19:14:49.644848 11280 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:49.644966 11280 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:49.645092 11280 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:49.652122 11280 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:14:49.652216 11280 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:49.652316 11280 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:49.652391 11280 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:14:49.652486 11280 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:14:49.661965 11280 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:45691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:40309,127.7.39.61:33239,127.7.39.60:42149
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:40309
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:49.663245 11280 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:49.664599 11280 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:49.675974 11288 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:49.676076 11290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:49.676153 11287 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:49.676916 11280 server_base.cc:1034] running on GCE node
I20260809 19:14:49.677682 11280 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:49.679208 11280 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:49.680434 11280 hybrid_clock.cc:648] HybridClock initialized: now 1786302889680367 us; error 45 us; skew 500 ppm
I20260809 19:14:49.680742 11280 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:14:49 dist-test-slave-4tdj krb5kdc[11259](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302889, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:14:49.683744 11280 init.cc:377] Logged in from keytab as kudu/127.7.39.62@KRBTEST.COM (short username kudu)
I20260809 19:14:49.684998 11280 webserver.cc:460] Webserver started at http://127.7.39.62:41847/ using document root <none> and password file <none>
I20260809 19:14:49.685649 11280 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:49.685734 11280 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:49.685988 11280 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:49.688795 11280 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "90592a8a61e849c5a739f10e20c4f74a"
format_stamp: "Formatted at 2026-08-09 19:14:49 on dist-test-slave-4tdj"
server_key: "2ebcc71334ede45fe334e8e6dab908c1"
server_key_iv: "a9015dc2356357ebb0e4ae75becdf642"
server_key_version: "encryptionkey@0"
I20260809 19:14:49.689486 11280 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "90592a8a61e849c5a739f10e20c4f74a"
format_stamp: "Formatted at 2026-08-09 19:14:49 on dist-test-slave-4tdj"
server_key: "2ebcc71334ede45fe334e8e6dab908c1"
server_key_iv: "a9015dc2356357ebb0e4ae75becdf642"
server_key_version: "encryptionkey@0"
I20260809 19:14:49.694173 11280 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 19:14:49.697342 11298 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:49.698586 11280 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 19:14:49.698721 11280 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "90592a8a61e849c5a739f10e20c4f74a"
format_stamp: "Formatted at 2026-08-09 19:14:49 on dist-test-slave-4tdj"
server_key: "2ebcc71334ede45fe334e8e6dab908c1"
server_key_iv: "a9015dc2356357ebb0e4ae75becdf642"
server_key_version: "encryptionkey@0"
I20260809 19:14:49.698882 11280 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:49.717254 11280 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:49.720743 11280 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:49.720947 11280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:49.737850 11280 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:40309
I20260809 19:14:49.737865 11373 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:40309 every 8 connection(s)
I20260809 19:14:49.739069 11280 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:14:49.742576 11374 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:49.746755 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 11280
I20260809 19:14:49.746975 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:14:49.747785 7324 external_mini_cluster.cc:1428] Setting key 0496ed391ec7ce75c91ec2ccf09322eb
I20260809 19:14:49.749812 11374 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.39.62" port: 40309 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 19:14:49 dist-test-slave-4tdj krb5kdc[11259](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302889, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.7.39.61@KRBTEST.COM; defaulting to no policy
I20260809 19:14:49.779652 11382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:49.753217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:40309 (local address 127.0.0.1:46890)
0809 19:14:49.761352 (+ 8135us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:49.761399 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:49.763638 (+ 2239us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:49.764507 (+ 869us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:49.764514 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:49.765310 (+ 796us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:14:49.765759 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:49.765782 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:49.767361 (+ 1579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:49.767367 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:49.768963 (+ 1596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:49.768977 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:49.769857 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:49.769866 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:49.770027 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:49.770642 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:14:49.770668 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:14:49.773105 (+ 2437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:14:49.776016 (+ 2911us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:49.776028 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:49.776039 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:49.776545 (+ 506us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:49.776908 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:49.776913 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:49.776916 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:49.777124 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:49.777791 (+ 667us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:14:49.777799 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:14:49.778049 (+ 250us) client_negotiation.cc:769] Sending connection context
0809 19:14:49.778334 (+ 285us) client_negotiation.cc:240] Negotiation successful
0809 19:14:49.778846 (+ 512us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7884,"mutex_wait_us":101,"thread_start_us":7676,"threads_started":1}
I20260809 19:14:49.779690 11378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:49.753217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46890 (local address 127.7.39.62:40309)
0809 19:14:49.761004 (+ 7787us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:49.761018 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:49.761706 (+ 688us) server_negotiation.cc:407] Connection header received
0809 19:14:49.763995 (+ 2289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:49.764001 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:49.764227 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:49.764430 (+ 203us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:49.765969 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:49.767205 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:49.769099 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:49.769616 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:49.769735 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:49.773306 (+ 3571us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:49.773313 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:49.773324 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:49.773356 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:49.775870 (+ 2514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:49.776654 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:49.776661 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:49.776663 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:49.776801 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:49.777212 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:49.777215 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:49.777217 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:49.777646 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:49.777791 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:49.778445 (+ 654us) server_negotiation.cc:299] Negotiation successful
0809 19:14:49.778704 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7535,"thread_start_us":7325,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.61@KRBTEST.COM" created.
I20260809 19:14:49.782226 11374 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.39.61" port: 33239 } has no permanent_uuid. Determining permanent_uuid...
I20260809 19:14:49.783188 11382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:49.782806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:33239 (local address 127.0.0.1:38676)
0809 19:14:49.782960 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:49.783079 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.61:33239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 19:14:49.783432 11303 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.39.61:33239: connect: Connection refused (error 111)
I20260809 19:14:49.784870 11382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:49.784511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:33239 (local address 127.0.0.1:38690)
0809 19:14:49.784657 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:49.784731 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.61:33239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 19:14:49.785053 11374 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.61:33239: Network error: Client connection negotiation failed: client connection to 127.7.39.61:33239: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.61.keytab.
Entry for principal kudu/127.7.39.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.61.keytab.
I20260809 19:14:49.806906 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.61:33239
--webserver_interface=127.7.39.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.61.keytab
--principal=kudu/127.7.39.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:45691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:40309,127.7.39.61:33239,127.7.39.60:42149
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 19:14:49.834399 11374 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.61" port: 33239 } attempt: 1
I20260809 19:14:49.835541 11382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:49.835096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:33239 (local address 127.0.0.1:38696)
0809 19:14:49.835290 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:49.835403 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.61:33239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260809 19:14:49.836485 11382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:49.836147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:33239 (local address 127.0.0.1:38710)
0809 19:14:49.836299 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:49.836367 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.61:33239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260809 19:14:49.836678 11374 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.61:33239: Network error: Client connection negotiation failed: client connection to 127.7.39.61:33239: connect: Connection refused (error 111)
I20260809 19:14:49.904889 11374 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.61" port: 33239 } attempt: 2
I20260809 19:14:49.906044 11382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:49.905591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:33239 (local address 127.0.0.1:38720)
0809 19:14:49.905813 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:49.905901 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.61:33239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260809 19:14:49.907050 11382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:49.906714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:33239 (local address 127.0.0.1:38732)
0809 19:14:49.906840 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:49.906917 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.61:33239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 19:14:49.907250 11374 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.61:33239: Network error: Client connection negotiation failed: client connection to 127.7.39.61:33239: connect: Connection refused (error 111)
I20260809 19:14:49.998464 11374 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.61" port: 33239 } attempt: 3
I20260809 19:14:49.999650 11382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:49.999231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:33239 (local address 127.0.0.1:38740)
0809 19:14:49.999426 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:49.999517 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.61:33239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260809 19:14:50.000669 11382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.000319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:33239 (local address 127.0.0.1:38742)
0809 19:14:50.000465 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:50.000540 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.61:33239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260809 19:14:50.000874 11374 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.61:33239: Network error: Client connection negotiation failed: client connection to 127.7.39.61:33239: connect: Connection refused (error 111)
W20260809 19:14:50.127060 11392 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 19:14:50.127351 11392 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:50.127453 11392 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:50.127559 11392 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:50.134459 11392 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:14:50.134536 11392 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:50.134630 11392 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:50.134691 11392 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:14:50.134773 11392 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:14:50.144037 11392 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:45691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:40309,127.7.39.61:33239,127.7.39.60:42149
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.61.keytab
--principal=kudu/127.7.39.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.61:33239
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.7.39.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:50.144086 11374 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.61" port: 33239 } attempt: 4
I20260809 19:14:50.145291 11382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.144766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:33239 (local address 127.0.0.1:38750)
0809 19:14:50.145063 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:50.145153 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.61:33239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151}
I20260809 19:14:50.145380 11392 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:50.146271 11382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.145947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:33239 (local address 127.0.0.1:38760)
0809 19:14:50.146074 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:50.146156 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.61:33239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 19:14:50.146513 11374 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.61:33239: Network error: Client connection negotiation failed: client connection to 127.7.39.61:33239: connect: Connection refused (error 111)
I20260809 19:14:50.146986 11392 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:50.158025 11399 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:50.158056 11402 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:50.158238 11400 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:50.159061 11392 server_base.cc:1034] running on GCE node
I20260809 19:14:50.159818 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:50.161082 11392 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:50.162322 11392 hybrid_clock.cc:648] HybridClock initialized: now 1786302890162227 us; error 41 us; skew 500 ppm
I20260809 19:14:50.162632 11392 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:14:50 dist-test-slave-4tdj krb5kdc[11259](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302890, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:14:50.165589 11392 init.cc:377] Logged in from keytab as kudu/127.7.39.61@KRBTEST.COM (short username kudu)
I20260809 19:14:50.166957 11392 webserver.cc:460] Webserver started at http://127.7.39.61:44835/ using document root <none> and password file <none>
I20260809 19:14:50.167591 11392 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:50.167690 11392 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:50.167982 11392 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:50.170817 11392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-1/data/instance:
uuid: "41a436dc7f6c4992806edf5c51f77872"
format_stamp: "Formatted at 2026-08-09 19:14:50 on dist-test-slave-4tdj"
server_key: "be6774808718dc89e9feaa67e97c1d1a"
server_key_iv: "188d9411cfdf702dd5dc8bd9c75d74c3"
server_key_version: "encryptionkey@0"
I20260809 19:14:50.171571 11392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-1/wal/instance:
uuid: "41a436dc7f6c4992806edf5c51f77872"
format_stamp: "Formatted at 2026-08-09 19:14:50 on dist-test-slave-4tdj"
server_key: "be6774808718dc89e9feaa67e97c1d1a"
server_key_iv: "188d9411cfdf702dd5dc8bd9c75d74c3"
server_key_version: "encryptionkey@0"
I20260809 19:14:50.176312 11392 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 19:14:50.179522 11417 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:50.180716 11392 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 19:14:50.180864 11392 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-1/wal
uuid: "41a436dc7f6c4992806edf5c51f77872"
format_stamp: "Formatted at 2026-08-09 19:14:50 on dist-test-slave-4tdj"
server_key: "be6774808718dc89e9feaa67e97c1d1a"
server_key_iv: "188d9411cfdf702dd5dc8bd9c75d74c3"
server_key_version: "encryptionkey@0"
I20260809 19:14:50.181056 11392 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:50.206748 11392 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:50.210328 11392 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:50.210563 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:50.227468 11392 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.61:33239
I20260809 19:14:50.227487 11492 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.61:33239 every 8 connection(s)
I20260809 19:14:50.228713 11392 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-1/data/info.pb
I20260809 19:14:50.232178 11493 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:50.238076 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 11392
I20260809 19:14:50.238222 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-1/wal/instance
I20260809 19:14:50.238682 7324 external_mini_cluster.cc:1428] Setting key 944d5eaaad32f6a3c3d4804dc3563730
I20260809 19:14:50.238441 11493 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.39.62" port: 40309 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 19:14:50 dist-test-slave-4tdj krb5kdc[11259](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302890, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.61@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:14:50.257843 11378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.241147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46900 (local address 127.7.39.62:40309)
0809 19:14:50.241303 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:50.241307 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:50.242664 (+ 1357us) server_negotiation.cc:407] Connection header received
0809 19:14:50.244427 (+ 1763us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:50.244434 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:50.244516 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:50.244609 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:50.246029 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.246754 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.248204 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.248604 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.248714 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:50.251988 (+ 3274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:50.251993 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:50.251998 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:50.252034 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:50.255151 (+ 3117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:50.255806 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:50.255811 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:50.255814 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:50.255952 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:50.256289 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:50.256294 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:50.256298 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:50.256633 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:50.256790 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:50.257347 (+ 557us) server_negotiation.cc:299] Negotiation successful
0809 19:14:50.257559 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 19:14:50.258618 11497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.241759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:40309 (local address 127.0.0.1:46900)
0809 19:14:50.242502 (+ 743us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:50.242545 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:50.244172 (+ 1627us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:50.244832 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:50.244839 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:50.245339 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:14:50.245865 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:50.245881 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.246902 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.246906 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:50.248060 (+ 1154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:50.248072 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.248811 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.248819 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:50.249027 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:50.249647 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:14:50.249667 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:14:50.251790 (+ 2123us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:14:50.255267 (+ 3477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:50.255274 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:50.255284 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:50.255693 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:50.256039 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:50.256042 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:50.256044 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:50.256197 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:50.256745 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:14:50.256750 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:14:50.257022 (+ 272us) client_negotiation.cc:769] Sending connection context
0809 19:14:50.257229 (+ 207us) client_negotiation.cc:240] Negotiation successful
0809 19:14:50.257574 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":315,"threads_started":1}
I20260809 19:14:50.260301 11493 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.39.61" port: 33239 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 19:14:50 dist-test-slave-4tdj krb5kdc[11259](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302890, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.61@KRBTEST.COM for kudu/127.7.39.61@KRBTEST.COM
WARNING: no policy specified for kudu/127.7.39.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.60@KRBTEST.COM" created.
I20260809 19:14:50.274464 11497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.261006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:33239 (local address 127.0.0.1:38766)
0809 19:14:50.261171 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:50.261188 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:50.261285 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:50.261997 (+ 712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:50.262001 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:50.262413 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:14:50.262573 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:50.262583 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.263904 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.263909 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:50.265140 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:50.265156 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.265986 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.265992 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:50.266171 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:50.266704 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:14:50.266726 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:14:50.268890 (+ 2164us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:14:50.271967 (+ 3077us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:50.271972 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:50.271976 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:50.272453 (+ 477us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:50.272816 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:50.272821 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:50.272825 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:50.272986 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:50.273586 (+ 600us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:14:50.273591 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:14:50.273736 (+ 145us) client_negotiation.cc:769] Sending connection context
0809 19:14:50.273873 (+ 137us) client_negotiation.cc:240] Negotiation successful
0809 19:14:50.274109 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260809 19:14:50.274566 11500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.261090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38766 (local address 127.7.39.61:33239)
0809 19:14:50.261618 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:50.261623 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:50.261647 (+ 24us) server_negotiation.cc:407] Connection header received
0809 19:14:50.261685 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:50.261691 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:50.261847 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:50.261953 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:50.262727 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.263756 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.265287 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.265811 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.265901 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:50.269076 (+ 3175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:50.269086 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:50.269097 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:50.269129 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:50.271866 (+ 2737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:50.272580 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:50.272588 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:50.272591 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:50.272713 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:50.273086 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:50.273090 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:50.273092 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:50.273436 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:50.273615 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:50.274006 (+ 391us) server_negotiation.cc:299] Negotiation successful
0809 19:14:50.274219 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":258,"threads_started":1}
I20260809 19:14:50.277083 11493 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.39.60" port: 42149 } has no permanent_uuid. Determining permanent_uuid...
I20260809 19:14:50.278211 11497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.277748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:42149 (local address 127.0.0.1:47438)
0809 19:14:50.277914 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:50.278060 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:42149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260809 19:14:50.278502 11421 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.39.60:42149: connect: Connection refused (error 111)
I20260809 19:14:50.279923 11497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.279599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:42149 (local address 127.0.0.1:47454)
0809 19:14:50.279729 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:50.279814 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:42149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260809 19:14:50.280110 11493 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.60:42149: Network error: Client connection negotiation failed: client connection to 127.7.39.60:42149: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.60.keytab.
Entry for principal kudu/127.7.39.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.60.keytab.
I20260809 19:14:50.303440 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.60:42149
--webserver_interface=127.7.39.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.60.keytab
--principal=kudu/127.7.39.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:45691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:40309,127.7.39.61:33239,127.7.39.60:42149
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 19:14:50.329401 11493 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.60" port: 42149 } attempt: 1
I20260809 19:14:50.330482 11497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.329994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:42149 (local address 127.0.0.1:47470)
0809 19:14:50.330192 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:50.330277 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:42149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260809 19:14:50.331458 11497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.331132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:42149 (local address 127.0.0.1:47484)
0809 19:14:50.331273 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:50.331362 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:42149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 19:14:50.331670 11493 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.60:42149: Network error: Client connection negotiation failed: client connection to 127.7.39.60:42149: connect: Connection refused (error 111)
I20260809 19:14:50.399878 11493 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.60" port: 42149 } attempt: 2
I20260809 19:14:50.400892 11497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.400469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:42149 (local address 127.0.0.1:47488)
0809 19:14:50.400654 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:50.400742 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:42149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260809 19:14:50.401782 11497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.401460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:42149 (local address 127.0.0.1:47496)
0809 19:14:50.401601 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:50.401670 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:42149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 19:14:50.401997 11493 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.60:42149: Network error: Client connection negotiation failed: client connection to 127.7.39.60:42149: connect: Connection refused (error 111)
I20260809 19:14:50.445765 11374 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.61" port: 33239 } attempt: 5
Aug 09 19:14:50 dist-test-slave-4tdj krb5kdc[11259](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302889, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for kudu/127.7.39.61@KRBTEST.COM
I20260809 19:14:50.459419 11500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.446517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38772 (local address 127.7.39.61:33239)
0809 19:14:50.446702 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:50.446706 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:50.446764 (+ 58us) server_negotiation.cc:407] Connection header received
0809 19:14:50.446954 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:50.446957 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:50.447046 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:50.447125 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:50.448077 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.448748 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.450431 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.450883 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.450976 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:50.454539 (+ 3563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:50.454544 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:50.454547 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:50.454580 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:50.457000 (+ 2420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:50.457605 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:50.457609 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:50.457611 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:50.457730 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:50.458080 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:50.458083 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:50.458085 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:50.458406 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:50.458544 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:50.458916 (+ 372us) server_negotiation.cc:299] Negotiation successful
0809 19:14:50.459115 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260809 19:14:50.459422 11382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.446404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:33239 (local address 127.0.0.1:38772)
0809 19:14:50.446642 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:50.446679 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:50.446842 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:50.447190 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:50.447195 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:50.447704 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:14:50.447933 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:50.447945 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.448896 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.448902 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:50.450224 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:50.450241 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.451054 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.451061 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:50.451275 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:50.451896 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:14:50.451920 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:14:50.454361 (+ 2441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:14:50.457122 (+ 2761us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:50.457127 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:50.457132 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:50.457480 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:50.457831 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:50.457836 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:50.457840 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:50.457971 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:50.458521 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:14:50.458526 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:14:50.458675 (+ 149us) client_negotiation.cc:769] Sending connection context
0809 19:14:50.458786 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 19:14:50.459052 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74}
I20260809 19:14:50.460431 11374 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.39.60" port: 42149 } has no permanent_uuid. Determining permanent_uuid...
I20260809 19:14:50.461556 11382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.461187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:42149 (local address 127.0.0.1:47512)
0809 19:14:50.461344 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:50.461411 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:42149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260809 19:14:50.462579 11382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.462256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:42149 (local address 127.0.0.1:47520)
0809 19:14:50.462397 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:50.462477 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:42149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260809 19:14:50.462787 11374 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.60:42149: Network error: Client connection negotiation failed: client connection to 127.7.39.60:42149: connect: Connection refused (error 111)
I20260809 19:14:50.493212 11493 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.60" port: 42149 } attempt: 3
I20260809 19:14:50.494207 11497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.493763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:42149 (local address 127.0.0.1:47524)
0809 19:14:50.493964 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:50.494059 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:42149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 19:14:50.495280 11497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.494868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:42149 (local address 127.0.0.1:47536)
0809 19:14:50.495092 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:50.495167 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:42149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134}
W20260809 19:14:50.495492 11493 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.60:42149: Network error: Client connection negotiation failed: client connection to 127.7.39.60:42149: connect: Connection refused (error 111)
I20260809 19:14:50.513979 11374 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.60" port: 42149 } attempt: 1
I20260809 19:14:50.514925 11382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.514546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:42149 (local address 127.0.0.1:47548)
0809 19:14:50.514698 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:50.514778 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:42149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 19:14:50.515810 11382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.515538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:42149 (local address 127.0.0.1:47552)
0809 19:14:50.515649 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:50.515713 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:42149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260809 19:14:50.516021 11374 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.60:42149: Network error: Client connection negotiation failed: client connection to 127.7.39.60:42149: connect: Connection refused (error 111)
I20260809 19:14:50.584224 11374 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.60" port: 42149 } attempt: 2
I20260809 19:14:50.585395 11382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.584915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:42149 (local address 127.0.0.1:47566)
0809 19:14:50.585135 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:50.585235 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:42149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260809 19:14:50.586472 11382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.586030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:42149 (local address 127.0.0.1:47578)
0809 19:14:50.586239 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:50.586353 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:42149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
W20260809 19:14:50.586689 11374 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.60:42149: Network error: Client connection negotiation failed: client connection to 127.7.39.60:42149: connect: Connection refused (error 111)
W20260809 19:14:50.623638 11507 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 19:14:50.623950 11507 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:50.624040 11507 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:50.624130 11507 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:50.630941 11507 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:14:50.631011 11507 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:50.631072 11507 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:50.631121 11507 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:14:50.631179 11507 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:14:50.638684 11493 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.60" port: 42149 } attempt: 4
I20260809 19:14:50.639736 11497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.639300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:42149 (local address 127.0.0.1:47590)
0809 19:14:50.639505 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:50.639594 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:42149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260809 19:14:50.640605 11497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.640324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:42149 (local address 127.0.0.1:47596)
0809 19:14:50.640436 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:50.640499 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:42149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260809 19:14:50.640836 11493 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.60:42149: Network error: Client connection negotiation failed: client connection to 127.7.39.60:42149: connect: Connection refused (error 111)
I20260809 19:14:50.640818 11507 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:45691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:40309,127.7.39.61:33239,127.7.39.60:42149
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.60.keytab
--principal=kudu/127.7.39.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.60:42149
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.7.39.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:50.641990 11507 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:50.643267 11507 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:50.654336 11516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:50.654310 11517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:50.654239 11519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:50.655381 11507 server_base.cc:1034] running on GCE node
I20260809 19:14:50.656132 11507 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:50.657480 11507 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:50.658701 11507 hybrid_clock.cc:648] HybridClock initialized: now 1786302890658634 us; error 35 us; skew 500 ppm
I20260809 19:14:50.659013 11507 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:14:50 dist-test-slave-4tdj krb5kdc[11259](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302890, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:14:50.661984 11507 init.cc:377] Logged in from keytab as kudu/127.7.39.60@KRBTEST.COM (short username kudu)
I20260809 19:14:50.663409 11507 webserver.cc:460] Webserver started at http://127.7.39.60:42863/ using document root <none> and password file <none>
I20260809 19:14:50.664064 11507 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:50.664165 11507 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:50.664450 11507 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:50.667405 11507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-2/data/instance:
uuid: "51d9626d2ac94b08b230db70ae7ea9f1"
format_stamp: "Formatted at 2026-08-09 19:14:50 on dist-test-slave-4tdj"
server_key: "6a697dc84e6fdeb96e6ef9f82caf6b08"
server_key_iv: "37ad6ad940add9195143f59a7ad330fe"
server_key_version: "encryptionkey@0"
I20260809 19:14:50.668147 11507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-2/wal/instance:
uuid: "51d9626d2ac94b08b230db70ae7ea9f1"
format_stamp: "Formatted at 2026-08-09 19:14:50 on dist-test-slave-4tdj"
server_key: "6a697dc84e6fdeb96e6ef9f82caf6b08"
server_key_iv: "37ad6ad940add9195143f59a7ad330fe"
server_key_version: "encryptionkey@0"
I20260809 19:14:50.672963 11507 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 19:14:50.676152 11529 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:50.677363 11507 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 19:14:50.677538 11507 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-2/wal
uuid: "51d9626d2ac94b08b230db70ae7ea9f1"
format_stamp: "Formatted at 2026-08-09 19:14:50 on dist-test-slave-4tdj"
server_key: "6a697dc84e6fdeb96e6ef9f82caf6b08"
server_key_iv: "37ad6ad940add9195143f59a7ad330fe"
server_key_version: "encryptionkey@0"
I20260809 19:14:50.677728 11507 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:50.692881 11374 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.60" port: 42149 } attempt: 3
I20260809 19:14:50.693948 11382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.693441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:42149 (local address 127.0.0.1:47598)
0809 19:14:50.693668 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:50.693769 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:42149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260809 19:14:50.694950 11382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.694576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:42149 (local address 127.0.0.1:47602)
0809 19:14:50.694774 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:50.694846 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:42149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
W20260809 19:14:50.695149 11374 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.60:42149: Network error: Client connection negotiation failed: client connection to 127.7.39.60:42149: connect: Connection refused (error 111)
I20260809 19:14:50.699941 11507 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:50.703876 11507 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:50.704130 11507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:50.721917 11507 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.60:42149
I20260809 19:14:50.721940 11610 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.60:42149 every 8 connection(s)
I20260809 19:14:50.723271 11507 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-2/data/info.pb
I20260809 19:14:50.725557 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 11507
I20260809 19:14:50.725720 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786302538618573-7324-0/minicluster-data/master-2/wal/instance
I20260809 19:14:50.726193 7324 external_mini_cluster.cc:1428] Setting key 404357e26445f4934444d3d206854122
I20260809 19:14:50.726861 11613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:50.736119 11613 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.39.62" port: 40309 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 19:14:50 dist-test-slave-4tdj krb5kdc[11259](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302889, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.60@KRBTEST.COM
Aug 09 19:14:50 dist-test-slave-4tdj krb5kdc[11259](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302890, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.60@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:14:50.749593 11618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.728065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47616 (local address 127.7.39.60:42149)
0809 19:14:50.728883 (+ 818us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:50.728897 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:50.728947 (+ 50us) server_negotiation.cc:407] Connection header received
0809 19:14:50.731274 (+ 2327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:50.731301 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:50.731764 (+ 463us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:50.732191 (+ 427us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:50.733451 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.735363 (+ 1912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.736598 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.737591 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.737757 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:50.742229 (+ 4472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:50.742236 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:50.742246 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:50.742283 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:50.745915 (+ 3632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:50.746604 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:50.746610 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:50.746615 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:50.746775 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:50.747163 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:50.747167 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:50.747169 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:50.747699 (+ 530us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:50.747998 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:50.748352 (+ 354us) server_negotiation.cc:299] Negotiation successful
0809 19:14:50.748677 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":599,"thread_start_us":350,"threads_started":1}
I20260809 19:14:50.754032 11378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.738747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46908 (local address 127.7.39.62:40309)
0809 19:14:50.738933 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:50.738939 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:50.739636 (+ 697us) server_negotiation.cc:407] Connection header received
0809 19:14:50.739887 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:50.739891 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:50.739955 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:50.740037 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:50.741173 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.742243 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.744136 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.744789 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.744922 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:50.748513 (+ 3591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:50.748521 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:50.748525 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:50.748579 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:50.751189 (+ 2610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:50.751933 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:50.751938 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:50.751940 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:50.752084 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:50.752518 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:50.752523 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:50.752527 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:50.752807 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:50.752909 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:50.753525 (+ 616us) server_negotiation.cc:299] Negotiation successful
0809 19:14:50.753755 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 19:14:50.754122 11621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.738759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:40309 (local address 127.0.0.1:46908)
0809 19:14:50.739507 (+ 748us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:50.739545 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:50.739757 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:50.740125 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:50.740132 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:50.740697 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:14:50.740997 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:50.741010 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.742418 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.742423 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:50.744008 (+ 1585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:50.744023 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.744993 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.745000 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:50.745184 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:50.745848 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:14:50.745870 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:14:50.748313 (+ 2443us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:14:50.751320 (+ 3007us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:50.751331 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:50.751338 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:50.751822 (+ 484us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:50.752218 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:50.752223 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:50.752226 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:50.752389 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:50.753012 (+ 623us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:14:50.753019 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:14:50.753216 (+ 197us) client_negotiation.cc:769] Sending connection context
0809 19:14:50.753411 (+ 195us) client_negotiation.cc:240] Negotiation successful
0809 19:14:50.753739 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":399,"threads_started":1}
I20260809 19:14:50.755344 11613 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.39.61" port: 33239 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 19:14:50 dist-test-slave-4tdj krb5kdc[11259](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302889, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
Aug 09 19:14:50 dist-test-slave-4tdj krb5kdc[11259](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302890, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.60@KRBTEST.COM for kudu/127.7.39.61@KRBTEST.COM
I20260809 19:14:50.767050 11622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.752250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46918 (local address 127.7.39.62:40309)
0809 19:14:50.752751 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:50.752755 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:50.752773 (+ 18us) server_negotiation.cc:407] Connection header received
0809 19:14:50.752810 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:50.752813 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:50.752867 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:50.752945 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:50.754641 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.755523 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.756941 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.757503 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.757632 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:50.761531 (+ 3899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:50.761573 (+ 42us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:50.761581 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:50.761619 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:50.764282 (+ 2663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:50.764895 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:50.764900 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:50.764902 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:50.765041 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:50.765409 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:50.765415 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:50.765419 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:50.765756 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:50.766019 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:50.766488 (+ 469us) server_negotiation.cc:299] Negotiation successful
0809 19:14:50.766705 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":254,"threads_started":1}
I20260809 19:14:50.768335 11500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.756037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38776 (local address 127.7.39.61:33239)
0809 19:14:50.756221 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:50.756227 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:50.756246 (+ 19us) server_negotiation.cc:407] Connection header received
0809 19:14:50.756348 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:50.756354 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:50.756424 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:50.756521 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:50.757099 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.757968 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.759238 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.759665 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.759777 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:50.762844 (+ 3067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:50.762849 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:50.762852 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:50.762886 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:50.765382 (+ 2496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:50.766068 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:50.766073 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:50.766077 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:50.766222 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:50.766707 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:50.766711 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:50.766715 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:50.767030 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:50.767177 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:50.767743 (+ 566us) server_negotiation.cc:299] Negotiation successful
0809 19:14:50.767964 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 19:14:50.769164 11621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.756012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:33239 (local address 127.0.0.1:38776)
0809 19:14:50.756160 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:50.756178 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:50.756255 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:50.756527 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:50.756529 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:50.756829 (+ 300us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:14:50.756966 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:50.756973 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.758117 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.758123 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:50.759091 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:50.759104 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.759803 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.759809 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:50.759993 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:50.760453 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:14:50.760475 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:14:50.762664 (+ 2189us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:14:50.765480 (+ 2816us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:50.765484 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:50.765488 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:50.765930 (+ 442us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:50.766409 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:50.766413 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:50.766417 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:50.766579 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:50.767278 (+ 699us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:14:50.767283 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:14:50.767440 (+ 157us) client_negotiation.cc:769] Sending connection context
0809 19:14:50.768576 (+ 1136us) client_negotiation.cc:240] Negotiation successful
0809 19:14:50.768844 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260809 19:14:50.770198 11613 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.39.60" port: 42149 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 19:14:50 dist-test-slave-4tdj krb5kdc[11259](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302889, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.61@KRBTEST.COM
Aug 09 19:14:50 dist-test-slave-4tdj krb5kdc[11259](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302890, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.60@KRBTEST.COM for kudu/127.7.39.60@KRBTEST.COM
I20260809 19:14:50.782933 11618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.771128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47618 (local address 127.7.39.60:42149)
0809 19:14:50.771297 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:50.771303 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:50.771320 (+ 17us) server_negotiation.cc:407] Connection header received
0809 19:14:50.771362 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:50.771367 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:50.771427 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:50.771522 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:50.772296 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.772969 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.774346 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.774753 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.774846 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:50.777931 (+ 3085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:50.777935 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:50.777938 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:50.777965 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:50.780425 (+ 2460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:50.780990 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:50.780994 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:50.780996 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:50.781138 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:50.781507 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:50.781511 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:50.781514 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:50.781833 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:50.781946 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:50.782424 (+ 478us) server_negotiation.cc:299] Negotiation successful
0809 19:14:50.782613 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 19:14:50.782930 11500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.768838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38782 (local address 127.7.39.61:33239)
0809 19:14:50.769006 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:50.769012 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:50.769032 (+ 20us) server_negotiation.cc:407] Connection header received
0809 19:14:50.769177 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:50.769182 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:50.769398 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:50.769497 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:50.770707 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.771485 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.772873 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.773350 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.773435 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:50.777843 (+ 4408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:50.777849 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:50.777853 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:50.777889 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:50.780276 (+ 2387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:50.780929 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:50.780934 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:50.780938 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:50.781084 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:50.781508 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:50.781512 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:50.781516 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:50.781835 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:50.782101 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:50.782384 (+ 283us) server_negotiation.cc:299] Negotiation successful
0809 19:14:50.782613 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 19:14:50.783598 11621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.770827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:42149 (local address 127.0.0.1:47618)
0809 19:14:50.770959 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:50.770976 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:50.771087 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:50.771537 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:50.771540 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:50.771973 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:14:50.772156 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:50.772168 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.773092 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.773096 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:50.774188 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:50.774202 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.774917 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.774923 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:50.775166 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:50.775625 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:14:50.775648 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:14:50.777777 (+ 2129us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:14:50.780552 (+ 2775us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:50.780555 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:50.780558 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:50.780885 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:50.781286 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:50.781290 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:50.781292 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:50.781410 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:50.782025 (+ 615us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:14:50.782041 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:14:50.782175 (+ 134us) client_negotiation.cc:769] Sending connection context
0809 19:14:50.783091 (+ 916us) client_negotiation.cc:240] Negotiation successful
0809 19:14:50.783294 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260809 19:14:50.787544 7324 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:14:50.788575 11613 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51d9626d2ac94b08b230db70ae7ea9f1: Bootstrap starting.
I20260809 19:14:50.792253 11613 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 51d9626d2ac94b08b230db70ae7ea9f1: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:50.793560 11613 log.cc:824] T 00000000000000000000000000000000 P 51d9626d2ac94b08b230db70ae7ea9f1: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:50.790086 11338 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "90592a8a61e849c5a739f10e20c4f74a"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46918
I20260809 19:14:50.796147 11613 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51d9626d2ac94b08b230db70ae7ea9f1: No bootstrap required, opened a new log
I20260809 19:14:50.803527 11613 raft_consensus.cc:348] T 00000000000000000000000000000000 P 51d9626d2ac94b08b230db70ae7ea9f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90592a8a61e849c5a739f10e20c4f74a" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 40309 } } peers { permanent_uuid: "41a436dc7f6c4992806edf5c51f77872" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 33239 } } peers { permanent_uuid: "51d9626d2ac94b08b230db70ae7ea9f1" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 42149 } }
I20260809 19:14:50.803901 11613 raft_consensus.cc:729] T 00000000000000000000000000000000 P 51d9626d2ac94b08b230db70ae7ea9f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51d9626d2ac94b08b230db70ae7ea9f1, State: Initialized, Role: FOLLOWER
I20260809 19:14:50.804320 11613 consensus_queue.cc:260] T 00000000000000000000000000000000 P 51d9626d2ac94b08b230db70ae7ea9f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90592a8a61e849c5a739f10e20c4f74a" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 40309 } } peers { permanent_uuid: "41a436dc7f6c4992806edf5c51f77872" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 33239 } } peers { permanent_uuid: "51d9626d2ac94b08b230db70ae7ea9f1" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 42149 } }
I20260809 19:14:50.805205 11625 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51d9626d2ac94b08b230db70ae7ea9f1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90592a8a61e849c5a739f10e20c4f74a" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 40309 } } peers { permanent_uuid: "41a436dc7f6c4992806edf5c51f77872" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 33239 } } peers { permanent_uuid: "51d9626d2ac94b08b230db70ae7ea9f1" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 42149 } } }
I20260809 19:14:50.805614 11625 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51d9626d2ac94b08b230db70ae7ea9f1 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:14:50.806102 11613 sys_catalog.cc:564] T 00000000000000000000000000000000 P 51d9626d2ac94b08b230db70ae7ea9f1 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 19:14:50.814797 11646 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 51d9626d2ac94b08b230db70ae7ea9f1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 19:14:50.814915 11646 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 19:14:50.812439 11507 master_runner.cc:186] Error getting master registration for 127.7.39.62:40309: OK, instance_id { permanent_uuid: "90592a8a61e849c5a739f10e20c4f74a" instance_seqno: 1786302889733088 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 19:14:50.820117 11507 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 19:14:50.872392 11374 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.60" port: 42149 } attempt: 4
Aug 09 19:14:50 dist-test-slave-4tdj krb5kdc[11259](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302889, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for kudu/127.7.39.60@KRBTEST.COM
I20260809 19:14:50.885906 11382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.873155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:42149 (local address 127.0.0.1:47622)
0809 19:14:50.873424 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:50.873442 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:50.873591 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:50.873919 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:50.873923 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:50.874384 (+ 461us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:14:50.874571 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:50.874581 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.875611 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.875617 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:50.876531 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:50.876542 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.877284 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.877290 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:50.877494 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:50.878036 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:14:50.878066 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:14:50.880336 (+ 2270us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:14:50.883357 (+ 3021us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:50.883362 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:50.883366 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:50.883759 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:50.884191 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:50.884196 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:50.884200 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:50.884373 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:50.884918 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:14:50.884923 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:14:50.885068 (+ 145us) client_negotiation.cc:769] Sending connection context
0809 19:14:50.885187 (+ 119us) client_negotiation.cc:240] Negotiation successful
0809 19:14:50.885487 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149}
I20260809 19:14:50.885958 11618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.873217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47622 (local address 127.7.39.60:42149)
0809 19:14:50.873415 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:50.873421 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:50.873524 (+ 103us) server_negotiation.cc:407] Connection header received
0809 19:14:50.873722 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:50.873727 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:50.873789 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:50.873875 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:50.874715 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.875465 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.876673 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.877150 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.877257 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:50.880519 (+ 3262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:50.880523 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:50.880526 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:50.880558 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:50.883236 (+ 2678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:50.883881 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:50.883887 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:50.883890 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:50.884042 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:50.884480 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:50.884485 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:50.884487 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:50.884804 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:50.884952 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:50.885378 (+ 426us) server_negotiation.cc:299] Negotiation successful
0809 19:14:50.885636 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 19:14:50.891798 11374 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90592a8a61e849c5a739f10e20c4f74a: Bootstrap starting.
I20260809 19:14:50.895002 11374 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 90592a8a61e849c5a739f10e20c4f74a: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:50.896229 11374 log.cc:824] T 00000000000000000000000000000000 P 90592a8a61e849c5a739f10e20c4f74a: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:50.899013 11374 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90592a8a61e849c5a739f10e20c4f74a: No bootstrap required, opened a new log
I20260809 19:14:50.906306 11374 raft_consensus.cc:348] T 00000000000000000000000000000000 P 90592a8a61e849c5a739f10e20c4f74a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90592a8a61e849c5a739f10e20c4f74a" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 40309 } } peers { permanent_uuid: "41a436dc7f6c4992806edf5c51f77872" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 33239 } } peers { permanent_uuid: "51d9626d2ac94b08b230db70ae7ea9f1" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 42149 } }
I20260809 19:14:50.906703 11374 raft_consensus.cc:729] T 00000000000000000000000000000000 P 90592a8a61e849c5a739f10e20c4f74a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90592a8a61e849c5a739f10e20c4f74a, State: Initialized, Role: FOLLOWER
I20260809 19:14:50.907181 11374 consensus_queue.cc:260] T 00000000000000000000000000000000 P 90592a8a61e849c5a739f10e20c4f74a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90592a8a61e849c5a739f10e20c4f74a" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 40309 } } peers { permanent_uuid: "41a436dc7f6c4992806edf5c51f77872" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 33239 } } peers { permanent_uuid: "51d9626d2ac94b08b230db70ae7ea9f1" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 42149 } }
I20260809 19:14:50.908138 11651 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90592a8a61e849c5a739f10e20c4f74a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90592a8a61e849c5a739f10e20c4f74a" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 40309 } } peers { permanent_uuid: "41a436dc7f6c4992806edf5c51f77872" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 33239 } } peers { permanent_uuid: "51d9626d2ac94b08b230db70ae7ea9f1" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 42149 } } }
I20260809 19:14:50.908519 11651 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90592a8a61e849c5a739f10e20c4f74a [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:14:50.909313 11374 sys_catalog.cc:564] T 00000000000000000000000000000000 P 90592a8a61e849c5a739f10e20c4f74a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:14:50.909606 11338 raft_consensus.cc:482] T 00000000000000000000000000000000 P 90592a8a61e849c5a739f10e20c4f74a [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 19:14:50.909809 11338 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 90592a8a61e849c5a739f10e20c4f74a [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:50.913269 11338 raft_consensus.cc:504] T 00000000000000000000000000000000 P 90592a8a61e849c5a739f10e20c4f74a [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90592a8a61e849c5a739f10e20c4f74a" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 40309 } } peers { permanent_uuid: "41a436dc7f6c4992806edf5c51f77872" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 33239 } } peers { permanent_uuid: "51d9626d2ac94b08b230db70ae7ea9f1" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 42149 } }
I20260809 19:14:50.915617 11573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "90592a8a61e849c5a739f10e20c4f74a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "51d9626d2ac94b08b230db70ae7ea9f1"
I20260809 19:14:50.916128 11573 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 51d9626d2ac94b08b230db70ae7ea9f1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:50.916935 11338 leader_election.cc:288] T 00000000000000000000000000000000 P 90592a8a61e849c5a739f10e20c4f74a [CANDIDATE]: Term 1 election: Requested vote from peers 41a436dc7f6c4992806edf5c51f77872 (127.7.39.61:33239), 51d9626d2ac94b08b230db70ae7ea9f1 (127.7.39.60:42149)
I20260809 19:14:50.919428 11573 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 51d9626d2ac94b08b230db70ae7ea9f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90592a8a61e849c5a739f10e20c4f74a in term 1.
I20260809 19:14:50.920085 11304 leader_election.cc:302] T 00000000000000000000000000000000 P 90592a8a61e849c5a739f10e20c4f74a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51d9626d2ac94b08b230db70ae7ea9f1, 90592a8a61e849c5a739f10e20c4f74a; no voters:
I20260809 19:14:50.920531 11651 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 90592a8a61e849c5a739f10e20c4f74a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:14:50.931473 11651 raft_consensus.cc:686] T 00000000000000000000000000000000 P 90592a8a61e849c5a739f10e20c4f74a [term 1 LEADER]: Becoming Leader. State: Replica: 90592a8a61e849c5a739f10e20c4f74a, State: Running, Role: LEADER
I20260809 19:14:50.932063 11651 consensus_queue.cc:237] T 00000000000000000000000000000000 P 90592a8a61e849c5a739f10e20c4f74a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90592a8a61e849c5a739f10e20c4f74a" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 40309 } } peers { permanent_uuid: "41a436dc7f6c4992806edf5c51f77872" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 33239 } } peers { permanent_uuid: "51d9626d2ac94b08b230db70ae7ea9f1" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 42149 } }
I20260809 19:14:50.940024 11493 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.60" port: 42149 } attempt: 5
I20260809 19:14:50.939947 11663 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90592a8a61e849c5a739f10e20c4f74a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 90592a8a61e849c5a739f10e20c4f74a. Latest consensus state: current_term: 1 leader_uuid: "90592a8a61e849c5a739f10e20c4f74a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90592a8a61e849c5a739f10e20c4f74a" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 40309 } } peers { permanent_uuid: "41a436dc7f6c4992806edf5c51f77872" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 33239 } } peers { permanent_uuid: "51d9626d2ac94b08b230db70ae7ea9f1" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 42149 } } }
I20260809 19:14:50.940357 11663 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90592a8a61e849c5a739f10e20c4f74a [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:50.947198 11672 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 09 19:14:50 dist-test-slave-4tdj krb5kdc[11259](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302890, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.61@KRBTEST.COM for kudu/127.7.39.60@KRBTEST.COM
W20260809 19:14:50.956131 11540 tablet.cc:2369] T 00000000000000000000000000000000 P 51d9626d2ac94b08b230db70ae7ea9f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:14:50.957963 11497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.940620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:42149 (local address 127.0.0.1:47636)
0809 19:14:50.941013 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:50.941034 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:50.941159 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:50.942021 (+ 862us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:50.942027 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:50.942632 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:14:50.942850 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:50.942864 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.944384 (+ 1520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.944390 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:50.945911 (+ 1521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:50.945926 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.947146 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.947151 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:50.947350 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:50.948007 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:14:50.948031 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:14:50.950868 (+ 2837us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:14:50.955126 (+ 4258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:50.955131 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:50.955135 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:50.955665 (+ 530us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:50.956089 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:50.956094 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:50.956097 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:50.956267 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:50.956970 (+ 703us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:14:50.956975 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:14:50.957136 (+ 161us) client_negotiation.cc:769] Sending connection context
0809 19:14:50.957286 (+ 150us) client_negotiation.cc:240] Negotiation successful
0809 19:14:50.957584 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259}
I20260809 19:14:50.958873 11618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.941373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47636 (local address 127.7.39.60:42149)
0809 19:14:50.941571 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:50.941576 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:50.941596 (+ 20us) server_negotiation.cc:407] Connection header received
0809 19:14:50.941654 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:50.941659 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:50.941737 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:50.941828 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:50.943049 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.944206 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.946113 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.946830 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.946948 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:50.951074 (+ 4126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:50.951081 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:50.951086 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:50.951124 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:50.954976 (+ 3852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:50.955804 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:50.955809 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:50.955813 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:50.955962 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:50.956397 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:50.956402 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:50.956405 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:50.956745 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:50.956905 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:50.958350 (+ 1445us) server_negotiation.cc:299] Negotiation successful
0809 19:14:50.958583 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 19:14:50.964437 11493 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41a436dc7f6c4992806edf5c51f77872: Bootstrap starting.
I20260809 19:14:50.969172 11493 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 41a436dc7f6c4992806edf5c51f77872: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:50.970472 11493 log.cc:824] T 00000000000000000000000000000000 P 41a436dc7f6c4992806edf5c51f77872: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:50.973245 11672 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260809 19:14:50.973429 11307 tablet.cc:2369] T 00000000000000000000000000000000 P 90592a8a61e849c5a739f10e20c4f74a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:14:50.978928 11493 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41a436dc7f6c4992806edf5c51f77872: No bootstrap required, opened a new log
I20260809 19:14:51.003837 11573 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 51d9626d2ac94b08b230db70ae7ea9f1 [term 1 FOLLOWER]: Refusing update from remote peer 90592a8a61e849c5a739f10e20c4f74a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:14:51.004875 11663 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 90592a8a61e849c5a739f10e20c4f74a [LEADER]: Connected to new peer: Peer: permanent_uuid: "51d9626d2ac94b08b230db70ae7ea9f1" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 42149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:14:51.008699 11618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.962256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47648 (local address 127.7.39.60:42149)
0809 19:14:50.962442 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:50.962447 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:50.974669 (+ 12222us) server_negotiation.cc:407] Connection header received
0809 19:14:50.974859 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:50.974864 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:50.974938 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:50.975007 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:50.976839 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.977890 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.981335 (+ 3445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.982073 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.982170 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:50.988072 (+ 5902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:50.988079 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:50.988085 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:50.988123 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:50.991874 (+ 3751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:50.996887 (+ 5013us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:50.996893 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:50.996897 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:50.997055 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:50.998611 (+ 1556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:50.998617 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:50.998621 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:50.999012 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:50.999289 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:51.007926 (+ 8637us) server_negotiation.cc:299] Negotiation successful
0809 19:14:51.008232 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 19:14:51.017529 11500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.965396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38798 (local address 127.7.39.61:33239)
0809 19:14:50.965552 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:50.965558 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:50.971589 (+ 6031us) server_negotiation.cc:407] Connection header received
0809 19:14:50.972063 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:50.972070 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:50.972148 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:50.972215 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:50.978178 (+ 5963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.979333 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.987497 (+ 8164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:50.990070 (+ 2573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:50.990189 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:51.002436 (+ 12247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:51.002443 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:51.002449 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:51.002491 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:51.006434 (+ 3943us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:51.013004 (+ 6570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:51.013010 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:51.013014 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:51.013189 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:51.014638 (+ 1449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:51.014644 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:51.014648 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:51.015052 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:51.015295 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:51.016869 (+ 1574us) server_negotiation.cc:299] Negotiation successful
0809 19:14:51.017131 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 19:14:51.035606 11625 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51d9626d2ac94b08b230db70ae7ea9f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 90592a8a61e849c5a739f10e20c4f74a. Latest consensus state: current_term: 1 leader_uuid: "90592a8a61e849c5a739f10e20c4f74a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90592a8a61e849c5a739f10e20c4f74a" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 40309 } } peers { permanent_uuid: "41a436dc7f6c4992806edf5c51f77872" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 33239 } } peers { permanent_uuid: "51d9626d2ac94b08b230db70ae7ea9f1" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 42149 } } }
I20260809 19:14:51.035929 11625 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51d9626d2ac94b08b230db70ae7ea9f1 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:14:51.039448 11685 mvcc.cc:205] Tried to move back new op lower bound from 7316696641489653760 to 7316696641263742976. Current Snapshot: MvccSnapshot[applied={T|T < 7316696641489653760}]
I20260809 19:14:51.040408 11663 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90592a8a61e849c5a739f10e20c4f74a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "90592a8a61e849c5a739f10e20c4f74a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90592a8a61e849c5a739f10e20c4f74a" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 40309 } } peers { permanent_uuid: "41a436dc7f6c4992806edf5c51f77872" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 33239 } } peers { permanent_uuid: "51d9626d2ac94b08b230db70ae7ea9f1" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 42149 } } }
I20260809 19:14:51.040678 11663 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90592a8a61e849c5a739f10e20c4f74a [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:51.041296 11493 raft_consensus.cc:348] T 00000000000000000000000000000000 P 41a436dc7f6c4992806edf5c51f77872 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90592a8a61e849c5a739f10e20c4f74a" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 40309 } } peers { permanent_uuid: "41a436dc7f6c4992806edf5c51f77872" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 33239 } } peers { permanent_uuid: "51d9626d2ac94b08b230db70ae7ea9f1" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 42149 } }
I20260809 19:14:51.041718 11493 raft_consensus.cc:729] T 00000000000000000000000000000000 P 41a436dc7f6c4992806edf5c51f77872 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41a436dc7f6c4992806edf5c51f77872, State: Initialized, Role: FOLLOWER
I20260809 19:14:51.042313 11493 consensus_queue.cc:260] T 00000000000000000000000000000000 P 41a436dc7f6c4992806edf5c51f77872 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90592a8a61e849c5a739f10e20c4f74a" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 40309 } } peers { permanent_uuid: "41a436dc7f6c4992806edf5c51f77872" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 33239 } } peers { permanent_uuid: "51d9626d2ac94b08b230db70ae7ea9f1" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 42149 } }
I20260809 19:14:51.047803 11622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:50.966770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46920 (local address 127.7.39.62:40309)
0809 19:14:50.966925 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:50.966931 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:50.986249 (+ 19318us) server_negotiation.cc:407] Connection header received
0809 19:14:50.994417 (+ 8168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:50.994424 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:50.994525 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:50.994597 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:50.999756 (+ 5159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:51.000927 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:51.019578 (+ 18651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:51.021105 (+ 1527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:51.021340 (+ 235us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:51.035644 (+ 14304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:51.035652 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:51.035657 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:51.035704 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:51.040941 (+ 5237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:51.042782 (+ 1841us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:51.042823 (+ 41us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:51.042828 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:51.043130 (+ 302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:51.044060 (+ 930us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:51.044069 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:51.044073 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:51.044882 (+ 809us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:51.045388 (+ 506us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:51.046628 (+ 1240us) server_negotiation.cc:299] Negotiation successful
0809 19:14:51.047073 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 19:14:51.054543 11625 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51d9626d2ac94b08b230db70ae7ea9f1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "90592a8a61e849c5a739f10e20c4f74a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90592a8a61e849c5a739f10e20c4f74a" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 40309 } } peers { permanent_uuid: "41a436dc7f6c4992806edf5c51f77872" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 33239 } } peers { permanent_uuid: "51d9626d2ac94b08b230db70ae7ea9f1" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 42149 } } }
I20260809 19:14:51.054826 11625 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51d9626d2ac94b08b230db70ae7ea9f1 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:14:51.055804 11707 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41a436dc7f6c4992806edf5c51f77872 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90592a8a61e849c5a739f10e20c4f74a" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 40309 } } peers { permanent_uuid: "41a436dc7f6c4992806edf5c51f77872" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 33239 } } peers { permanent_uuid: "51d9626d2ac94b08b230db70ae7ea9f1" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 42149 } } }
I20260809 19:14:51.056229 11707 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41a436dc7f6c4992806edf5c51f77872 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:14:51.057387 11672 catalog_manager.cc:1347] Generated new cluster ID: f6c10050f9af4ef1a4d283ce612aa8db
I20260809 19:14:51.057487 11672 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:14:51.057973 11493 sys_catalog.cc:564] T 00000000000000000000000000000000 P 41a436dc7f6c4992806edf5c51f77872 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:14:51.057914 11698 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 19:14:51.058468 11455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "90592a8a61e849c5a739f10e20c4f74a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "41a436dc7f6c4992806edf5c51f77872"
I20260809 19:14:51.058900 11455 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 41a436dc7f6c4992806edf5c51f77872 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:51.061944 11455 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 41a436dc7f6c4992806edf5c51f77872 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90592a8a61e849c5a739f10e20c4f74a in term 1.
I20260809 19:14:51.062943 11453 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 41a436dc7f6c4992806edf5c51f77872 [term 1 FOLLOWER]: Refusing update from remote peer 90592a8a61e849c5a739f10e20c4f74a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:14:51.063758 11651 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 90592a8a61e849c5a739f10e20c4f74a [LEADER]: Connected to new peer: Peer: permanent_uuid: "41a436dc7f6c4992806edf5c51f77872" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:14:51.086252 11672 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:14:51.088200 11672 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:14:51.069085 11280 master_runner.cc:186] Error getting master registration for 127.7.39.61:33239: OK, instance_id { permanent_uuid: "41a436dc7f6c4992806edf5c51f77872" instance_seqno: 1786302890222753 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 19:14:51.099855 11280 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 19:14:51.130525 11672 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 90592a8a61e849c5a739f10e20c4f74a: Generated new TSK 0
I20260809 19:14:51.131636 11672 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:14:51.136878 11651 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90592a8a61e849c5a739f10e20c4f74a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "90592a8a61e849c5a739f10e20c4f74a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90592a8a61e849c5a739f10e20c4f74a" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 40309 } } peers { permanent_uuid: "41a436dc7f6c4992806edf5c51f77872" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 33239 } } peers { permanent_uuid: "51d9626d2ac94b08b230db70ae7ea9f1" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 42149 } } }
I20260809 19:14:51.137202 11651 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90592a8a61e849c5a739f10e20c4f74a [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:51.135833 11718 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41a436dc7f6c4992806edf5c51f77872 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "90592a8a61e849c5a739f10e20c4f74a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90592a8a61e849c5a739f10e20c4f74a" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 40309 } } peers { permanent_uuid: "41a436dc7f6c4992806edf5c51f77872" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 33239 } } peers { permanent_uuid: "51d9626d2ac94b08b230db70ae7ea9f1" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 42149 } } }
I20260809 19:14:51.139245 11718 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41a436dc7f6c4992806edf5c51f77872 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:14:51.138849 11707 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41a436dc7f6c4992806edf5c51f77872 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 90592a8a61e849c5a739f10e20c4f74a. Latest consensus state: current_term: 1 leader_uuid: "90592a8a61e849c5a739f10e20c4f74a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90592a8a61e849c5a739f10e20c4f74a" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 40309 } } peers { permanent_uuid: "41a436dc7f6c4992806edf5c51f77872" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 33239 } } peers { permanent_uuid: "51d9626d2ac94b08b230db70ae7ea9f1" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 42149 } } }
I20260809 19:14:51.139598 11707 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41a436dc7f6c4992806edf5c51f77872 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:14:51.241214 11735 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
W20260809 19:14:51.286616 11622 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:14:51.267841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46926 (local address 127.7.39.62:40309)
0809 19:14:51.268331 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:51.268338 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:51.283694 (+ 15356us) server_negotiation.cc:407] Connection header received
0809 19:14:51.284687 (+ 993us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:51.284693 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:51.284785 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:51.284862 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:51.286272 (+ 1410us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46926: BlockingRecv error: recv got EOF from 127.0.0.1:46926 (error 108)
Metrics: {"server-negotiator.queue_time_us":347}
W20260809 19:14:51.288141 11500 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:14:51.268121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38810 (local address 127.7.39.61:33239)
0809 19:14:51.268485 (+ 364us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:51.268492 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:51.283509 (+ 15017us) server_negotiation.cc:407] Connection header received
0809 19:14:51.284194 (+ 685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:51.284201 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:51.284318 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:51.284399 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:51.287919 (+ 3520us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38810: BlockingRecv error: recv got EOF from 127.0.0.1:38810 (error 108)
Metrics: {"server-negotiator.queue_time_us":241}
W20260809 19:14:51.290918 11618 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:14:51.274501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47658 (local address 127.7.39.60:42149)
0809 19:14:51.274705 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:51.274712 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:51.288906 (+ 14194us) server_negotiation.cc:407] Connection header received
0809 19:14:51.289525 (+ 619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:51.289531 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:51.289613 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:51.289689 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:51.290653 (+ 964us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47658: BlockingRecv error: recv got EOF from 127.0.0.1:47658 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260809 19:14:51.303691 11500 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:14:51.300193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38822 (local address 127.7.39.61:33239)
0809 19:14:51.300392 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:51.300399 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:51.302012 (+ 1613us) server_negotiation.cc:407] Connection header received
0809 19:14:51.302364 (+ 352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:51.302371 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:51.302524 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:51.302637 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:51.303423 (+ 786us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38822: BlockingRecv error: recv got EOF from 127.0.0.1:38822 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260809 19:14:51.316097 11500 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:14:51.308062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38832 (local address 127.7.39.61:33239)
0809 19:14:51.308216 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:51.308222 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:51.314794 (+ 6572us) server_negotiation.cc:407] Connection header received
0809 19:14:51.314965 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:51.314971 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:51.315056 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:51.315166 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:51.315897 (+ 731us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38832: BlockingRecv error: recv got EOF from 127.0.0.1:38832 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260809 19:14:51.328028 11500 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:14:51.323951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38834 (local address 127.7.39.61:33239)
0809 19:14:51.324112 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:51.324117 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:51.326775 (+ 2658us) server_negotiation.cc:407] Connection header received
0809 19:14:51.326927 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:51.326933 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:51.327030 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:51.327137 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:51.327801 (+ 664us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38834: BlockingRecv error: recv got EOF from 127.0.0.1:38834 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260809 19:14:51.336756 11500 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:14:51.334849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38836 (local address 127.7.39.61:33239)
0809 19:14:51.335048 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:51.335054 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:51.335500 (+ 446us) server_negotiation.cc:407] Connection header received
0809 19:14:51.335646 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:51.335652 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:51.335732 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:51.335837 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:51.336553 (+ 716us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38836: BlockingRecv error: recv got EOF from 127.0.0.1:38836 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
W20260809 19:14:51.349684 11500 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:14:51.347776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38848 (local address 127.7.39.61:33239)
0809 19:14:51.347941 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:51.347946 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:51.348413 (+ 467us) server_negotiation.cc:407] Connection header received
0809 19:14:51.348583 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:51.348589 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:51.348667 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:51.348761 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:51.349475 (+ 714us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38848: BlockingRecv error: recv got EOF from 127.0.0.1:38848 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260809 19:14:51.371006 11500 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:14:51.368887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38850 (local address 127.7.39.61:33239)
0809 19:14:51.369046 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:51.369053 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:51.369602 (+ 549us) server_negotiation.cc:407] Connection header received
0809 19:14:51.369789 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:51.369794 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:51.369874 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:51.369976 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:51.370785 (+ 809us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38850: BlockingRecv error: recv got EOF from 127.0.0.1:38850 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260809 19:14:51.408604 11500 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:14:51.406632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38864 (local address 127.7.39.61:33239)
0809 19:14:51.406847 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:51.406855 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:51.407172 (+ 317us) server_negotiation.cc:407] Connection header received
0809 19:14:51.407339 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:51.407346 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:51.407489 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:51.407624 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:51.408306 (+ 682us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38864: BlockingRecv error: recv got EOF from 127.0.0.1:38864 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260809 19:14:51.477653 11500 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:14:51.475530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38868 (local address 127.7.39.61:33239)
0809 19:14:51.475724 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:51.475730 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:51.476077 (+ 347us) server_negotiation.cc:407] Connection header received
0809 19:14:51.476288 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:51.476292 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:51.476363 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:51.476446 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:51.477410 (+ 964us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38868: BlockingRecv error: recv got EOF from 127.0.0.1:38868 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260809 19:14:51.611979 11500 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:14:51.609954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38884 (local address 127.7.39.61:33239)
0809 19:14:51.610153 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:51.610160 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:51.610585 (+ 425us) server_negotiation.cc:407] Connection header received
0809 19:14:51.610805 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:51.610809 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:51.610884 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:51.610972 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:51.611781 (+ 809us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38884: BlockingRecv error: recv got EOF from 127.0.0.1:38884 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 19:14:51.816793 11646 catalog_manager.cc:1259] Loaded cluster ID: f6c10050f9af4ef1a4d283ce612aa8db
I20260809 19:14:51.816895 11646 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 51d9626d2ac94b08b230db70ae7ea9f1: loading cluster ID for follower catalog manager: success
I20260809 19:14:51.819403 11646 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 51d9626d2ac94b08b230db70ae7ea9f1: acquiring CA information for follower catalog manager: success
I20260809 19:14:51.821116 11646 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 51d9626d2ac94b08b230db70ae7ea9f1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260809 19:14:51.877550 11500 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:14:51.875863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38888 (local address 127.7.39.61:33239)
0809 19:14:51.876092 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:51.876099 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:51.876216 (+ 117us) server_negotiation.cc:407] Connection header received
0809 19:14:51.876431 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:51.876436 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:51.876509 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:51.876607 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:51.877330 (+ 723us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38888: BlockingRecv error: recv got EOF from 127.0.0.1:38888 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 19:14:52.245417 11735 catalog_manager.cc:1259] Loaded cluster ID: f6c10050f9af4ef1a4d283ce612aa8db
I20260809 19:14:52.245551 11735 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 41a436dc7f6c4992806edf5c51f77872: loading cluster ID for follower catalog manager: success
I20260809 19:14:52.248178 11735 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 41a436dc7f6c4992806edf5c51f77872: acquiring CA information for follower catalog manager: success
I20260809 19:14:52.249953 11735 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 41a436dc7f6c4992806edf5c51f77872: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 19:14:52.402158 11837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:52.396086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38894 (local address 127.7.39.61:33239)
0809 19:14:52.396890 (+ 804us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:52.396897 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:52.396915 (+ 18us) server_negotiation.cc:407] Connection header received
0809 19:14:52.396981 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:52.396984 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:52.397122 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:52.397259 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:14:52.397700 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:52.398552 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:52.399881 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:52.400362 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:52.400477 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:52.400990 (+ 513us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:14:52.401506 (+ 516us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:14:52.401661 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:52.401764 (+ 103us) server_negotiation.cc:299] Negotiation successful
0809 19:14:52.401846 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":644,"thread_start_us":497,"threads_started":1}
I20260809 19:14:52.417886 11847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:52.408131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47664 (local address 127.7.39.60:42149)
0809 19:14:52.412600 (+ 4469us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:52.412604 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:52.412620 (+ 16us) server_negotiation.cc:407] Connection header received
0809 19:14:52.412706 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:52.412710 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:52.412849 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:52.412980 (+ 131us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:14:52.413425 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:52.414108 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:52.415896 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:52.416266 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:52.416353 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:52.416824 (+ 471us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:14:52.417282 (+ 458us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:14:52.417384 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:52.417510 (+ 126us) server_negotiation.cc:299] Negotiation successful
0809 19:14:52.417589 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4363,"thread_start_us":4254,"threads_started":1}
I20260809 19:14:52.444159 11837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:52.425596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38910 (local address 127.7.39.61:33239)
0809 19:14:52.425792 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:52.425798 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:52.437054 (+ 11256us) server_negotiation.cc:407] Connection header received
0809 19:14:52.437218 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:52.437224 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:52.437312 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:52.437401 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:14:52.438703 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:52.439840 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:52.442034 (+ 2194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:52.442679 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:52.442767 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:52.443326 (+ 559us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:14:52.443453 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:14:52.443516 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:52.443759 (+ 243us) server_negotiation.cc:299] Negotiation successful
0809 19:14:52.443836 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260809 19:14:52.444267 11847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:52.425509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47668 (local address 127.7.39.60:42149)
0809 19:14:52.425655 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:52.425661 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:52.437642 (+ 11981us) server_negotiation.cc:407] Connection header received
0809 19:14:52.437810 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:52.437815 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:52.437896 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:52.437975 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:14:52.438889 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:52.439931 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:52.442220 (+ 2289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:52.442843 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:52.442931 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:52.443522 (+ 591us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:14:52.443655 (+ 133us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:14:52.443719 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:52.443935 (+ 216us) server_negotiation.cc:299] Negotiation successful
0809 19:14:52.444012 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 19:14:52.445184 11860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:52.425700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46936 (local address 127.7.39.62:40309)
0809 19:14:52.438139 (+ 12439us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:52.438144 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:52.438162 (+ 18us) server_negotiation.cc:407] Connection header received
0809 19:14:52.438268 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:52.438274 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:52.438489 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:52.439209 (+ 720us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:14:52.439377 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:52.440387 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:52.442540 (+ 2153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:52.443137 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:52.443673 (+ 536us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:52.443844 (+ 171us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:14:52.444249 (+ 405us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:14:52.444750 (+ 501us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:52.444804 (+ 54us) server_negotiation.cc:299] Negotiation successful
0809 19:14:52.444884 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12307,"thread_start_us":12191,"threads_started":1}
I20260809 19:14:52.450238 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 11280
I20260809 19:14:52.451299 11368 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:14:52.585479 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 11280
I20260809 19:14:52.613792 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 11392
I20260809 19:14:52.614882 11486 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:14:52.716682 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 11392
I20260809 19:14:52.738710 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 11507
I20260809 19:14:52.739748 11606 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:14:52.843609 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 11507
2026-08-09T19:14:52Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (5035 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:14:52 dist-test-slave-4tdj krb5kdc[11875](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:14:52 dist-test-slave-4tdj krb5kdc[11875](info): set up 2 sockets
Aug 09 19:14:52 dist-test-slave-4tdj krb5kdc[11875](info): commencing operation
krb5kdc: starting...
W20260809 19:14:54.074393 7324 mini_kdc.cc:121] Time spent starting KDC: real 1.180s user 0.000s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/krb5kdc/test-user.keytab.
Aug 09 19:14:54 dist-test-slave-4tdj krb5kdc[11875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302894, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:14:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:14:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.39.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
Entry for principal kudu/127.7.39.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab.
I20260809 19:14:54.325588 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:39517
--webserver_interface=127.7.39.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:35435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:39517,127.7.39.61:46221,127.7.39.60:33185
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:14:54.643801 11895 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 19:14:54.644116 11895 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:54.644215 11895 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:54.644322 11895 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:54.651234 11895 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:14:54.651309 11895 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:54.651391 11895 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:54.651453 11895 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:14:54.651537 11895 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:14:54.660718 11895 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:35435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:39517,127.7.39.61:46221,127.7.39.60:33185
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.62.keytab
--principal=kudu/127.7.39.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.62:39517
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.39.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:54.661835 11895 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:54.663098 11895 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:54.674001 11903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:54.674093 11908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:54.674096 11904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:54.675034 11895 server_base.cc:1034] running on GCE node
I20260809 19:14:54.675720 11895 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:54.676935 11895 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:54.678145 11895 hybrid_clock.cc:648] HybridClock initialized: now 1786302894678085 us; error 35 us; skew 500 ppm
I20260809 19:14:54.678471 11895 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:14:54 dist-test-slave-4tdj krb5kdc[11875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302894, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:14:54.681351 11895 init.cc:377] Logged in from keytab as kudu/127.7.39.62@KRBTEST.COM (short username kudu)
I20260809 19:14:54.682737 11895 webserver.cc:460] Webserver started at http://127.7.39.62:36857/ using document root <none> and password file <none>
I20260809 19:14:54.683367 11895 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:54.683465 11895 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:54.683769 11895 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:54.686592 11895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-0/data/instance:
uuid: "83acb6d671dd459f9d76a684d167f935"
format_stamp: "Formatted at 2026-08-09 19:14:54 on dist-test-slave-4tdj"
server_key: "91f8913060efba9cacfbb7466f3d5e06"
server_key_iv: "bb6c1a1166038be9c518b028ff616433"
server_key_version: "encryptionkey@0"
I20260809 19:14:54.687326 11895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-0/wal/instance:
uuid: "83acb6d671dd459f9d76a684d167f935"
format_stamp: "Formatted at 2026-08-09 19:14:54 on dist-test-slave-4tdj"
server_key: "91f8913060efba9cacfbb7466f3d5e06"
server_key_iv: "bb6c1a1166038be9c518b028ff616433"
server_key_version: "encryptionkey@0"
I20260809 19:14:54.692122 11895 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 19:14:54.695246 11917 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:54.696511 11895 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:14:54.696671 11895 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-0/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-0/wal
uuid: "83acb6d671dd459f9d76a684d167f935"
format_stamp: "Formatted at 2026-08-09 19:14:54 on dist-test-slave-4tdj"
server_key: "91f8913060efba9cacfbb7466f3d5e06"
server_key_iv: "bb6c1a1166038be9c518b028ff616433"
server_key_version: "encryptionkey@0"
I20260809 19:14:54.696856 11895 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:54.711191 11895 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:54.715158 11895 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:54.715405 11895 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:54.732439 11895 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.62:39517
I20260809 19:14:54.732458 11985 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.62:39517 every 8 connection(s)
I20260809 19:14:54.733678 11895 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-0/data/info.pb
I20260809 19:14:54.737143 11986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:54.737852 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 11895
I20260809 19:14:54.738052 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-0/wal/instance
I20260809 19:14:54.738679 7324 external_mini_cluster.cc:1428] Setting key bbd2bb1a4ac590b686d19d6c4517742c
I20260809 19:14:54.745693 11986 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39517 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 19:14:54 dist-test-slave-4tdj krb5kdc[11875](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302894, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:14:54.767972 11992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:54.748845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39517 (local address 127.0.0.1:43986)
0809 19:14:54.749629 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:54.749680 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:54.751636 (+ 1956us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:54.752494 (+ 858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:54.752501 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:54.753206 (+ 705us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:14:54.753656 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:54.753678 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:54.755229 (+ 1551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:54.755234 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:54.756753 (+ 1519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:54.756767 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:54.757642 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:54.757649 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:54.757822 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:54.758468 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:14:54.758495 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:14:54.760823 (+ 2328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:14:54.764486 (+ 3663us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:54.764496 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:54.764504 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:54.764875 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:54.765319 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:54.765322 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:54.765324 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:54.765470 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:54.766287 (+ 817us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:14:54.766309 (+ 22us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:14:54.766504 (+ 195us) client_negotiation.cc:769] Sending connection context
0809 19:14:54.766698 (+ 194us) client_negotiation.cc:240] Negotiation successful
0809 19:14:54.767042 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":338,"threads_started":1}
I20260809 19:14:54.768014 11993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:54.750026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43986 (local address 127.7.39.62:39517)
0809 19:14:54.750740 (+ 714us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:54.750748 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:54.750799 (+ 51us) server_negotiation.cc:407] Connection header received
0809 19:14:54.752005 (+ 1206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:54.752013 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:54.752260 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:54.752428 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:54.753857 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:54.755077 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:54.756886 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:54.757410 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:54.757533 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:54.761062 (+ 3529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:54.761077 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:54.761092 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:54.761132 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:54.764354 (+ 3222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:54.765009 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:54.765016 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:54.765020 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:54.765202 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:54.765573 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:54.765577 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:54.765580 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:54.766166 (+ 586us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:54.766387 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:54.766863 (+ 476us) server_negotiation.cc:299] Negotiation successful
0809 19:14:54.767204 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":63,"server-negotiator.queue_time_us":512,"thread_start_us":344,"threads_started":1}
WARNING: no policy specified for kudu/127.7.39.61@KRBTEST.COM; defaulting to no policy
I20260809 19:14:54.770954 11986 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46221 } has no permanent_uuid. Determining permanent_uuid...
I20260809 19:14:54.771819 11992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:54.771501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:46221 (local address 127.0.0.1:34880)
0809 19:14:54.771624 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:54.771720 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.61:46221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 19:14:54.772075 11921 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.39.61:46221: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.61@KRBTEST.COM" created.
I20260809 19:14:54.773463 11992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:54.773096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:46221 (local address 127.0.0.1:34892)
0809 19:14:54.773232 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:54.773323 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.61:46221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260809 19:14:54.773650 11986 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.61:46221: Network error: Client connection negotiation failed: client connection to 127.7.39.61:46221: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.61.keytab.
Entry for principal kudu/127.7.39.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.61.keytab.
I20260809 19:14:54.801373 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.61:46221
--webserver_interface=127.7.39.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.61.keytab
--principal=kudu/127.7.39.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:35435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:39517,127.7.39.61:46221,127.7.39.60:33185
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 19:14:54.822952 11986 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46221 } attempt: 1
I20260809 19:14:54.824132 11992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:54.823621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:46221 (local address 127.0.0.1:34898)
0809 19:14:54.823843 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:54.823952 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.61:46221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260809 19:14:54.825148 11992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:54.824767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:46221 (local address 127.0.0.1:34908)
0809 19:14:54.824916 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:54.824999 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.61:46221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 19:14:54.825330 11986 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.61:46221: Network error: Client connection negotiation failed: client connection to 127.7.39.61:46221: connect: Connection refused (error 111)
I20260809 19:14:54.893576 11986 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46221 } attempt: 2
I20260809 19:14:54.894834 11992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:54.894259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:46221 (local address 127.0.0.1:34910)
0809 19:14:54.894544 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:54.894658 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.61:46221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260809 19:14:54.895875 11992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:54.895472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:46221 (local address 127.0.0.1:34916)
0809 19:14:54.895615 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:54.895716 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.61:46221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 19:14:54.896073 11986 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.61:46221: Network error: Client connection negotiation failed: client connection to 127.7.39.61:46221: connect: Connection refused (error 111)
I20260809 19:14:54.987349 11986 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46221 } attempt: 3
I20260809 19:14:54.988719 11992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:54.988123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:46221 (local address 127.0.0.1:34920)
0809 19:14:54.988381 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:54.988515 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.61:46221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260809 19:14:54.989833 11992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:54.989392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:46221 (local address 127.0.0.1:34934)
0809 19:14:54.989549 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:54.989647 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.61:46221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 19:14:54.990049 11986 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.61:46221: Network error: Client connection negotiation failed: client connection to 127.7.39.61:46221: connect: Connection refused (error 111)
W20260809 19:14:55.126436 12003 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 19:14:55.126729 12003 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:55.126801 12003 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:55.126878 12003 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260809 19:14:55.133307 11986 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46221 } attempt: 4
W20260809 19:14:55.133705 12003 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:14:55.133777 12003 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:55.133846 12003 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:55.133901 12003 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:14:55.133982 12003 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:14:55.134543 11992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.133922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:46221 (local address 127.0.0.1:34946)
0809 19:14:55.134246 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:55.134385 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.61:46221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156}
I20260809 19:14:55.135550 11992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.135159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:46221 (local address 127.0.0.1:34962)
0809 19:14:55.135295 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:55.135396 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.61:46221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260809 19:14:55.135758 11986 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.61:46221: Network error: Client connection negotiation failed: client connection to 127.7.39.61:46221: connect: Connection refused (error 111)
I20260809 19:14:55.143824 12003 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:35435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:39517,127.7.39.61:46221,127.7.39.60:33185
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.61.keytab
--principal=kudu/127.7.39.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.61:46221
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.7.39.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:55.144918 12003 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:55.146114 12003 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:14:55.157073 12009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:55.157116 12012 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:55.157140 12014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:55.158152 12003 server_base.cc:1034] running on GCE node
I20260809 19:14:55.158924 12003 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:55.160104 12003 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:55.161327 12003 hybrid_clock.cc:648] HybridClock initialized: now 1786302895161256 us; error 45 us; skew 500 ppm
I20260809 19:14:55.161604 12003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:14:55 dist-test-slave-4tdj krb5kdc[11875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302895, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:14:55.164556 12003 init.cc:377] Logged in from keytab as kudu/127.7.39.61@KRBTEST.COM (short username kudu)
I20260809 19:14:55.165946 12003 webserver.cc:460] Webserver started at http://127.7.39.61:42373/ using document root <none> and password file <none>
I20260809 19:14:55.166599 12003 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:55.166689 12003 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:55.166926 12003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:55.169605 12003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-1/data/instance:
uuid: "ffb89a1c3989431e8a587f4acc08af4b"
format_stamp: "Formatted at 2026-08-09 19:14:55 on dist-test-slave-4tdj"
server_key: "bef1386e0102967847a79009ff4af0cf"
server_key_iv: "2b4c248edf5344a925011d15c323cf7f"
server_key_version: "encryptionkey@0"
I20260809 19:14:55.170284 12003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-1/wal/instance:
uuid: "ffb89a1c3989431e8a587f4acc08af4b"
format_stamp: "Formatted at 2026-08-09 19:14:55 on dist-test-slave-4tdj"
server_key: "bef1386e0102967847a79009ff4af0cf"
server_key_iv: "2b4c248edf5344a925011d15c323cf7f"
server_key_version: "encryptionkey@0"
I20260809 19:14:55.175045 12003 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 19:14:55.178093 12028 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:55.179318 12003 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 19:14:55.179456 12003 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-1/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-1/wal
uuid: "ffb89a1c3989431e8a587f4acc08af4b"
format_stamp: "Formatted at 2026-08-09 19:14:55 on dist-test-slave-4tdj"
server_key: "bef1386e0102967847a79009ff4af0cf"
server_key_iv: "2b4c248edf5344a925011d15c323cf7f"
server_key_version: "encryptionkey@0"
I20260809 19:14:55.179629 12003 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:55.207698 12003 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:55.211473 12003 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:55.211691 12003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:55.228642 12003 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.61:46221
I20260809 19:14:55.228662 12103 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.61:46221 every 8 connection(s)
I20260809 19:14:55.229799 12003 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-1/data/info.pb
I20260809 19:14:55.233109 12104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:55.233774 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 12003
I20260809 19:14:55.233940 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-1/wal/instance
I20260809 19:14:55.234433 7324 external_mini_cluster.cc:1428] Setting key 94db12442b28bc526d8dba23d560dae5
I20260809 19:14:55.239230 12104 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39517 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 19:14:55 dist-test-slave-4tdj krb5kdc[11875](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302895, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.61@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:14:55.258857 11993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.241519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43996 (local address 127.7.39.62:39517)
0809 19:14:55.241679 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:55.241683 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:55.243007 (+ 1324us) server_negotiation.cc:407] Connection header received
0809 19:14:55.244752 (+ 1745us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:55.244759 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:55.244836 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:55.244924 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:55.246688 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.247363 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.248848 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.249287 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.249403 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:55.253114 (+ 3711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:55.253121 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:55.253124 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:55.253162 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:55.255840 (+ 2678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:55.256637 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:55.256640 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:55.256643 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:55.256767 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:55.257238 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:55.257242 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:55.257245 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:55.257536 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:55.257653 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:55.258468 (+ 815us) server_negotiation.cc:299] Negotiation successful
0809 19:14:55.258639 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 19:14:55.260105 12108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.242091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39517 (local address 127.0.0.1:43996)
0809 19:14:55.242847 (+ 756us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:55.242882 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:55.244496 (+ 1614us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:55.245156 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:55.245163 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:55.245739 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:14:55.246491 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:55.246516 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.247515 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.247519 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:55.248693 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:55.248706 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.249511 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.249520 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:55.249728 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:55.250376 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:14:55.250412 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:14:55.252885 (+ 2473us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:14:55.255986 (+ 3101us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:55.255994 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:55.256006 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:55.256527 (+ 521us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:55.256877 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:55.256881 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:55.256884 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:55.257097 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:55.257669 (+ 572us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:14:55.257677 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:14:55.258080 (+ 403us) client_negotiation.cc:769] Sending connection context
0809 19:14:55.258378 (+ 298us) client_negotiation.cc:240] Negotiation successful
0809 19:14:55.258828 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":346,"threads_started":1}
I20260809 19:14:55.261809 12104 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46221 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.7.39.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.39.60@KRBTEST.COM" created.
Aug 09 19:14:55 dist-test-slave-4tdj krb5kdc[11875](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302895, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.61@KRBTEST.COM for kudu/127.7.39.61@KRBTEST.COM
I20260809 19:14:55.274933 12108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.262494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:46221 (local address 127.0.0.1:34968)
0809 19:14:55.262652 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:55.262666 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:55.262743 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:55.263805 (+ 1062us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:55.263808 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:55.264137 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:14:55.264283 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:55.264291 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.265665 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.265670 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:55.266679 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:55.266692 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.267433 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.267439 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:55.267589 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:55.268074 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:14:55.268087 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:14:55.269943 (+ 1856us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:14:55.272650 (+ 2707us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:55.272654 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:55.272659 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:55.273072 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:55.273391 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:55.273396 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:55.273400 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:55.273528 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:55.274068 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:14:55.274073 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:14:55.274193 (+ 120us) client_negotiation.cc:769] Sending connection context
0809 19:14:55.274334 (+ 141us) client_negotiation.cc:240] Negotiation successful
0809 19:14:55.274574 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 19:14:55.275036 12112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.262818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34968 (local address 127.7.39.61:46221)
0809 19:14:55.263426 (+ 608us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:55.263431 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:55.263455 (+ 24us) server_negotiation.cc:407] Connection header received
0809 19:14:55.263511 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:55.263516 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:55.263665 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:55.263768 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:55.264444 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.265531 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.266806 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.267283 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.267392 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:55.270122 (+ 2730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:55.270134 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:55.270145 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:55.270175 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:55.272538 (+ 2363us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:55.273184 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:55.273190 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:55.273192 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:55.273293 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:55.273622 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:55.273627 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:55.273630 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:55.273924 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:55.274114 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:55.274468 (+ 354us) server_negotiation.cc:299] Negotiation successful
0809 19:14:55.274671 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":461,"thread_start_us":332,"threads_started":1}
I20260809 19:14:55.277323 12104 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.39.60" port: 33185 } has no permanent_uuid. Determining permanent_uuid...
I20260809 19:14:55.278285 12108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.277881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:33185 (local address 127.0.0.1:43852)
0809 19:14:55.278038 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:55.278161 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:33185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 19:14:55.278553 12033 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.39.60:33185: connect: Connection refused (error 111)
I20260809 19:14:55.279888 12108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.279588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:33185 (local address 127.0.0.1:43854)
0809 19:14:55.279718 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:55.279793 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:33185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260809 19:14:55.280076 12104 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.60:33185: Network error: Client connection negotiation failed: client connection to 127.7.39.60:33185: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.39.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.60.keytab.
Entry for principal kudu/127.7.39.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.60.keytab.
I20260809 19:14:55.294997 7324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
/tmp/dist-test-taskP6iNI4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.60:33185
--webserver_interface=127.7.39.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.60.keytab
--principal=kudu/127.7.39.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.39.20:35435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.39.62:39517,127.7.39.61:46221,127.7.39.60:33185
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 19:14:55.329360 12104 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.60" port: 33185 } attempt: 1
I20260809 19:14:55.330435 12108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.329973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:33185 (local address 127.0.0.1:43856)
0809 19:14:55.330171 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:55.330252 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:33185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260809 19:14:55.331394 12108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.331066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:33185 (local address 127.0.0.1:43868)
0809 19:14:55.331209 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:55.331296 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:33185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 19:14:55.331626 12104 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.60:33185: Network error: Client connection negotiation failed: client connection to 127.7.39.60:33185: connect: Connection refused (error 111)
I20260809 19:14:55.399819 12104 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.60" port: 33185 } attempt: 2
I20260809 19:14:55.400934 12108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.400504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:33185 (local address 127.0.0.1:43878)
0809 19:14:55.400686 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:55.400777 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:33185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260809 19:14:55.401989 12108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.401576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:33185 (local address 127.0.0.1:43892)
0809 19:14:55.401734 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:55.401826 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:33185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 19:14:55.402211 12104 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.60:33185: Network error: Client connection negotiation failed: client connection to 127.7.39.60:33185: connect: Connection refused (error 111)
I20260809 19:14:55.434985 11986 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46221 } attempt: 5
Aug 09 19:14:55 dist-test-slave-4tdj krb5kdc[11875](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302894, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for kudu/127.7.39.61@KRBTEST.COM
I20260809 19:14:55.449023 12112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.435870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34984 (local address 127.7.39.61:46221)
0809 19:14:55.436030 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:55.436034 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:55.436054 (+ 20us) server_negotiation.cc:407] Connection header received
0809 19:14:55.436206 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:55.436210 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:55.436289 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:55.436369 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:55.437418 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.438112 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.439809 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.440245 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.440340 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:55.444022 (+ 3682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:55.444028 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:55.444032 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:55.444096 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:55.446567 (+ 2471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:55.447337 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:55.447341 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:55.447343 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:55.447452 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:55.447828 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:55.447831 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:55.447833 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:55.448099 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:55.448208 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:55.448634 (+ 426us) server_negotiation.cc:299] Negotiation successful
0809 19:14:55.448794 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 19:14:55.449216 11992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.435658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:46221 (local address 127.0.0.1:34984)
0809 19:14:55.435906 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:55.435931 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:55.436083 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:55.436443 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:55.436448 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:55.437033 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:14:55.437277 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:55.437291 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.438253 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.438259 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:55.439662 (+ 1403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:55.439681 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.440391 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.440398 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:55.440606 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:55.441211 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:14:55.441234 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:14:55.443829 (+ 2595us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:14:55.446694 (+ 2865us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:55.446699 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:55.446704 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:55.447234 (+ 530us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:55.447550 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:55.447555 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:55.447559 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:55.447733 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:55.448213 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:14:55.448219 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:14:55.448386 (+ 167us) client_negotiation.cc:769] Sending connection context
0809 19:14:55.448565 (+ 179us) client_negotiation.cc:240] Negotiation successful
0809 19:14:55.448852 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80}
I20260809 19:14:55.450336 11986 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.39.60" port: 33185 } has no permanent_uuid. Determining permanent_uuid...
I20260809 19:14:55.451315 11992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.450885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:33185 (local address 127.0.0.1:43894)
0809 19:14:55.451063 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:55.451156 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:33185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260809 19:14:55.452296 11992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.451935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:33185 (local address 127.0.0.1:43898)
0809 19:14:55.452073 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:55.452159 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:33185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260809 19:14:55.452551 11986 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.60:33185: Network error: Client connection negotiation failed: client connection to 127.7.39.60:33185: connect: Connection refused (error 111)
I20260809 19:14:55.493479 12104 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.60" port: 33185 } attempt: 3
I20260809 19:14:55.494879 12108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.494287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:33185 (local address 127.0.0.1:43908)
0809 19:14:55.494570 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:55.494686 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:33185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260809 19:14:55.496071 12108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.495555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:33185 (local address 127.0.0.1:43916)
0809 19:14:55.495816 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:55.495918 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:33185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146}
W20260809 19:14:55.496291 12104 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.60:33185: Network error: Client connection negotiation failed: client connection to 127.7.39.60:33185: connect: Connection refused (error 111)
I20260809 19:14:55.503772 11986 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.60" port: 33185 } attempt: 1
I20260809 19:14:55.504835 11992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.504327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:33185 (local address 127.0.0.1:43928)
0809 19:14:55.504535 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:55.504640 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:33185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260809 19:14:55.505846 11992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.505512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:33185 (local address 127.0.0.1:43938)
0809 19:14:55.505644 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:55.505723 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:33185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 19:14:55.506053 11986 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.60:33185: Network error: Client connection negotiation failed: client connection to 127.7.39.60:33185: connect: Connection refused (error 111)
I20260809 19:14:55.574276 11986 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.60" port: 33185 } attempt: 2
I20260809 19:14:55.575553 11992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.575000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:33185 (local address 127.0.0.1:43944)
0809 19:14:55.575225 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:55.575351 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:33185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260809 19:14:55.576512 11992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.576152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:33185 (local address 127.0.0.1:43952)
0809 19:14:55.576288 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:55.576369 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:33185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260809 19:14:55.576722 11986 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.60:33185: Network error: Client connection negotiation failed: client connection to 127.7.39.60:33185: connect: Connection refused (error 111)
W20260809 19:14:55.614825 12116 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 19:14:55.615100 12116 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:14:55.615170 12116 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:14:55.615247 12116 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:14:55.622010 12116 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:14:55.622084 12116 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:14:55.622138 12116 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:14:55.622185 12116 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:14:55.622242 12116 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:14:55.631403 12116 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.39.20:35435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.7.39.62:39517,127.7.39.61:46221,127.7.39.60:33185
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/krb5kdc/kudu_127.7.39.60.keytab
--principal=kudu/127.7.39.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.39.60:33185
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.7.39.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:14:55.632503 12116 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:14:55.633716 12116 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 19:14:55.639504 12104 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.60" port: 33185 } attempt: 4
I20260809 19:14:55.640563 12108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.640043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:33185 (local address 127.0.0.1:43962)
0809 19:14:55.640285 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:55.640387 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:33185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260809 19:14:55.641496 12108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.641161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:33185 (local address 127.0.0.1:43970)
0809 19:14:55.641295 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:55.641375 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:33185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260809 19:14:55.641727 12104 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.60:33185: Network error: Client connection negotiation failed: client connection to 127.7.39.60:33185: connect: Connection refused (error 111)
W20260809 19:14:55.644995 12123 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:55.645134 12124 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:14:55.645431 12130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:14:55.646147 12116 server_base.cc:1034] running on GCE node
I20260809 19:14:55.646869 12116 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:14:55.648059 12116 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:14:55.649269 12116 hybrid_clock.cc:648] HybridClock initialized: now 1786302895649200 us; error 40 us; skew 500 ppm
I20260809 19:14:55.649570 12116 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:14:55 dist-test-slave-4tdj krb5kdc[11875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302895, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:14:55.652469 12116 init.cc:377] Logged in from keytab as kudu/127.7.39.60@KRBTEST.COM (short username kudu)
I20260809 19:14:55.653823 12116 webserver.cc:460] Webserver started at http://127.7.39.60:41107/ using document root <none> and password file <none>
I20260809 19:14:55.654502 12116 fs_manager.cc:359] Metadata directory not provided
I20260809 19:14:55.654593 12116 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:14:55.654891 12116 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:14:55.657620 12116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-2/data/instance:
uuid: "b5ce464c072345fb9255e047b7c04082"
format_stamp: "Formatted at 2026-08-09 19:14:55 on dist-test-slave-4tdj"
server_key: "be7666a1ac6f40192ef3981aaceb4bd4"
server_key_iv: "32c02d3b2138b194cc9e63ca7913e3ee"
server_key_version: "encryptionkey@0"
I20260809 19:14:55.658398 12116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-2/wal/instance:
uuid: "b5ce464c072345fb9255e047b7c04082"
format_stamp: "Formatted at 2026-08-09 19:14:55 on dist-test-slave-4tdj"
server_key: "be7666a1ac6f40192ef3981aaceb4bd4"
server_key_iv: "32c02d3b2138b194cc9e63ca7913e3ee"
server_key_version: "encryptionkey@0"
I20260809 19:14:55.663075 12116 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260809 19:14:55.666157 12139 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:14:55.667385 12116 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 19:14:55.667534 12116 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-2/data,/tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-2/wal
uuid: "b5ce464c072345fb9255e047b7c04082"
format_stamp: "Formatted at 2026-08-09 19:14:55 on dist-test-slave-4tdj"
server_key: "be7666a1ac6f40192ef3981aaceb4bd4"
server_key_iv: "32c02d3b2138b194cc9e63ca7913e3ee"
server_key_version: "encryptionkey@0"
I20260809 19:14:55.667716 12116 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:14:55.682914 11986 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.60" port: 33185 } attempt: 3
I20260809 19:14:55.684012 11992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.683490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:33185 (local address 127.0.0.1:43976)
0809 19:14:55.683707 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:55.683803 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:33185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260809 19:14:55.684965 11992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.684623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:33185 (local address 127.0.0.1:43984)
0809 19:14:55.684767 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:55.684851 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.39.60:33185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260809 19:14:55.685143 11986 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.39.60:33185: Network error: Client connection negotiation failed: client connection to 127.7.39.60:33185: connect: Connection refused (error 111)
I20260809 19:14:55.695406 12116 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:14:55.702912 12116 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:14:55.703130 12116 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:14:55.719671 12116 rpc_server.cc:307] RPC server started. Bound to: 127.7.39.60:33185
I20260809 19:14:55.719691 12219 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.39.60:33185 every 8 connection(s)
I20260809 19:14:55.720892 12116 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-2/data/info.pb
I20260809 19:14:55.724416 12220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:14:55.726063 7324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu as pid 12116
I20260809 19:14:55.726250 7324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP6iNI4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786302538618573-7324-0/minicluster-data/master-2/wal/instance
I20260809 19:14:55.726830 7324 external_mini_cluster.cc:1428] Setting key 945c4c8b86456a3304d9b23086c161fe
I20260809 19:14:55.733760 12220 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39517 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 19:14:55 dist-test-slave-4tdj krb5kdc[11875](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302894, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.60@KRBTEST.COM
Aug 09 19:14:55 dist-test-slave-4tdj krb5kdc[11875](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302895, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.60@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:14:55.748821 12224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.728620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43992 (local address 127.7.39.60:33185)
0809 19:14:55.729365 (+ 745us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:55.729379 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:55.729419 (+ 40us) server_negotiation.cc:407] Connection header received
0809 19:14:55.730951 (+ 1532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:55.730979 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:55.731347 (+ 368us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:55.731656 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:55.733311 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.735218 (+ 1907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.736812 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.737677 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.737848 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:55.742441 (+ 4593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:55.742452 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:55.742466 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:55.742502 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:55.745280 (+ 2778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:55.745891 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:55.745897 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:55.745903 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:55.746047 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:55.746413 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:55.746419 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:55.746421 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:55.746864 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:55.747137 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:55.747576 (+ 439us) server_negotiation.cc:299] Negotiation successful
0809 19:14:55.747923 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":551,"thread_start_us":358,"threads_started":1}
I20260809 19:14:55.749812 11993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.736287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44002 (local address 127.7.39.62:39517)
0809 19:14:55.736492 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:55.736498 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:55.737152 (+ 654us) server_negotiation.cc:407] Connection header received
0809 19:14:55.737406 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:55.737411 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:55.737506 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:55.737610 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:55.738832 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.739534 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.740776 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.741245 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.741352 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:55.744766 (+ 3414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:55.744770 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:55.744774 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:55.744804 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:55.747190 (+ 2386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:55.747840 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:55.747845 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:55.747848 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:55.748013 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:55.748382 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:55.748385 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:55.748387 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:55.748643 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:55.748770 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:55.749275 (+ 505us) server_negotiation.cc:299] Negotiation successful
0809 19:14:55.749485 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 19:14:55.749853 12225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.736176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.62:39517 (local address 127.0.0.1:44002)
0809 19:14:55.737026 (+ 850us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:55.737071 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:55.737266 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:55.737677 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:55.737684 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:55.738390 (+ 706us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:14:55.738691 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:55.738701 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.739680 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.739684 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:55.740643 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:55.740654 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.741458 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.741478 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:55.741630 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:55.742156 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:14:55.742181 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:14:55.744589 (+ 2408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:14:55.747310 (+ 2721us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:55.747321 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:55.747328 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:55.747705 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:55.748131 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:55.748134 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:55.748137 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:55.748273 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:55.748769 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:14:55.748780 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:14:55.748994 (+ 214us) client_negotiation.cc:769] Sending connection context
0809 19:14:55.749152 (+ 158us) client_negotiation.cc:240] Negotiation successful
0809 19:14:55.749457 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":617,"thread_start_us":464,"threads_started":1}
I20260809 19:14:55.751420 12220 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46221 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 19:14:55 dist-test-slave-4tdj krb5kdc[11875](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302895, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.60@KRBTEST.COM for kudu/127.7.39.61@KRBTEST.COM
Aug 09 19:14:55 dist-test-slave-4tdj krb5kdc[11875](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302894, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.62@KRBTEST.COM
I20260809 19:14:55.763311 12112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.752130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35000 (local address 127.7.39.61:46221)
0809 19:14:55.752296 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:55.752303 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:55.752350 (+ 47us) server_negotiation.cc:407] Connection header received
0809 19:14:55.752521 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:55.752527 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:55.752587 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:55.752665 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:55.753282 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.753932 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.755099 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.755522 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.755625 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:55.758134 (+ 2509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:55.758139 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:55.758143 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:55.758174 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:55.760814 (+ 2640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:55.761383 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:55.761388 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:55.761391 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:55.761530 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:55.761866 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:55.761874 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:55.761876 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:55.762194 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:55.762378 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:55.762823 (+ 445us) server_negotiation.cc:299] Negotiation successful
0809 19:14:55.763033 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 19:14:55.763336 12225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.751947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.61:46221 (local address 127.0.0.1:35000)
0809 19:14:55.752289 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:55.752305 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:55.752397 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:55.752696 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:55.752700 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:55.753032 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:14:55.753149 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:55.753156 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.754073 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.754079 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:55.754962 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:55.754972 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.755646 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.755652 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:55.755822 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:55.756222 (+ 400us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:14:55.756237 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:14:55.757962 (+ 1725us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:14:55.760934 (+ 2972us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:55.760939 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:55.760943 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:55.761274 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:55.761632 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:55.761637 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:55.761641 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:55.761768 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:55.762378 (+ 610us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:14:55.762384 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:14:55.762566 (+ 182us) client_negotiation.cc:769] Sending connection context
0809 19:14:55.762742 (+ 176us) client_negotiation.cc:240] Negotiation successful
0809 19:14:55.762986 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252}
I20260809 19:14:55.764106 12220 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.39.60" port: 33185 } has no permanent_uuid. Determining permanent_uuid...
I20260809 19:14:55.764645 11993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.751495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44016 (local address 127.7.39.62:39517)
0809 19:14:55.751841 (+ 346us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:55.751845 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:55.751859 (+ 14us) server_negotiation.cc:407] Connection header received
0809 19:14:55.751910 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:55.751915 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:55.751974 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:55.752067 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:55.753276 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.753953 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.755149 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.755533 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.755637 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:55.759489 (+ 3852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:55.759495 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:55.759498 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:55.759533 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:55.761844 (+ 2311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:55.762564 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:55.762570 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:55.762574 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:55.762726 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:55.763143 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:55.763149 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:55.763152 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:55.763524 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:55.763803 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:55.764141 (+ 338us) server_negotiation.cc:299] Negotiation successful
0809 19:14:55.764348 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":255}
Aug 09 19:14:55 dist-test-slave-4tdj krb5kdc[11875](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302895, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.60@KRBTEST.COM for kudu/127.7.39.60@KRBTEST.COM
Aug 09 19:14:55 dist-test-slave-4tdj krb5kdc[11875](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302894, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.39.61@KRBTEST.COM
I20260809 19:14:55.777314 12224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.765052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44004 (local address 127.7.39.60:33185)
0809 19:14:55.765232 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:55.765235 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:55.765251 (+ 16us) server_negotiation.cc:407] Connection header received
0809 19:14:55.765288 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:55.765291 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:55.765342 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:55.765432 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:55.766184 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.767088 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.768312 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.768715 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.768813 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:55.771895 (+ 3082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:55.771900 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:55.771904 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:55.771932 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:55.774861 (+ 2929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:55.775488 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:55.775492 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:55.775494 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:55.775621 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:55.776026 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:55.776032 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:55.776035 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:55.776353 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:55.776457 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:55.776859 (+ 402us) server_negotiation.cc:299] Negotiation successful
0809 19:14:55.777048 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 19:14:55.777678 12225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.764753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:33185 (local address 127.0.0.1:44004)
0809 19:14:55.764881 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:55.764897 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:55.764996 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:55.765475 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:55.765479 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:55.765879 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:14:55.766039 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:55.766052 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.767212 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.767216 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:55.768153 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:55.768168 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.768863 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.768870 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:55.769071 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:55.769560 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:14:55.769577 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:14:55.771710 (+ 2133us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:14:55.775002 (+ 3292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:55.775007 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:55.775012 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:55.775377 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:55.775727 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:55.775732 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:55.775737 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:55.775898 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:55.776475 (+ 577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:14:55.776481 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:14:55.776642 (+ 161us) client_negotiation.cc:769] Sending connection context
0809 19:14:55.776807 (+ 165us) client_negotiation.cc:240] Negotiation successful
0809 19:14:55.777236 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":113}
I20260809 19:14:55.782145 12112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.766361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35012 (local address 127.7.39.61:46221)
0809 19:14:55.766524 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:55.766528 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:55.766545 (+ 17us) server_negotiation.cc:407] Connection header received
0809 19:14:55.766680 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:55.766683 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:55.766737 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:55.766816 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:55.768023 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.768793 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.769970 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.770662 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.770801 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:55.775450 (+ 4649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:55.775467 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:55.775472 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:55.775513 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:55.778859 (+ 3346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:55.779625 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:55.779628 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:55.779631 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:55.779757 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:55.780132 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:55.780135 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:55.780137 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:55.780373 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:55.780656 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:55.781548 (+ 892us) server_negotiation.cc:299] Negotiation successful
0809 19:14:55.781774 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 19:14:55.783702 12220 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5ce464c072345fb9255e047b7c04082: Bootstrap starting.
I20260809 19:14:55.787298 12220 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b5ce464c072345fb9255e047b7c04082: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:55.787377 7324 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:14:55.788319 12220 log.cc:824] T 00000000000000000000000000000000 P b5ce464c072345fb9255e047b7c04082: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:55.791071 12220 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5ce464c072345fb9255e047b7c04082: No bootstrap required, opened a new log
I20260809 19:14:55.789736 11954 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "83acb6d671dd459f9d76a684d167f935"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44016
I20260809 19:14:55.798255 12220 raft_consensus.cc:348] T 00000000000000000000000000000000 P b5ce464c072345fb9255e047b7c04082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83acb6d671dd459f9d76a684d167f935" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39517 } } peers { permanent_uuid: "ffb89a1c3989431e8a587f4acc08af4b" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46221 } } peers { permanent_uuid: "b5ce464c072345fb9255e047b7c04082" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 33185 } }
I20260809 19:14:55.798616 12220 raft_consensus.cc:729] T 00000000000000000000000000000000 P b5ce464c072345fb9255e047b7c04082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5ce464c072345fb9255e047b7c04082, State: Initialized, Role: FOLLOWER
I20260809 19:14:55.799036 12220 consensus_queue.cc:260] T 00000000000000000000000000000000 P b5ce464c072345fb9255e047b7c04082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83acb6d671dd459f9d76a684d167f935" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39517 } } peers { permanent_uuid: "ffb89a1c3989431e8a587f4acc08af4b" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46221 } } peers { permanent_uuid: "b5ce464c072345fb9255e047b7c04082" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 33185 } }
I20260809 19:14:55.799957 12227 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5ce464c072345fb9255e047b7c04082 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83acb6d671dd459f9d76a684d167f935" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39517 } } peers { permanent_uuid: "ffb89a1c3989431e8a587f4acc08af4b" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46221 } } peers { permanent_uuid: "b5ce464c072345fb9255e047b7c04082" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 33185 } } }
I20260809 19:14:55.800323 12227 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5ce464c072345fb9255e047b7c04082 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:14:55.801043 12220 sys_catalog.cc:564] T 00000000000000000000000000000000 P b5ce464c072345fb9255e047b7c04082 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 19:14:55.810452 12245 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b5ce464c072345fb9255e047b7c04082: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 19:14:55.810588 12245 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 19:14:55.808117 12116 master_runner.cc:186] Error getting master registration for 127.7.39.62:39517: OK, instance_id { permanent_uuid: "83acb6d671dd459f9d76a684d167f935" instance_seqno: 1786302894727655 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 19:14:55.815954 12116 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 19:14:55.862349 11986 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.60" port: 33185 } attempt: 4
Aug 09 19:14:55 dist-test-slave-4tdj krb5kdc[11875](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302894, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.62@KRBTEST.COM for kudu/127.7.39.60@KRBTEST.COM
I20260809 19:14:55.878757 11992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.863174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:33185 (local address 127.0.0.1:44012)
0809 19:14:55.863392 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:55.863414 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:55.863570 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:55.863927 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:55.863931 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:55.864453 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:14:55.864696 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:55.864708 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.866151 (+ 1443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.866157 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:55.867621 (+ 1464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:55.867636 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.868635 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.868641 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:55.868835 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:55.869461 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:14:55.869482 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:14:55.872216 (+ 2734us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:14:55.876053 (+ 3837us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:55.876059 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:55.876064 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:55.876545 (+ 481us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:55.876922 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:55.876926 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:55.876930 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:55.877096 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:55.877769 (+ 673us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:14:55.877774 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:14:55.877926 (+ 152us) client_negotiation.cc:769] Sending connection context
0809 19:14:55.878065 (+ 139us) client_negotiation.cc:240] Negotiation successful
0809 19:14:55.878366 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70}
I20260809 19:14:55.878827 12224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.863209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44012 (local address 127.7.39.60:33185)
0809 19:14:55.863423 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:55.863429 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:55.863532 (+ 103us) server_negotiation.cc:407] Connection header received
0809 19:14:55.863693 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:55.863699 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:55.863784 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:55.863892 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:55.864859 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.866005 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.867768 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.868493 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.868627 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:55.872386 (+ 3759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:55.872393 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:55.872398 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:55.872438 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:55.875909 (+ 3471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:55.876661 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:55.876667 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:55.876670 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:55.876810 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:55.877198 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:55.877203 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:55.877207 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:55.877654 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:55.877802 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:55.878209 (+ 407us) server_negotiation.cc:299] Negotiation successful
0809 19:14:55.878459 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 19:14:55.883354 11986 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83acb6d671dd459f9d76a684d167f935: Bootstrap starting.
I20260809 19:14:55.886629 11986 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 83acb6d671dd459f9d76a684d167f935: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:55.887849 11986 log.cc:824] T 00000000000000000000000000000000 P 83acb6d671dd459f9d76a684d167f935: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:55.891052 11986 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83acb6d671dd459f9d76a684d167f935: No bootstrap required, opened a new log
I20260809 19:14:55.898262 11986 raft_consensus.cc:348] T 00000000000000000000000000000000 P 83acb6d671dd459f9d76a684d167f935 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83acb6d671dd459f9d76a684d167f935" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39517 } } peers { permanent_uuid: "ffb89a1c3989431e8a587f4acc08af4b" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46221 } } peers { permanent_uuid: "b5ce464c072345fb9255e047b7c04082" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 33185 } }
I20260809 19:14:55.898645 11986 raft_consensus.cc:729] T 00000000000000000000000000000000 P 83acb6d671dd459f9d76a684d167f935 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83acb6d671dd459f9d76a684d167f935, State: Initialized, Role: FOLLOWER
I20260809 19:14:55.899124 11986 consensus_queue.cc:260] T 00000000000000000000000000000000 P 83acb6d671dd459f9d76a684d167f935 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83acb6d671dd459f9d76a684d167f935" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39517 } } peers { permanent_uuid: "ffb89a1c3989431e8a587f4acc08af4b" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46221 } } peers { permanent_uuid: "b5ce464c072345fb9255e047b7c04082" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 33185 } }
I20260809 19:14:55.900307 12248 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83acb6d671dd459f9d76a684d167f935 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83acb6d671dd459f9d76a684d167f935" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39517 } } peers { permanent_uuid: "ffb89a1c3989431e8a587f4acc08af4b" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46221 } } peers { permanent_uuid: "b5ce464c072345fb9255e047b7c04082" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 33185 } } }
I20260809 19:14:55.900915 12248 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83acb6d671dd459f9d76a684d167f935 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:14:55.901384 11986 sys_catalog.cc:564] T 00000000000000000000000000000000 P 83acb6d671dd459f9d76a684d167f935 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:14:55.901448 11954 raft_consensus.cc:482] T 00000000000000000000000000000000 P 83acb6d671dd459f9d76a684d167f935 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 19:14:55.901659 11954 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 83acb6d671dd459f9d76a684d167f935 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:55.905148 11954 raft_consensus.cc:504] T 00000000000000000000000000000000 P 83acb6d671dd459f9d76a684d167f935 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83acb6d671dd459f9d76a684d167f935" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39517 } } peers { permanent_uuid: "ffb89a1c3989431e8a587f4acc08af4b" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46221 } } peers { permanent_uuid: "b5ce464c072345fb9255e047b7c04082" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 33185 } }
I20260809 19:14:55.908241 12176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "83acb6d671dd459f9d76a684d167f935" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b5ce464c072345fb9255e047b7c04082"
I20260809 19:14:55.908785 12176 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b5ce464c072345fb9255e047b7c04082 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:55.912395 12176 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b5ce464c072345fb9255e047b7c04082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83acb6d671dd459f9d76a684d167f935 in term 1.
I20260809 19:14:55.913053 11921 leader_election.cc:302] T 00000000000000000000000000000000 P 83acb6d671dd459f9d76a684d167f935 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83acb6d671dd459f9d76a684d167f935, b5ce464c072345fb9255e047b7c04082; no voters:
I20260809 19:14:55.913549 11954 leader_election.cc:288] T 00000000000000000000000000000000 P 83acb6d671dd459f9d76a684d167f935 [CANDIDATE]: Term 1 election: Requested vote from peers ffb89a1c3989431e8a587f4acc08af4b (127.7.39.61:46221), b5ce464c072345fb9255e047b7c04082 (127.7.39.60:33185)
I20260809 19:14:55.913920 12248 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 83acb6d671dd459f9d76a684d167f935 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:14:55.926540 12248 raft_consensus.cc:686] T 00000000000000000000000000000000 P 83acb6d671dd459f9d76a684d167f935 [term 1 LEADER]: Becoming Leader. State: Replica: 83acb6d671dd459f9d76a684d167f935, State: Running, Role: LEADER
I20260809 19:14:55.927176 12248 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83acb6d671dd459f9d76a684d167f935 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83acb6d671dd459f9d76a684d167f935" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39517 } } peers { permanent_uuid: "ffb89a1c3989431e8a587f4acc08af4b" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46221 } } peers { permanent_uuid: "b5ce464c072345fb9255e047b7c04082" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 33185 } }
I20260809 19:14:55.937067 12260 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83acb6d671dd459f9d76a684d167f935 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83acb6d671dd459f9d76a684d167f935. Latest consensus state: current_term: 1 leader_uuid: "83acb6d671dd459f9d76a684d167f935" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83acb6d671dd459f9d76a684d167f935" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39517 } } peers { permanent_uuid: "ffb89a1c3989431e8a587f4acc08af4b" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46221 } } peers { permanent_uuid: "b5ce464c072345fb9255e047b7c04082" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 33185 } } }
I20260809 19:14:55.937511 12260 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83acb6d671dd459f9d76a684d167f935 [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:55.938803 12286 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:14:55.940925 12104 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.39.60" port: 33185 } attempt: 5
Aug 09 19:14:55 dist-test-slave-4tdj krb5kdc[11875](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302895, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.39.61@KRBTEST.COM for kudu/127.7.39.60@KRBTEST.COM
W20260809 19:14:55.955006 12146 tablet.cc:2369] T 00000000000000000000000000000000 P b5ce464c072345fb9255e047b7c04082: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:14:55.957834 12286 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:14:55.957976 12108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.941554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.39.60:33185 (local address 127.0.0.1:44014)
0809 19:14:55.941754 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0809 19:14:55.941778 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 19:14:55.941908 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:14:55.942482 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:14:55.942487 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:14:55.943032 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:14:55.943249 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:55.943262 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.944784 (+ 1522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.944789 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:55.946273 (+ 1484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:14:55.946304 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.947498 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.947506 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:14:55.947716 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:55.948382 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:14:55.948407 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:14:55.951187 (+ 2780us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:14:55.955171 (+ 3984us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:55.955177 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:55.955180 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:55.955693 (+ 513us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:55.956163 (+ 470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:14:55.956169 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:14:55.956172 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:14:55.956338 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:14:55.957028 (+ 690us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:14:55.957033 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:14:55.957192 (+ 159us) client_negotiation.cc:769] Sending connection context
0809 19:14:55.957341 (+ 149us) client_negotiation.cc:240] Negotiation successful
0809 19:14:55.957610 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260809 19:14:55.958895 12224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.941943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44014 (local address 127.7.39.60:33185)
0809 19:14:55.942129 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:55.942136 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:55.942156 (+ 20us) server_negotiation.cc:407] Connection header received
0809 19:14:55.942220 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:55.942225 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:55.942336 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:55.942447 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:55.943446 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.944603 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.946466 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.947166 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.947285 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:55.951393 (+ 4108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:55.951400 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:55.951404 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:55.951445 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:55.955010 (+ 3565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:55.955832 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:55.955838 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:55.955842 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:55.956019 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:55.956467 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:55.956472 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:55.956476 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:55.956809 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:55.956951 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:55.958342 (+ 1391us) server_negotiation.cc:299] Negotiation successful
0809 19:14:55.958557 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 19:14:55.964970 12104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffb89a1c3989431e8a587f4acc08af4b: Bootstrap starting.
W20260809 19:14:55.967993 11923 tablet.cc:2369] T 00000000000000000000000000000000 P 83acb6d671dd459f9d76a684d167f935: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:14:55.969203 12104 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ffb89a1c3989431e8a587f4acc08af4b: Neither blocks nor log segments found. Creating new log.
I20260809 19:14:55.982669 12104 log.cc:824] T 00000000000000000000000000000000 P ffb89a1c3989431e8a587f4acc08af4b: Log is configured to *not* fsync() on all Append() calls
I20260809 19:14:55.969913 11895 master_runner.cc:186] Error getting master registration for 127.7.39.61:46221: OK, instance_id { permanent_uuid: "ffb89a1c3989431e8a587f4acc08af4b" instance_seqno: 1786302895223765 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 19:14:55.984587 11895 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 19:14:55.989396 12176 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b5ce464c072345fb9255e047b7c04082 [term 1 FOLLOWER]: Refusing update from remote peer 83acb6d671dd459f9d76a684d167f935: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:14:55.990590 12260 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 83acb6d671dd459f9d76a684d167f935 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5ce464c072345fb9255e047b7c04082" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 33185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:14:55.990922 12104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffb89a1c3989431e8a587f4acc08af4b: No bootstrap required, opened a new log
I20260809 19:14:56.010605 12104 raft_consensus.cc:348] T 00000000000000000000000000000000 P ffb89a1c3989431e8a587f4acc08af4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83acb6d671dd459f9d76a684d167f935" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39517 } } peers { permanent_uuid: "ffb89a1c3989431e8a587f4acc08af4b" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46221 } } peers { permanent_uuid: "b5ce464c072345fb9255e047b7c04082" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 33185 } }
I20260809 19:14:56.011021 12104 raft_consensus.cc:729] T 00000000000000000000000000000000 P ffb89a1c3989431e8a587f4acc08af4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffb89a1c3989431e8a587f4acc08af4b, State: Initialized, Role: FOLLOWER
I20260809 19:14:56.011551 12104 consensus_queue.cc:260] T 00000000000000000000000000000000 P ffb89a1c3989431e8a587f4acc08af4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83acb6d671dd459f9d76a684d167f935" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39517 } } peers { permanent_uuid: "ffb89a1c3989431e8a587f4acc08af4b" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46221 } } peers { permanent_uuid: "b5ce464c072345fb9255e047b7c04082" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 33185 } }
I20260809 19:14:56.014880 12112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.972439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35026 (local address 127.7.39.61:46221)
0809 19:14:55.972606 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:55.972612 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:55.979316 (+ 6704us) server_negotiation.cc:407] Connection header received
0809 19:14:55.980441 (+ 1125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:55.980447 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:55.980530 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:55.980595 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:55.984441 (+ 3846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.985440 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.996067 (+ 10627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.996725 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.996826 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:56.005765 (+ 8939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:56.005772 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:56.005777 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:56.005818 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:56.009890 (+ 4072us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:56.011836 (+ 1946us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:56.011844 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:56.011867 (+ 23us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:56.012085 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:56.012766 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:56.012771 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:56.012775 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:56.013139 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:56.013391 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:56.014269 (+ 878us) server_negotiation.cc:299] Negotiation successful
0809 19:14:56.014536 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 19:14:56.021018 12104 sys_catalog.cc:564] T 00000000000000000000000000000000 P ffb89a1c3989431e8a587f4acc08af4b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:14:56.021054 12067 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "83acb6d671dd459f9d76a684d167f935" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "ffb89a1c3989431e8a587f4acc08af4b"
I20260809 19:14:56.021363 12066 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ffb89a1c3989431e8a587f4acc08af4b [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:14:56.019019 12302 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffb89a1c3989431e8a587f4acc08af4b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83acb6d671dd459f9d76a684d167f935" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39517 } } peers { permanent_uuid: "ffb89a1c3989431e8a587f4acc08af4b" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46221 } } peers { permanent_uuid: "b5ce464c072345fb9255e047b7c04082" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 33185 } } }
I20260809 19:14:56.022594 12302 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffb89a1c3989431e8a587f4acc08af4b [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:14:56.024559 11993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.948943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44018 (local address 127.7.39.62:39517)
0809 19:14:55.949100 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:55.949106 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:55.972340 (+ 23234us) server_negotiation.cc:407] Connection header received
0809 19:14:55.972628 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:55.972633 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:55.972720 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:55.972794 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:55.983323 (+ 10529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.984540 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.986833 (+ 2293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:55.987647 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:55.987746 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:56.011908 (+ 24162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:56.011916 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:56.011922 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:56.011969 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:56.015846 (+ 3877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:56.017636 (+ 1790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:56.017642 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:56.017645 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:56.017785 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:56.021670 (+ 3885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:56.021676 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:56.021679 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:56.021984 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:56.022170 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:56.023985 (+ 1815us) server_negotiation.cc:299] Negotiation successful
0809 19:14:56.024224 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 19:14:56.025254 12066 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ffb89a1c3989431e8a587f4acc08af4b [term 1 FOLLOWER]: Refusing update from remote peer 83acb6d671dd459f9d76a684d167f935: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:14:56.028604 12067 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ffb89a1c3989431e8a587f4acc08af4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83acb6d671dd459f9d76a684d167f935 in term 1.
I20260809 19:14:56.029709 12227 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5ce464c072345fb9255e047b7c04082 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83acb6d671dd459f9d76a684d167f935. Latest consensus state: current_term: 1 leader_uuid: "83acb6d671dd459f9d76a684d167f935" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83acb6d671dd459f9d76a684d167f935" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39517 } } peers { permanent_uuid: "ffb89a1c3989431e8a587f4acc08af4b" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46221 } } peers { permanent_uuid: "b5ce464c072345fb9255e047b7c04082" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 33185 } } }
I20260809 19:14:56.030020 12227 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5ce464c072345fb9255e047b7c04082 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:14:56.030416 12292 mvcc.cc:205] Tried to move back new op lower bound from 7316696661961420800 to 7316696661723918336. Current Snapshot: MvccSnapshot[applied={T|T < 7316696661961420800}]
I20260809 19:14:56.033349 12260 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 83acb6d671dd459f9d76a684d167f935 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffb89a1c3989431e8a587f4acc08af4b" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:14:56.036940 12224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:55.979741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44020 (local address 127.7.39.60:33185)
0809 19:14:55.979928 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:55.979934 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:56.005471 (+ 25537us) server_negotiation.cc:407] Connection header received
0809 19:14:56.005628 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:56.005635 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:56.005729 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:56.005813 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:56.017516 (+ 11703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:56.018552 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:56.023860 (+ 5308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:56.024470 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:56.024624 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:56.027897 (+ 3273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:14:56.027905 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:14:56.027909 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:14:56.027945 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:14:56.033328 (+ 5383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:56.034378 (+ 1050us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:56.034385 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:56.034389 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:56.034559 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:14:56.035018 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:14:56.035023 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:14:56.035027 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:14:56.035387 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:14:56.035676 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:56.036263 (+ 587us) server_negotiation.cc:299] Negotiation successful
0809 19:14:56.036536 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 19:14:56.038703 12227 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5ce464c072345fb9255e047b7c04082 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "83acb6d671dd459f9d76a684d167f935" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83acb6d671dd459f9d76a684d167f935" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39517 } } peers { permanent_uuid: "ffb89a1c3989431e8a587f4acc08af4b" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46221 } } peers { permanent_uuid: "b5ce464c072345fb9255e047b7c04082" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 33185 } } }
I20260809 19:14:56.038940 12227 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5ce464c072345fb9255e047b7c04082 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:14:56.040331 12248 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83acb6d671dd459f9d76a684d167f935 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "83acb6d671dd459f9d76a684d167f935" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83acb6d671dd459f9d76a684d167f935" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39517 } } peers { permanent_uuid: "ffb89a1c3989431e8a587f4acc08af4b" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46221 } } peers { permanent_uuid: "b5ce464c072345fb9255e047b7c04082" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 33185 } } }
I20260809 19:14:56.040735 12248 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83acb6d671dd459f9d76a684d167f935 [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:56.042181 12286 catalog_manager.cc:1347] Generated new cluster ID: c8466e80c2cd4f6c87799abcbc01b644
I20260809 19:14:56.042323 12286 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:14:56.042440 12300 mvcc.cc:205] Tried to move back new op lower bound from 7316696661961420800 to 7316696661723918336. Current Snapshot: MvccSnapshot[applied={T|T < 7316696661961420800}]
I20260809 19:14:56.075727 12321 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffb89a1c3989431e8a587f4acc08af4b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "83acb6d671dd459f9d76a684d167f935" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83acb6d671dd459f9d76a684d167f935" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39517 } } peers { permanent_uuid: "ffb89a1c3989431e8a587f4acc08af4b" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46221 } } peers { permanent_uuid: "b5ce464c072345fb9255e047b7c04082" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 33185 } } }
I20260809 19:14:56.076010 12302 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffb89a1c3989431e8a587f4acc08af4b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83acb6d671dd459f9d76a684d167f935. Latest consensus state: current_term: 1 leader_uuid: "83acb6d671dd459f9d76a684d167f935" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83acb6d671dd459f9d76a684d167f935" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39517 } } peers { permanent_uuid: "ffb89a1c3989431e8a587f4acc08af4b" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46221 } } peers { permanent_uuid: "b5ce464c072345fb9255e047b7c04082" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 33185 } } }
I20260809 19:14:56.076258 12321 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffb89a1c3989431e8a587f4acc08af4b [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:14:56.076314 12302 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffb89a1c3989431e8a587f4acc08af4b [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:14:56.085291 12260 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83acb6d671dd459f9d76a684d167f935 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "83acb6d671dd459f9d76a684d167f935" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83acb6d671dd459f9d76a684d167f935" member_type: VOTER last_known_addr { host: "127.7.39.62" port: 39517 } } peers { permanent_uuid: "ffb89a1c3989431e8a587f4acc08af4b" member_type: VOTER last_known_addr { host: "127.7.39.61" port: 46221 } } peers { permanent_uuid: "b5ce464c072345fb9255e047b7c04082" member_type: VOTER last_known_addr { host: "127.7.39.60" port: 33185 } } }
I20260809 19:14:56.085660 12260 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83acb6d671dd459f9d76a684d167f935 [sys.catalog]: This master's current role is: LEADER
I20260809 19:14:56.092536 12286 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:14:56.094319 12286 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:14:56.108017 12286 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 83acb6d671dd459f9d76a684d167f935: Generated new TSK 0
I20260809 19:14:56.109030 12286 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:14:56.129310 12329 catalog_manager.cc:1259] Loaded cluster ID: c8466e80c2cd4f6c87799abcbc01b644
I20260809 19:14:56.129537 12329 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ffb89a1c3989431e8a587f4acc08af4b: loading cluster ID for follower catalog manager: success
I20260809 19:14:56.133315 12329 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ffb89a1c3989431e8a587f4acc08af4b: acquiring CA information for follower catalog manager: success
I20260809 19:14:56.135892 12329 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ffb89a1c3989431e8a587f4acc08af4b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260809 19:14:56.234510 11993 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:14:56.224165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44030 (local address 127.7.39.62:39517)
0809 19:14:56.224418 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:56.224424 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:56.231378 (+ 6954us) server_negotiation.cc:407] Connection header received
0809 19:14:56.232830 (+ 1452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:56.232838 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:56.232927 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:56.233024 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:56.234229 (+ 1205us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44030: BlockingRecv error: recv got EOF from 127.0.0.1:44030 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
W20260809 19:14:56.237880 12112 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:14:56.231925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35040 (local address 127.7.39.61:46221)
0809 19:14:56.232158 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:56.232164 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:56.235908 (+ 3744us) server_negotiation.cc:407] Connection header received
0809 19:14:56.236605 (+ 697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:56.236610 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:56.236717 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:56.236791 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:56.237664 (+ 873us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35040: BlockingRecv error: recv got EOF from 127.0.0.1:35040 (error 108)
Metrics: {"server-negotiator.queue_time_us":96}
W20260809 19:14:56.243184 12224 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:14:56.240659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44030 (local address 127.7.39.60:33185)
0809 19:14:56.240816 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:56.240821 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:56.241411 (+ 590us) server_negotiation.cc:407] Connection header received
0809 19:14:56.241673 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:56.241678 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:56.241778 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:56.241867 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:56.242927 (+ 1060us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44030: BlockingRecv error: recv got EOF from 127.0.0.1:44030 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 19:14:56.291602 12112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:56.277105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35042 (local address 127.7.39.61:46221)
0809 19:14:56.277291 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:56.277296 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:56.284195 (+ 6899us) server_negotiation.cc:407] Connection header received
0809 19:14:56.284500 (+ 305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:56.284507 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:56.284744 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:56.284919 (+ 175us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:14:56.285482 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:56.286678 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:56.288652 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:56.289379 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:56.289520 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:56.290139 (+ 619us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:14:56.290869 (+ 730us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:14:56.291053 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:56.291161 (+ 108us) server_negotiation.cc:299] Negotiation successful
0809 19:14:56.291263 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
W20260809 19:14:56.306744 12224 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:14:56.298478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44044 (local address 127.7.39.60:33185)
0809 19:14:56.298669 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:56.298676 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:56.304999 (+ 6323us) server_negotiation.cc:407] Connection header received
0809 19:14:56.305273 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:56.305281 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:56.305442 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:56.305576 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:56.306489 (+ 913us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44044: BlockingRecv error: recv got EOF from 127.0.0.1:44044 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 19:14:56.358103 12112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:56.345243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35052 (local address 127.7.39.61:46221)
0809 19:14:56.345491 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:56.345498 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:56.350882 (+ 5384us) server_negotiation.cc:407] Connection header received
0809 19:14:56.351236 (+ 354us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:56.351244 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:56.351364 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:56.351446 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:14:56.352227 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:56.353400 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:56.355618 (+ 2218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:56.356369 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:56.356481 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:56.357168 (+ 687us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:14:56.357337 (+ 169us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:14:56.357405 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:56.357668 (+ 263us) server_negotiation.cc:299] Negotiation successful
0809 19:14:56.357757 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
W20260809 19:14:56.397023 12224 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:14:56.387837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44050 (local address 127.7.39.60:33185)
0809 19:14:56.388046 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:56.388053 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:56.394951 (+ 6898us) server_negotiation.cc:407] Connection header received
0809 19:14:56.395479 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:56.395486 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:56.395589 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:56.395672 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:56.396761 (+ 1089us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44050: BlockingRecv error: recv got EOF from 127.0.0.1:44050 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 19:14:56.421299 12112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:56.410755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35060 (local address 127.7.39.61:46221)
0809 19:14:56.410941 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:56.410948 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:56.414868 (+ 3920us) server_negotiation.cc:407] Connection header received
0809 19:14:56.415068 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:56.415074 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:56.415193 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:56.415299 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:14:56.415812 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:56.416957 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:56.419013 (+ 2056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:56.419735 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:56.419862 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:56.420397 (+ 535us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:14:56.420572 (+ 175us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:14:56.420661 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:56.420820 (+ 159us) server_negotiation.cc:299] Negotiation successful
0809 19:14:56.420900 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260809 19:14:56.432440 12224 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:14:56.428116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44060 (local address 127.7.39.60:33185)
0809 19:14:56.428342 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:56.428349 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:56.430899 (+ 2550us) server_negotiation.cc:407] Connection header received
0809 19:14:56.431097 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:56.431103 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:56.431203 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:56.431318 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:56.432183 (+ 865us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44060: BlockingRecv error: recv got EOF from 127.0.0.1:44060 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 19:14:56.447355 12112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:56.440278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35074 (local address 127.7.39.61:46221)
0809 19:14:56.440519 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:56.440525 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:56.441137 (+ 612us) server_negotiation.cc:407] Connection header received
0809 19:14:56.441313 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:56.441319 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:56.441408 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:56.441514 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:14:56.441978 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:56.443201 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:56.445144 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:56.445919 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:56.446062 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:56.446544 (+ 482us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:14:56.446687 (+ 143us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:14:56.446787 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:56.446967 (+ 180us) server_negotiation.cc:299] Negotiation successful
0809 19:14:56.447057 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
W20260809 19:14:56.458216 12224 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:14:56.456004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44074 (local address 127.7.39.60:33185)
0809 19:14:56.456256 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:56.456262 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:56.456780 (+ 518us) server_negotiation.cc:407] Connection header received
0809 19:14:56.456936 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:56.456942 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:56.457035 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:56.457146 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:56.458011 (+ 865us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44074: BlockingRecv error: recv got EOF from 127.0.0.1:44074 (error 108)
Metrics: {"server-negotiator.queue_time_us":143}
I20260809 19:14:56.476253 12112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:56.469257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35084 (local address 127.7.39.61:46221)
0809 19:14:56.469449 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:56.469455 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:56.469978 (+ 523us) server_negotiation.cc:407] Connection header received
0809 19:14:56.470194 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:56.470200 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:56.470332 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:56.470431 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:14:56.470991 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:56.472143 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:56.474148 (+ 2005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:56.474850 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:56.474986 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:56.475463 (+ 477us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:14:56.475627 (+ 164us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:14:56.475724 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:56.475866 (+ 142us) server_negotiation.cc:299] Negotiation successful
0809 19:14:56.475945 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260809 19:14:56.485957 12224 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:14:56.483452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44080 (local address 127.7.39.60:33185)
0809 19:14:56.483641 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:56.483648 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:56.484146 (+ 498us) server_negotiation.cc:407] Connection header received
0809 19:14:56.484446 (+ 300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:56.484453 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:56.484565 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:56.484643 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:56.485697 (+ 1054us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44080: BlockingRecv error: recv got EOF from 127.0.0.1:44080 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 19:14:56.513330 12112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:56.506148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35100 (local address 127.7.39.61:46221)
0809 19:14:56.506370 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:56.506377 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:56.506911 (+ 534us) server_negotiation.cc:407] Connection header received
0809 19:14:56.507231 (+ 320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:56.507237 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:56.507358 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:56.507471 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:14:56.507914 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:56.509175 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:56.511131 (+ 1956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:56.511827 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:56.511978 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:56.512505 (+ 527us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:14:56.512649 (+ 144us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:14:56.512755 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:56.512927 (+ 172us) server_negotiation.cc:299] Negotiation successful
0809 19:14:56.513036 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
W20260809 19:14:56.528708 12224 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:14:56.520303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44086 (local address 127.7.39.60:33185)
0809 19:14:56.520490 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:56.520496 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:56.526815 (+ 6319us) server_negotiation.cc:407] Connection header received
0809 19:14:56.527097 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:56.527104 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:56.527209 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:56.527295 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:56.528473 (+ 1178us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44086: BlockingRecv error: recv got EOF from 127.0.0.1:44086 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 19:14:56.571907 12112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:56.565636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35102 (local address 127.7.39.61:46221)
0809 19:14:56.565894 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:56.565901 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:56.566309 (+ 408us) server_negotiation.cc:407] Connection header received
0809 19:14:56.566546 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:56.566550 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:56.566621 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:56.566701 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:14:56.567251 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:56.567999 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:56.570035 (+ 2036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:56.570500 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:56.570594 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:56.571168 (+ 574us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:14:56.571272 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:14:56.571354 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:56.571538 (+ 184us) server_negotiation.cc:299] Negotiation successful
0809 19:14:56.571603 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
W20260809 19:14:56.582059 12224 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:14:56.580094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44090 (local address 127.7.39.60:33185)
0809 19:14:56.580316 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:56.580322 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:56.580701 (+ 379us) server_negotiation.cc:407] Connection header received
0809 19:14:56.580884 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:56.580887 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:56.580956 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:56.581042 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:56.581841 (+ 799us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44090: BlockingRecv error: recv got EOF from 127.0.0.1:44090 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 19:14:56.655624 12112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:56.649724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35106 (local address 127.7.39.61:46221)
0809 19:14:56.649920 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:56.649927 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:56.650334 (+ 407us) server_negotiation.cc:407] Connection header received
0809 19:14:56.650538 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:56.650545 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:56.650642 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:56.650752 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:14:56.651116 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:56.652276 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:56.653614 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:56.654277 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:56.654453 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:56.654862 (+ 409us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:14:56.655030 (+ 168us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:14:56.655131 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:56.655231 (+ 100us) server_negotiation.cc:299] Negotiation successful
0809 19:14:56.655314 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260809 19:14:56.663635 12224 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:14:56.661903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44098 (local address 127.7.39.60:33185)
0809 19:14:56.662122 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:56.662129 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:56.662331 (+ 202us) server_negotiation.cc:407] Connection header received
0809 19:14:56.662511 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:56.662518 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:56.662613 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:56.662725 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:56.663398 (+ 673us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44098: BlockingRecv error: recv got EOF from 127.0.0.1:44098 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
I20260809 19:14:56.799726 12112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:56.795188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35122 (local address 127.7.39.61:46221)
0809 19:14:56.795424 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:56.795431 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:56.795660 (+ 229us) server_negotiation.cc:407] Connection header received
0809 19:14:56.795821 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:56.795825 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:56.795899 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:56.795978 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:14:56.796336 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:56.797045 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:56.798260 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:56.798663 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:56.798748 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:56.799091 (+ 343us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:14:56.799210 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:14:56.799269 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:56.799362 (+ 93us) server_negotiation.cc:299] Negotiation successful
0809 19:14:56.799422 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
W20260809 19:14:56.806695 12224 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:14:56.804911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44110 (local address 127.7.39.60:33185)
0809 19:14:56.805112 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:56.805118 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:56.805360 (+ 242us) server_negotiation.cc:407] Connection header received
0809 19:14:56.805526 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:56.805532 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:56.805610 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:56.805694 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:14:56.806436 (+ 742us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44110: BlockingRecv error: recv got EOF from 127.0.0.1:44110 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 19:14:56.812358 12245 catalog_manager.cc:1259] Loaded cluster ID: c8466e80c2cd4f6c87799abcbc01b644
I20260809 19:14:56.812429 12245 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b5ce464c072345fb9255e047b7c04082: loading cluster ID for follower catalog manager: success
I20260809 19:14:56.814782 12245 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b5ce464c072345fb9255e047b7c04082: acquiring CA information for follower catalog manager: success
I20260809 19:14:56.816459 12245 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b5ce464c072345fb9255e047b7c04082: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 19:14:57.072753 12112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:57.067882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35124 (local address 127.7.39.61:46221)
0809 19:14:57.068049 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:57.068054 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:57.068376 (+ 322us) server_negotiation.cc:407] Connection header received
0809 19:14:57.068555 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:57.068559 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:57.068631 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:57.068708 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:14:57.069135 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:57.069886 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:57.071285 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:57.071717 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:57.071811 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:57.072170 (+ 359us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:14:57.072285 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:14:57.072353 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:57.072476 (+ 123us) server_negotiation.cc:299] Negotiation successful
0809 19:14:57.072541 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 19:14:57.083211 12224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:57.078093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44112 (local address 127.7.39.60:33185)
0809 19:14:57.078310 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:57.078316 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:57.078593 (+ 277us) server_negotiation.cc:407] Connection header received
0809 19:14:57.078730 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:57.078735 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:57.078950 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:57.079057 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:14:57.079357 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:57.080041 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:57.081215 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:57.081571 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:57.081654 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:57.082072 (+ 418us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:14:57.082631 (+ 559us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:14:57.082749 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:57.082843 (+ 94us) server_negotiation.cc:299] Negotiation successful
0809 19:14:57.082917 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 19:14:57.094591 12503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:57.088322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44038 (local address 127.7.39.62:39517)
0809 19:14:57.088800 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:57.088805 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:57.088823 (+ 18us) server_negotiation.cc:407] Connection header received
0809 19:14:57.088919 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:57.088924 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:57.089138 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:57.089308 (+ 170us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:14:57.089746 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:57.090801 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:57.092056 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:57.092581 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:57.092684 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:57.093106 (+ 422us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:14:57.093427 (+ 321us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:14:57.093519 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:57.094201 (+ 682us) server_negotiation.cc:299] Negotiation successful
0809 19:14:57.094283 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":247,"threads_started":1}
I20260809 19:14:57.095141 12112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:57.088796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35130 (local address 127.7.39.61:46221)
0809 19:14:57.088956 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:57.088962 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:57.089933 (+ 971us) server_negotiation.cc:407] Connection header received
0809 19:14:57.090163 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:57.090168 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:57.090251 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:57.090364 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:14:57.090881 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:57.091574 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:57.093383 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:57.093843 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:57.093949 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:57.094479 (+ 530us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:14:57.094568 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:14:57.094642 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:57.094811 (+ 169us) server_negotiation.cc:299] Negotiation successful
0809 19:14:57.094881 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 19:14:57.096740 12224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:14:57.089418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44128 (local address 127.7.39.60:33185)
0809 19:14:57.089594 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 19:14:57.089600 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:14:57.090027 (+ 427us) server_negotiation.cc:407] Connection header received
0809 19:14:57.090248 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:14:57.090253 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:14:57.090354 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:14:57.090431 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:14:57.092379 (+ 1948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:57.093377 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:57.095015 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:14:57.095594 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:14:57.095715 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:14:57.096093 (+ 378us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:14:57.096211 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:14:57.096293 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 19:14:57.096416 (+ 123us) server_negotiation.cc:299] Negotiation successful
0809 19:14:57.096485 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 19:14:57.099738 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 11895
I20260809 19:14:57.100644 11980 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:14:57.206915 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 11895
W20260809 19:14:57.229970 12140 connection.cc:535] server connection from 127.0.0.1:44012 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 19:14:57.230630 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 12003
I20260809 19:14:57.231768 12097 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:14:57.337365 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 12003
I20260809 19:14:57.361112 7324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu pid 12116
I20260809 19:14:57.362342 12212 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:14:57.466991 7324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP6iNI4/build/asan/bin/kudu with pid 12116
2026-08-09T19:14:57Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (4624 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (9660 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (358793 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST